Connect with us

Tech News

Big data: overcoming cherry picking and endless variables

Big data presents businesses of all size with unprecedented insight into before unseen details, but does more data equal more problems? The answer may not be yes or no…

Published

on

big data

big data

Big data presenting big problems?

We have long written about “Big Data” which is defined as large data sets which cannot be managed with simple, common software that captures and processes the data, and is typically consisting of at least dozens of terabytes in a single data set. The challenges of Big Data are, clearly big, and most attention is being paid to the massive amounts of data being generated by social media sites like Facebook and Foursquare.

But it’s not just consumer data that is being called into question. Industry expert Nassim Taleb recently opined on WIRED, “With big data, researchers have brought cherry-picking to an industrial level. Modernity provides too many variables, but too little data per variable. So the spurious relationships grow much, much faster than real information. In other words: Big data may mean more information, but it also means more false information.”

Taleb addresses something that could lead one to think that big data is faulty and bad, but perhaps Taleb is really pointing out the human nature that is still required in some instances of analyzing big data – and most people would not typically question a researcher or their methods, leaving analysis in its youngest phase subjective.

Defining variables is key in big data analysis

Nitin Mayande is the Co-Founder and Chief Scientist at Tellagence which offers the next step in social marketing intelligence through predictive products. Mayande has a PhD in Engineering Management and is a well respected figure in the industry. He tells AGBeat that Taleb’s statement isn’t necessarily wrong, nor is it completely correct.

Mayande noted that Taleb “is right in saying that with big data one can use many many more variables but to say too little data per variable might not be right. By the way when analyzing the data, the efficacy of variables depends upon the frame of reference and the system definition one chooses. If one uses a open system instead of closed system it may not be possible to define variables at all.”

The great irony of big data

Chris Treadaway, CEO and Founder of Polygraph Media which is famous for data-driven analytics said, “To analyze big data, you have to know when you have enough data, know that you’re looking at the right data, and know how and when to draw conclusions from the data using methods developed from statistics theory and data science. That’s the great irony of “big data” – it’s as much of an art as a science, which is why the best efforts are multidisciplinary.”

“Big data can find tremendous hidden relationships,” Treadaway continued, “but you have to make sure your bias isn’t to find conclusions that don’t exist. Bias can cause the situation Taleb describes, and will cause disinformation as he says. If you’re cautious, discerning, and careful, you can make the most of big data. But there are pitfalls for the careless.”

More data is not the answer

Matt Hixson, Co-Founder and CEO of Tellagence stated, “I would agree that more data is not the answer. Most problems need the right data – not an infinite set. I see this a ton in social, people don’t fully understand what is going on so they just keep correlating more and more data.”

Hixson continued, “This is all that most of the big data scientists at Twitter, LinkedIn and Facebook are doing because the don’t know what else to do. The platforms that are generating this data – social networks are a primary source – creating new phenomena that people don’t understand yet.”

Big data remains a treasure trove of information while also presenting challenges as the world attempts to make sense of the tool and how to analyze the infinite amounts of data.

Tech News

Not just for gaming: How virtual reality can save PTSD patients

(TECH NEWS) Thanks to its ability to simulate situations safely, virtual reality technologies are proving effective in therapy for PTSD patients.

Published

on

Woman wearing a VR headset in warm sunny lighting, PTSD patients treatment

Over the last year, a great many people have developed a new and sometimes dangerous relationship with a new emotional state, anxiety. I know that personally I’d never had a panic attack in my life until the middle of the pandemic. For many these emotions have taken the form of actual disorders. Actual mental influences which affect everyday life on a large scale. One of the most common forms of which is PTSD.

This disorder has many different aspects and can affect people in a number of different and debilitating ways. Finding treatments for PTSD patients and other anxiety disorders – especially treatments that don’t involve drugging people into oblivion has been difficult.

A lot of these disorders require exposure therapy. Putting people back into similar situations which caused the original trauma so that their brains can adjust to the situation and not get stuck in pain or panic loops. But how do you do that for things like battlefield trauma. You can’t just create situations with gunfire and dead bodies! Or can you?

This is where VR starts coming in. Thanks to the falling cost of VR headsets, noted by The Economist, psychologists are more capable of creating these real world situations that can actually help people adjust to their individual trauma.

One therapist went so far as to compare it to easy access opioids for therapy. This tool is so powerful that of the 20 veterans that they started with, 16 of them no longer qualify for the categories of PTSD. That’s a 75% success rate with an over-the-counter medicine. I can think of antihistamines and painkillers that aren’t that good.

I’ve grown up around PTSD patients. The majority of my family have been in the military. I was even looking at a career before I was denied service. I have enough friends that deal with PTSD issues that I have a list of things I remember not to invite certain people to so as not to trigger it. Any and every tool available that could help people adapt to their trauma is worthwhile.

Continue Reading

Tech News

Tired of email spam? This silly, petty solution might provide vindication

(TECH NEWS) If you struggle to keep your inbox clean thanks to a multitude of emails, the widget “You’ve Got Spam” could provide some petty catharsis.

Published

on

Email icon with 20 possible spam emails on phone screen.

We’re all spending a lot of time behind our computers and inside of our inboxes these days, so it makes sense that some people—not naming names—might be sick of seeing several unsolicited emails a day from marketers and other unsavory businesses.

While we can’t recommend a mature, adult solution that hasn’t already been beaten to death (looking at you, “inbox zero” crowd), we can recommend a childish one: Signing solicitors up for spam.

If you do decide to go the petty route, “You’ve Got Spam”—a free email widget from MSCHF—has you covered. Upon installing the widget, you can configure it to respond automatically to incoming cold-marketing emails with tons of subscriptions to spam sources, thus resulting in overwhelming the sender with a crowded inbox and cultivating a potentially misplaced sense of catharsis for yourself.

The widget itself is fairly simple: You only need to install it to Gmail from the MSCHF website. The rest is pretty self-explanatory. When you receive an email from a person from whom you can safely assume you’ll never be receiving favors ever again, you can open it and click the “You’ve Got Spam” icon to sign the sender up for spam lists galore.

See? Petty, but effective.

The developer page does fail to make the distinction between the promised “100” subscriptions and the “hundreds of spam subscriptions” discussed on Product Hunt. But one can assume that anyone who dares trespass on the sacred grounds of your squeaky-clean inbox will rue the day they did so regardless of the exact number of cat litter magazine subscriptions they receive.

Of course, actually using something like “You’ve Got Spam” is, realistically, a poor choice. It takes exactly as much effort to type, “We’ll pass – thanks!” as a response to anyone cold-emailing you, and you’re substantially less likely to piss off the actual human being on the other side by doing so. Services like this are heavy on the comedic shock value, but the empathy side tends to lack a discernible presence.

That said, if you absolutely must wreck someone’s day—and inbox—MSCHF’s “You’ve Got Spam” is a pretty ingenious way to do it.

Continue Reading

Tech News

Clubhouse finally made it to Android, but has its time passed?

(TECH NEWS) Social media felt the impact of Clubhouse, but the internet moves fast, and even though it is finally on Android, it’s time may be waning.

Published

on

Woman holding book and a phone, with headphones, participating in Clubhouse.

Clubhouse finally got an Android release, and while many people clamored for such a thing months ago, others argue that it’s too little, too late.

If you aren’t familiar with Clubhouse, it’s an audio-only “social platform” that encourages discussions through live chat rooms. Users can drop into various rooms and listen to people talk, request the option to chime in, and follow a variety of rooms (or “topics”) to stay engaged over time. Users can even create their own rooms that feature them as speakers.

Clubhouse also has a certain allure to it in that the app requires new users to put their names on a waitlist that creates an “invite-only” culture of exclusivity.

But while iPhone users have had access to Clubhouse since its inception, Android users have been not-so-patiently waiting for their own release—and, now that Clubhouse for Android is available, it may have outstayed its welcome.

Part of the problem is the launch itself. The Android Clubhouse app launched with limited functionality; Android users weren’t able to follow the topics they like, change their account information, and so on. This made the release feel underwhelming, further highlighting Clubhouse’s affinity for Apple users.

A more complicated problem is the prevalence of audio options in other social media services. Slack, for example, recently released their audio-only rooms, and services such as Twitter, Facebook, and Instagram have placed a spotlight on voice-only mediums of expression.

Initially, Clubhouse was the only app to incorporate audio as a strong central focus, but the ubiquitous fascination with voice-posting has expanded to comprise most major communication platforms. As such, Clubhouse’s sought-after exclusivity is no more—something that was also arguably damaged by expanding to Android.

It should be noted that interest in the app itself is decreasing, and not just on Android. Social Media Today reported that, in March of 2021, Clubhouse downloads were down 72 percent from February’s 9.6 million downloads. The publication also pointed out that difficulty finding rooms was a substantial issue that is unlikely to do anything but worsen with a surge of Android users, necessitating some back-end fixes from the owners.

As it sits, Clubhouse is still very much in use, and Android users are poised to reignite interest as iOS users stagnate. Whether or not that interest will persevere in the current social media ecosystem remains to be seen.

Continue Reading

Our Great Partners

The
American Genius
news neatly in your inbox

Subscribe to our mailing list for news sent straight to your email inbox.

Emerging Stories

Get The American Genius
neatly in your inbox

Subscribe to get business and tech updates, breaking stories, and more!