Connect with us

Tech News

Big data: overcoming cherry picking and endless variables

Big data presents businesses of all size with unprecedented insight into before unseen details, but does more data equal more problems? The answer may not be yes or no…

Published

on

big data

big data

Big data presenting big problems?

We have long written about “Big Data” which is defined as large data sets which cannot be managed with simple, common software that captures and processes the data, and is typically consisting of at least dozens of terabytes in a single data set. The challenges of Big Data are, clearly big, and most attention is being paid to the massive amounts of data being generated by social media sites like Facebook and Foursquare.

But it’s not just consumer data that is being called into question. Industry expert Nassim Taleb recently opined on WIRED, “With big data, researchers have brought cherry-picking to an industrial level. Modernity provides too many variables, but too little data per variable. So the spurious relationships grow much, much faster than real information. In other words: Big data may mean more information, but it also means more false information.”

Taleb addresses something that could lead one to think that big data is faulty and bad, but perhaps Taleb is really pointing out the human nature that is still required in some instances of analyzing big data – and most people would not typically question a researcher or their methods, leaving analysis in its youngest phase subjective.

Defining variables is key in big data analysis

Nitin Mayande is the Co-Founder and Chief Scientist at Tellagence which offers the next step in social marketing intelligence through predictive products. Mayande has a PhD in Engineering Management and is a well respected figure in the industry. He tells AGBeat that Taleb’s statement isn’t necessarily wrong, nor is it completely correct.

Mayande noted that Taleb “is right in saying that with big data one can use many many more variables but to say too little data per variable might not be right. By the way when analyzing the data, the efficacy of variables depends upon the frame of reference and the system definition one chooses. If one uses a open system instead of closed system it may not be possible to define variables at all.”

The great irony of big data

Chris Treadaway, CEO and Founder of Polygraph Media which is famous for data-driven analytics said, “To analyze big data, you have to know when you have enough data, know that you’re looking at the right data, and know how and when to draw conclusions from the data using methods developed from statistics theory and data science. That’s the great irony of “big data” – it’s as much of an art as a science, which is why the best efforts are multidisciplinary.”

“Big data can find tremendous hidden relationships,” Treadaway continued, “but you have to make sure your bias isn’t to find conclusions that don’t exist. Bias can cause the situation Taleb describes, and will cause disinformation as he says. If you’re cautious, discerning, and careful, you can make the most of big data. But there are pitfalls for the careless.”

More data is not the answer

Matt Hixson, Co-Founder and CEO of Tellagence stated, “I would agree that more data is not the answer. Most problems need the right data – not an infinite set. I see this a ton in social, people don’t fully understand what is going on so they just keep correlating more and more data.”

Hixson continued, “This is all that most of the big data scientists at Twitter, LinkedIn and Facebook are doing because the don’t know what else to do. The platforms that are generating this data – social networks are a primary source – creating new phenomena that people don’t understand yet.”

Big data remains a treasure trove of information while also presenting challenges as the world attempts to make sense of the tool and how to analyze the infinite amounts of data.

Lani is the Chief Operating Officer at The American Genius and sister news outlet, The Real Daily, and has been named in the Inman 100 Most Influential Real Estate Leaders several times, co-authored a book, co-founded BASHH and Austin Digital Jobs, and is a seasoned business writer and editorialist with a penchant for the irreverent.

Tech News

OnePlus swears to kinda stop collecting invasive data from users

(TECH NEWS) Inadvertently discovered during a hackathon, OnePlus was ousted for collecting insane amounts of data on users’ phones and promises to make a small change.

Published

on

oneplus

Users of OnePlus phones were alarmed to learn this week that the company has been collecting large amounts of data from users without their consent or knowledge.

Software Engineer, Christopher Moore was participating in a hacking challenge when he discovered that his phone was sending excessive amounts of data to the OnePlus servers.

While it’s normal for your phone to automatically send data to headquarters when you have a bug or a system crash, OnePlus was collecting data every time the phone was turned off or on, and whenever apps were used.

“Moore says that OnePlus is collecting data such as phone numbers, serial numbers, WiFi and mobile network information, MAC addresses, and information about when and how apps are used, including Outlook and Slack.”

An opt-out option was buried deep within advanced settings. Most users were not aware that their data was being collected and transmitted.

In response to the user outcry, OnePlus posted an explanation on their support forum, saying that they were using the data to “fine tune our software according to user behavior” and to “provide better after-sales support.”

The company has promised to stop collecting MAC addresses, phone numbers, and WiFi information by the end of the month. They also say that they will update their terms of service to be more transparent about the data they are collecting, and will set up an opt-out option in the operating system’s setup wizard that will allow users to decide whether or not they want to join a “user experience program.”

While OnePlus claims that they have never given or sold information to a third party, users are suspicious that the types of data OnePlus is collecting would eventually be sold to marketers.

Even if you choose to opt out of the “user experience program”, OnePlus will continue to collect your data, but it will not be directly associated with your device. Users have generally not been satisfied with this response, saying that the company should give users the option of stopping all data transmissions.

Says Christopher Moore “Unfortunately, as a system service, there doesn’t appear to be any way of permanently disabling this data collection or removing this functionality without rooting the phone.”

You kind of blew it, OnePlus. You were caught red-handed, and it will take more than a partial opt out program to regain your customers’ trust.

Continue Reading

Tech News

With reward comes risk: facial recognition and privacy

(TECH NEWS) Facial recognition and artificial intelligence are awesome rewards from technical innovation but with reward comes risk.

Published

on

ai facial recognition risk

Technology is an omnipresent force in all of our lives. It is the core of innovation, providing us with quick, new ways to research, socialize and entertain ourselves. It seems like everyone is taking advantage of rapidly changing technology.

However what one person thinks as a reward of new systems may actually be a risk to someone else.

Take for instance, facial recognition software. Facebook uses it to identify familiar faces in photos and Apple uses it to unlock phones. It’s everywhere.

Even the porn industry is getting in on it. PornHub, a major online source for adult content, announced their new plan to use AI to help categorize the 10,000 plus videos that are uploaded every day.

Prior to this update, the site used a system of tagging videos to keep them organized. I would go into examples of such categories, but I’ll leave that up to the imagination.

One non-explicit example is organizing content based on the names of the stars of the film. Both the site itself and users had the ability to add tags to videos.

Regardless, this was not fast enough. By integrating AI software, PornHub hopes to expedite this process.

While this may sound like a smart business decision, this seems like high risk beginning to inadvertently diminish privacy rights.

Many people in the porn industry have alternate personas to separate their work and personal lives. Facial recognition software may pull from sources from both sides of that spectrum and end up merging the two.

This has already been the case on Facebook via the recommendations the site makes for “people you may know” via your internet practices.

However, it’s not just a matter of protecting the identity for a professional or amateur porn actor, it’s also about the privacy of clients.

Imagine being recommended to friend the star of the last video you streamed. This industry in particular, requires a level of discretion.

To combat some of the fears, PornHub has insists that the AI software only tags from the 10,000 stars in their database. Though as this update has proven, they could expand their database to keep up with the demand in the future.

It’s a technological advantage for their organization, but at what cost to others’ privacy?

Continue Reading

Tech News

Be My Eyes app offers eyes to those that need ’em

(TECH NEWS) Even with the best coping techniques, some people need help from time to time — enter Be My Eyes for the seeing impaired community.

Published

on

eyes

It’s nice to see a free app that connects helpful volunteers with folks seeking assistance.

“See” being a relative term here, because the free Be My Eyes app is designed to assist people who are visually impaired or blind. The anonymous and free app allows visually impaired users to connect, via video, to sighted volunteers who can then provide “visual assistance” to help with tasks such as identifying objects or describing environments.

Visually impaired users seeking assistance simply call in and the app finds the first available volunteer, usually within 45 to 60 seconds. The app automatically connects to a sighted volunteer who speaks the user’s language. There are currently volunteers representing 90 languages in 150 countries.

Be My Eyes also tracks the time zones in users’ locations so that visually impaired users can access the service 24 hours a day without worrying that they’ll disturb volunteers at night.

After dark, the app will even find a volunteer in the opposite hemisphere. Users are encouraged to ask for assistance whenever they want and as often as needed.

Sighted volunteers receive a notification when a visually impaired user seeks assistance. The volunteer can then decide whether or not to receive the call. If they aren’t available, the call is simply forwarded to the next appropriate volunteer.

Visually impaired users say they’ve used Be My Eyes to get help with finding lost items, reading instructions, navigating new places and public transportation, shopping, and more.

The app itself was invented by a visually impaired innovator, Hans Jørgen Wiberg, a member of the Danish Association of the Blind who began losing his sight at age 25.

Says Wiberg, “It is flexible, takes only a few minutes to help and the app is therefore a good opportunity for the busy, modern individual with the energy to help others.”

Wilberg presented his idea for Be My Eyes at a startup event in Denmark in 2012. He was able to recruit a team of developers, who rolled out the app in 2015.

Some critics have pointed out that the app tends to reinforce the stereotype that visually impaired people, and people with disabilities in general, are helpless and dependent on others to get by. Presumably, blind people have developed inventive strategies for solving everyday challenges long before Be My Eyes was ever invented.

According to the reviews from sighted volunteers, many wait weeks at a time to get an inquiry. The Be My Eyes network currently has about ten times more volunteers than users, which begs the question: Do blind people actually want to use this app?

If you’d like to try it out, as either a visually impaired user or a sighted volunteer, you can download the app for Android at the Google Play Store or for iOS at the App Store.

Continue Reading
Advertisement

The
American Genius
News neatly in your inbox

Join thousands of AG fans and SUBSCRIBE to get business and tech news updates, breaking stories, and MORE!

Emerging Stories