The Challenges Surrounding Big Data

Big Data in simple terms, as outlined by Oracle, is larger and more complex sets of data particularly from new sources such as social media and cloud applications. The data is structured, semi structured and unstructured and is collected to mine information and identify trends. It features the 5 V’s: 

 
Data-driven innovations all over the world today are optimising this process, However, it is raising concerns around the ethical and social implications of its misuse. In the ‘datafication’ of our society, these challenges are referred to as the ‘creep factor’ (Bormida, 2021).

Let’s Discuss: 

Privacy Concerns and Security: The data’s structure, source, storage location, format and device type is a key security concern, with the possibility of unauthorised access, cybercriminals, misuse and the question of ‘is this personal data even acceptable to collect’? Yahoo’s data breach in 2013 was the worst in history – affecting 3 BILLION accounts: read about it here https://www.csoonline.com/article/534628/the-biggest-data-breaches-of-the-21st-century.html 

Consent and biased algorithms: Collectors of big data ask for consent through the terms of ‘cookies’ online and upon account registrations in terms and conditions, to allow them to collect, analyse, use and/or share the data whatever way they want. These are not in simple terms or easy to read which is where the issue of ‘informed consent’ rises and with or without consent, there have been way too many cases where the data was used to create biased algorithms. For example, in 2018, it was revealed that Facebook allowed Cambridge Analytica (UK Consulting firm) to harvest personal data of more than 80 million users without their permission and used the data to target voters in America coming up to the 2016 presidential election. Ethically and socially this is a serious issue, and many studies have also found that biased algorithms can lead to discrimination and out-casting of minority groups in society. 

 
There are other concerns such as transparency, accountability and responsible use of the data - Balancing Big Data’s benefits with these concerns is the biggest challenge we now face today but thankfully more and more regulation is being implemented to tackle these issues.

Leave a comment with your thoughts below (or don’t... as it will be collected and stored🤣) and check out this journal for more insights: Emerald.com