I think the perceived opportunity in Big Data is real and is here to stay as Big Data Mining/Analytics will fundamentally change the way business is done not only online but also offline. Here’s why: Big Data is a key enabler for Social Business and without Big Data Mining/Analytics, a large or medium sized company can neither make sense of all the user generated content online nor can collaborate with  customers, suppliers and partners effectively on Social Media channels. And both of these activities, namely gaining insights from user generated content online and collaborating with customers and partners on Social Media channels are critical for success in the age of Social Media.

Can you imagine any large or medium sized business without e-Business in the internet age? Similarly, it is impossible to run a large or medium sized business in the age of Social Media without leveraging user generated content or without collaborating with customers and partners. And for this to happen, Big Data Management, Mining and Analytics are critical/key enablers.

Being a key enabler and catalyst in Social Age, Big Data Management, Mining and Analytics companies are going to command a premium valuation and hence Big Data Mining and Analytics has triggered a new ‘Gold Rush‘, not to mine gold this time but something even more valuable – knowledge and insights.

What do you think? Do you agree that Big Data has triggered a new Gold Rush?

Here’s a simple yet very effective example of using analytics for understanding consumer attitudes towards airlines in real time. In this study, Jeffrey Breen has used the R programming language to analyze consumer sentiments about major U.S. airlines expressed on Twitter. For more on the methodology and results, see the following embedded Slideshare presentation (if you cannot see the embedded file, click here to view it on Slideshare website).

As you can see on slide no. 27, the twitter sentiment scores obtained  for many of the airlines are “comparable” to results of The American Customer Satisfaction Index (ACSI). What is important to note here is that by analyzing few tweets using freely available R programming language (which is part of the GNU project), it is possible to achieve results similar to that of an elaborate and expensive market research study such as ACSI at a fraction of a cost, that too in real time. Isn’t that a game changer?

Now imagine using Big Data Analytics to analyze Social Media data – not only text data but also pictures, video, GPS , Social Graph/Social Media linkages and using that information for engaging customers on Social Media channels. That in my opinion is the ‘holy grail’ (if I may use that term) of Social CRM.

In one of my earlier post, I have defined Social CRM as the business strategy of engaging customers through Social Media with goal of building trust and brand loyalty. Big data analytics is a key enabler for engaging customers on social media channels for building trust and loyalty (Social CRM). What do you think?

• Big Data — Big Money Says It Is A Paradigm Buster - Forbes.com
• For Start-Ups That Aim at Giants, Sorting the Data Cloud Is the Next Big Thing - The New York Times
• Accel Makes Big Commitment To Big Data With $100M Fund - The Wall Street Journal
• Five startup predictions for 2012 - c|net
• Big Data: Investments Flow into the Next Big Thing - a great post by Dick Weisinger

So what is Big Data and why it is in the news so much these days?

According to Philip Russom, Director of TDWI Research, Big Data has three defining attributes – three Vs as he calls them. They are Data Volume, Data Variety and Data Velocity and together they constitute a comprehensive definition of Big Data. So Big Data is not just about Data Volume, but also the variety of data (mostly unstructured) and the velocity with which the data is generated and need to be analyzed. (for more, check out following posts by Philip Russom and the TDWI Best Practices Report titled Big Data Analytics):

• Big Data Analytics: Frequently Asked Questions (FAQ)
• The Three Vs of Big Data Analytics: VOLUME
• The Three Vs of Big Data Analytics: VARIETY
• The Three Vs of Big Data Analytics: VELOCITY

Given three Vs of Big Data, ‘traditional’ data storage, retrieval and analytics methodologies are no longer going to work. Cloud Computing is going to play a key role when it comes to Big Data Management and Analytics. And here in lies the opportunity for Outsourcing companies.

Traditionally, data collected by organizations is ‘safely’ stored in massive relational database accessible to only few within the organization and requires elaborate infrastructure both in terms of hardware and software for storage, retrieval and reporting/analytics. In such an environment, it is not possible to easily outsource Data Analytics function/processes alone given the heavy investments made in terms of hardware and software.

Because of the business requirement of analyzing vast amount of ever changing structured and unstructured Big Data almost instantaneously, companies will be hard pressed to do this on their own. But given the fact that Big Data stored in cloud can be accessed from anywhere the internet is available and can be analysed almost instantaneously by third party service providers,  outsourcing companies can offer to their clients value added services in the area of Big Data analytics without heavy investments on the part of clients in specialized hardware and software as was the case with ‘traditional’ data analytics. This will bring down significantly costs (especially fixed costs) associated with building and maintaining analytics infrastructure and solution center.

Just to give an example in the area of Social CRM, Social Media has empowered customers like never before as they can discuss about brands/products on Social Media channels. The best any marketer can do is to Listen, Learn and Engage customers. Given the three Vs of Big ‘Social’ data and the fact that most of the user generated content resides in the cloud, outsourcing companies can offer cost effective analytics solution to their clients to enable them effectively engage their customers/prospects in real time.

What do you think? Do you agree that Big Data Analytics is The Next Big Opportunity for Outsourcing Companies? Look forward to hearing your thoughts and comments:

Social Media according to Chris Brogan:

• Lot of light as compared to heat
• Puts human face back on Business
• Big companies have a chance to feel small and human again
• Individuals have an opportunity to compete with bigger organizations like never before