Interesting survey out by CIO Magazine that comments that Big Data aka Analysis of large data sets is important to many people surveyed. The survey indicated that the number one issue to big data analysis is budgets. But, isn’t that true for most projects? However there were several other insights. The big need for all the technology was surveyed to be Increasing productivity and decision making. No surprises in any of that response.
There are two ways of looking at Big Data: either a big vendor hype to portray the need for analytic tools, or, there is certainly a need and traditional methods of looking at data fail.
In Biology, big data is real. Sequencing, Imaging, and high throughput assays generate large data sets. These HAVE to be analyzed and this is being done very commonly. What is different is that if you are analyzing for “n” parameters even if large, you are looking for a very specific answer to a very specific question. For example, is there a chemical entity is my compound collection that can become a drug. However, if are just trying to find interesting correlations and you have a more diffuse question, like – tell me which customers do I target for next year financial goals then you need the “Big Data” analysis.
Either ways, expect jobs for such analysts to grow with titles like: Data analyst or architect
https://www.cio.com/article/2391822/big-data-projects-lack-big-budgets.html