Category: Data analysis and Big Data

The video below explains it all. But essentially our perception is dependent on what we see. Wonder how many of these effects exist without us realizing it {youtube}FefFfvriAwQ{/youtube}

When we think of internet, it seems amazing to see that there are so many computers connected. This was made possible by the internet protocol version 4 provides 232 (4,294,967,296) addresses even though not all of them are usable. There are mostly saturated and the total number becomes about 4.2 billion and that is about…

The lab is an important place where discoveries are made, whether the lab is virtual or whether the lab is a physical space where experiments are conducted. It is also a place where the data is acquired, compared and finally conclusions drawn to make the discoveries possible. One feature that is common to most labs…

How do you access 200 Terabytes of data? NIH is collecting data of many genomes that are being stored as computer code. These are then stored for researchers to access for their purpose. Being NIH, these large data sets are available for free. But, how do you process this amount of data. About the only…

Big data exists in different forms. Cold Spring Harbor Laboratory has worked to digitize the entire mouse brain. Each of the different regions of the brain can be seen and visualized. The data is estimated to be about 500 Terabytes but the fantastic thing is that it is available for anyone to see and download.…

Dr Dharmendra Modha’s group at IBM has been simulating the whole brain one cell at a time. They started with cat brain simulation and have almost reached the whole brain simulation except it runs about 1542 times slower.  This is a simulation of nearly 1.6 billion virtual neurons and 9 trillion synapses. The power consumption…

The current period has been called the information age, where information is the most important element of society. Interestingly, with so much data being collected, the next age is the data analysis age wherein the analysis of data is important. An interesting thing about research in medicine is that it has been oriented towards clinical…

Walmart as is well known is a big retailer, not just big but massive. They have been a big retailer since a long time and have been processing large data before the term “Big data existed”. The interesting feature about them is that they are about the biggest retailer with a net turnover of $450…

Typically, labor statistics are collected tediously by the staff of Bureau of Labor Statistics by visiting, faxing and calling different stores, offices and online retailers in 90 cities across the nation and getting back nearly 80,000 prices for different items. This costs about $250MM per year and takes at least several weeks to put together.…

Companies that you previously did not think were in the data mining business or in the prediction business have used data mining technologies in strange but very useful ways. Your company too has some “useless” data that can be harvested. It really comes down to asking the correct question. Google obviously is centrally in the…