Data analysis and Big Data

When anyone measures a lot of data and then correlates it with phenomenon seemingly unrelated to the data, seemingly some relationships become evident. Is there a cause and effect? – Not necessarily but it still is surprising on how it can be related. Consider the example correlation between the movie showed on TV and the…

Data visualization requires special tools. The one that has been very useful is “Weave”, as a ridiculously powerful visualization tool. Instead of describing in detail, look at this video below showing the elections of UK and the link that gives all the features very well. {youtube}WHQeP4yQa9U{/youtube}

There are several ways to visualize data. The most commonly used could be Excel charts. However, when the data sets are complicated and large, the ability to display and chart the data is required to be given to the individual user or consumer, new techniques are required to plot the data. One such technique involves…

When you have a business website, it is important to track visitors, the places they visit, the hits you get and other analytics that tell you more about whether your content is relevant and whether there is information that is useful to visitors or customers. Most companies make it a part of their daily, weekly…

The data analysis engine that most people use most commonly is something like an Excel spreadsheet with charts to look at the data that they have collected. However, once the dataset gets bigger, the tools to analyze the data also need to scale. Additionally, as the dataset gets bigger, it is managed through a database…

Each researcher spends quality time managing the literature that they have collected in the form of papers and PDF’s. However, the collection of PDF continues to grow and there are very little in the form of tools that help manage it. There are three(3) great open source tools that work wonderfully to manage the collection…

There are large data-sets that are being generated that are amazingly large, completely open for anyone to use and see and can generate valuable conclusions.   Hapmap is one such grand project. This is made up of participants from US, UK, China, Japan, Canada and Nigeria. Look at the link below to get all the…

All scientists agree that there is a lot of information and data that is being generated and that it takes a significant amount of time to integrate that information. Trying to draw conclusions from that and make new discoveries is quite another matter. A company called “DistilBio” has done a wonderful job of integrating those…

Paper comes in different sizes. Paper is used every day and it has been accepted as a standard but there is some interesting mathematics behind it too. Consider size A0: The area of a A0 size of paper is exactly 1 meter square. Interestingly, each subsequent size is half the area of the previous size….

A new coined term “data exhaust” has become popular. This implies that the data that is collected without a specific need or a specific routine, is also useful even though it is being “exhausted” like waste gases. Take an example of massive online courses: Coursera. Massive online courses (MOOC) are the latest trends in learning….