The Volume, Velocity, Variety, and Visualization of Big Data

What if We had More Big Data Artists in the World?

Today’s Big Data Scientists are being challenged with discovering actionable insights from the Volume, Velocity and Variety of data resources in cost-effective innovate ways. This is the foundation of Big Data Trends and has tremendous value when understanding is Visualized by today’s Big Data Artists.

Big Data Artists and Data Storytelling

Data comes to life in the hands of Data Artists.  Effective Data Storytelling can inspire new ideas and actions. Statistics guru Hans Rosling is a modern day Michelangelo of Big Data.  Watch his TED Talk video about “global trends in health and economics“.  Hans really gets rolling into this data story at about the 4 minute mark of this video.

Big Data Virtualization

Processing unstructured, semi-structured, and structured data can be accomplished with open-source tools such as Hadoop, MongoDB, Node.JS, with multiple programming languages including Java and Python. Many of these Big Data Tools can be installed and configured within a few minutes.  We can also leverage Cloud Computing for processing Big Data. Cost-effective processing of Graph Data for Social Network Analytics can be accomplished with GraphChi.  My friend and colleague, Brad Cox, created an easy to use plugin to accelerate graph data processing.  There are a plethora of tools and resources out there.  Help others and share your favorites here.

Big Data Visualization

Getting the right information to the right person at the right time in the right way is a big deal.  Data Visualizations should not be cryptic like a puzzle, but easy to understand.  This is not a simple task and is the reason why we need more Big Data Artists in the world. My friend Angela Dunn has inspiring Data Visualization stories at Data is Beautiful.

Data Visualization Tools

Great artists experiment with a variety of material and tools to create their masterpieces.  The modern day Big Data Artist can experiment with these tools to create their next masterpiece.

Gephi The Open Graph Viz Platform: Gephi is an interactive visualization and exploration platform for all kinds of networks and complex systems, dynamic and hierarchical graphs.  This tool makes it fun to experiment with GraphData.

RapidMiner Data Mining System: RapidMiner is an open-source system for data mining. It is available as a stand-alone application for data analysis and as a data mining engine for the integration into custom products.

Sencha Ext JS is an “Enterprise grade JavaScript Framework”.  Ext JS Plugin-free Charting provides advanced charting and graphing capabilities, delivering pixel perfect visuals on any browser on any operating system.

D3.js is a JavaScript library for manipulating documents based on data. D3 helps you bring data to life using HTML, SVG and CSS. D3’s emphasis on web standards gives you the full capabilities of modern browsers without tying yourself to a proprietary framework, combining powerful visualization components and a data-driven approach to DOM manipulation.

Highcharts is a charting library written in pure JavaScript, offering intuitive, interactive charts to your web site or web application. Highcharts currently supports line, spline, area, areaspline, column, bar, pie, scatter, angular gauges, arearange, areasplinerange, columnrange and polar chart types.

Raphaël is a small JavaScript library that should simplify your work with vector graphics.  Raphaël ['ræfeɪəl] uses the SVG W3C Recommendation and VML as a base for creating graphics. This means every graphical object you create is also a DOM object, so you can attach JavaScript event handlers or modify them later. Raphaël’s goal is to provide an adapter that will make drawing vector art compatible cross-browser and easy.

Visual.ly supports Visual Storytelling with data visualizations and infographics.     Visually’s Visual Reports can turn monthly performance metrics into a powerful visual narrative that communicates company objectives and milestones to both internal and external stakeholders. Infographics can also communicate product features.

Visualizing data helps others understand the value of information.  Additional data visualization tools are available here Top 20 Data Visualization Tools.  Visual content inspires conversation, as I was writing this, my friend Kathy Meyer shared this article about using visual content to inspire conversation 26 Ways to Use Visuals in Your Social Media Marketing

Big Data & Visualization Resources

Learning more about Big Data and the art of data visualization is a valuable skill to master.  There are several online classes and meetups in the area.  A recent meetup in the Washington DC area was Uncovering Hidden Social Information with Prof. Jennifer Golbeck. Her book, “Analyzing the Social Web” is available on Amazon.  Another great book to help you master the art of Big Data and Social Network Analytics is, “Mining the Social Web: Analyzing Data from Facebook, Twitter, LinkedIn, and Other Social Media Sites”.

Summary

Big Data is the Gold Rush of the 21st Century where discovering nuggets of actionable insights is transforming the way we work, live, & play.  Big Data Is Changing the Whole Equation for Business and organizations that fail to define Big Data Leadership will fall behind, far behind.  Organizations that hope to remain competitive in today’s market will include a strategy that implements Big Data tools along with the training and development of Data Scientists and Big Data Artists.

How to Master Data Visualization

Strategy & Tools for Data Visualization

Data Visualization

Data visualization is the study of the visual representation of data, meaning “information which has been abstracted in some schematic form, including attributes or variables for the units of information”.  According to Friedman (2008) the “main goal of data visualization is to communicate information clearly and effectively through graphical means. It doesn’t mean that data visualization needs to look boring to be functional or extremely sophisticated to look beautiful.

Data Visualization Strategy

Edward Tufte @EdwardTufte delivered a great presentation about data visualization strategy for the star studded Tech@State event audience.   Tech@State ( @techATstate ) connects tech innovators and those interested in diplomacy and development to enable 21st century statecraft by improving education, health and welfare of the world’s population.   The Edward Tufte: Beautiful Evidence (Highlights) video is available here. Edward Tufte’s complete data visualization strategy presentation video is available here, his presentation begins at 14:24.

If your display isn’t worth 1000 words, to hell with it – @EdwardTufte

Data Visualization Tools & Services

Google Data Visualization Services

Google Data Visualization Service provides a variety of charts that are optimized to address your data visualization needs. These charts are based on pure HTML5/SVG technology (adopting VML for old IE versions), so no plugins are required.

Sencha ExtJS Data Visualization Tools

It has always been hard to draw things in web applications. HTML is really not cut out for creating charts and other richly interactive imagery, but Sencha ExtJS 4 supports data visualizations HTML applications. Typically this need has been met with Adobe Flash, but this gave Sencha two problems: most people like writing code in JavaScript, and Flash isn’t available on all devices. The ExtJS 4 solution to these problems is a pure-JavaScript drawing library that can create incredibly rich charting and graphics. It works everywhere – from IE6 to iOS – and will also be available as an add-on for Sencha Touch (mobile).

Highcharts Data Visualization Tools

Highcharts is a charting library written in pure JavaScript, offering intuitive, interactive charts to your web site or web application. Highcharts currently supports line, spline, area, areaspline, column, bar, pie and scatter chart types.  You can also you create stock or general timeline charts in pure JavaScript, including sophisticated navigation options like a small navigator series, preset date ranges, date picker, scrolling and panning with Highstock.

Current Data Visualization Twitter Game Board

Diversity fuels innovation. Sports fanatics have their fantasy football teams. This is my fantasy innovation team. This Data Visualization twitter game board represents people focused on sharing ideas about how to make data make sense.

[twitterusers @edwardtufte @NoelDickover @JohnFMoore @SuzKPH @techATstate @StateDept @lovisatalk @visualisingdata @noahi ]

The Future of Content Platforms

Capture, Manage, Deliver, & Preserve Content

“Enterprise 2.0 is the use of emergent social software platforms within companies, or between companies and their partners or customers.” ~Andrew McAfee, Harvard Business School.  Stephane Croisier put together his thoughts and visuals on this topic in “Future of Content Platforms“.  Here is a nice look at using #LinkedData to surface “Collective Intelligence”. I also enjoyed seeing the inclusion of “Mashability” and Mashups starting on slide 28.

See This New Augmented Reality App for the Apple iPhone

Apple iPhone AppStore is about to get it’s First Augmented Reality App

AcrossAir creates a very interesting Apple iPhone App.  This amazing new application tells Londoners where their nearest tube station is via their iPhones video function.

When you load the app, holding it flat, all 13 lines of the London underground are displayed in coloured arrows. By tilting the phone upwards, you will see the nearest stations: what direction they are in relation to your location, how many kilometres and miles away they are and what tube lines they are on. If you continue to tilt the phone upwards, you will see stations further away, as stacked icons. Only available to Apple iPhone 3GS users.

AcrossAir

AcrossAir

AcrossAir is working with companies to take advantage of the Apple iPhone platform for everything from fun games to enterprise applications. Our first applications, delivering TV listings for TVGuide.co.uk and our fun game the Fruit Loons, are launching in AppStore in June 2009. Learn more: http://www.acrossair.com/

The first mobile Augmented Reality browser premiers in the Netherlands

A few weeks ago I saw a similar mobile app video on Ross Dawson’s (@rossdawson) blog here.

The World’s First Augmented Reality Browser. Layar is a free application on your mobile phone which shows what is around you by displaying real time digital information on top of reality through the camera of your mobile phone. Learn more: http://www.layar.com/

I would like to see something like this for the Washington DC Metro.  This would also be a nice way to locate the many Washington DC museums.

How could a mobile app help you?