Does Big Data spell the demise or renaissance of long established data quality approaches, tools and techniques? This was one of the questions recently explored in our latest Trillium Software Hashtag Chat. For those of you who are unsure what a Hashtag Chat is, it’s a Twitter based chat room where particular questions and topics can be explored in a real time forum.
Big Data is everywhere. Look at any IT industry journal or website and you'll see more articles about Big Data than any other subject in the industry. As I write this piece, typing the words "Big Data" into my Google search engine brings back over 1.5 billion hits. The topic of Big Data is itself clearly generating vast amounts of big data.
And there's no doubt that Big Data has enormous potential as a means of bringing new insights and opportunities to organisations who invest in it. There is a growing body of use cases where organizations are claiming that collecting, storing and analysing Big Data is reaping significant rewards. For example a recent BBC documentary on Big Data highlighted its use by the Los Angeles police force (LAPD). With the help of the University of California, the LAPD analysed the records of over 13 million crimes committed in LA over the last 80 years.
I recently had the pleasure of presenting at a Big Data & Data Management event in Cambridge University in the UK. The event, jointly organised by the University and DAMA UK, focused on some of the key trends and challenges facing organisations looking to mine and exploit new Big Data sources. It was an excellent day as attendees came from both Big Data science and the more traditional data management disciplines of data architecture, data integration, data quality and Business Intelligence. By the end we all realised how much we will ultimately depend on each other, rather than ploughing two parallel furrows that will never meet, as sadly seems to be norm at present.
Smart Meters are described as the next generation of gas and electricity meters that offer a range of intelligent functions. The end consumer can expect to see a display which tells them how much energy is being consumed in the household at any time.
It all sounds fantastic and personally, I’m looking forward to seeing real time information on my energy usage so I can manage this more effectively and ultimately save some money! As it stands, consumers don’t have this transparency and can’t make informed decisions - therefore we wait with great anticipation and high expectations.