The amount of data now being used and stored everyday would have been incomprehensible only 10 years ago. The name aptly given to this large amount of data that is both structured and unstructured is big data. As we are now operating in environment centered around big data, the amount of information flowing round and through our systems at any one time is truly remarkable.
Utilising your big data
With this challenge to manage data also comes the opportunity to use the information to the advantage of your business, Intelligent machines are now being created to deal with this ever increasing amount of data. IBM, for instance, recently unveiled the supercomputer Watson, which can ingest data at the rate of 67 million pages a second. It is obtaining this ever-increasing flow of data from the millions of connected devices in the Internet of Things. The purpose of this latest IBM innovation is to establish a ‘question and answer’ dialogue between it and humans, whereby Watson will run unimaginable amounts of data and answer in plain speech and in real time.
Perhaps we should not be surprised. It is the direction of travel for analytics and it has been made possible by the seemingly infinite capacity of the cloud with its interconnected stacks of thousands upon thousands of servers.
Helping a business with performance
A number of larger technology companies have been at the forefront of utilising this type of Q&A interaction for consumer use. Google with its search engine and more recently its Google Home and Amazon with its smart home device ‘Alexa’ are leaders in this area. Servers are able to scan through huge amounts of data almost instantly to provide information and answers to any questions consumers could conceive.
The question is, however, how can intelligent machines aid in tailoring big data for a specific company? No matter what the size of a company, whether it is big or small, local or global, the challenge for suppliers of these machines is understanding their individual ‘key performance indicators’, putting the data into a digestible form and consequently using the data to the advantage of the company in question.
Companies such as NetSuite for example provide this service through a dashboard function in which large volumes of data can be presented in a way that supports directors and managers in running and growing the business. As soon as the data changes, the dashboard changes.
Solutions are also now coming into play that can allow multiple systems to work simultaneously together, in order to avoid the disadvantages of employees manually entering information, which takes a long time and allows room for human error. Not only do systems like this increase efficiency, they also allow for an increase in data visibility and data accuracy.
The changing role of data analytics
As stated previously, data and the way it is managed is becoming increasingly important for businesses to innovate and succeed in competitive environments. Many leading professionals have commented that they believe this is the year of data analytics. Artificial intelligence is set to to take the leading role away from data engineers in the management and control of data, automating processes and as previously mentioned reducing human inaccuracies and speeding up processes.
Gartner recently produced a report looking at the future of data analytics showing how organisations are already innovating their systems to keep up with competitors by encompassing the entire business in their approach to data analytics. The report also suggested that the majority of businesses have not got the systems currently in place to support ‘end-to-end architecture built for agility, scale and experimentation’.
Although, completely AI managed systems may be further off than we think, businesses should be looking at utilising semi-automated machine intelligence to deliver the business intelligence they need in understandable data chunks in order to become more efficient, profitable and plan for the eventuality of improving their systems in the future.
David Lindores is technical director of Eureka Solutions
Further reading on business intelligence
