Published on 30/11/2016 in News
We use Hadoop to analyze certain types of customer data. The aim is to get to know our customers better and be able to predict what they expect and what they need. That way, we can raise our service provision to a higher level and improve customer satisfaction still further. Hadoop contains a whole ecosystem with datawarehousing and all sorts of tools to collect, load and analyze data. It’s far more than just business intelligence.”
“The main reason for working with Hadoop is that you want to assemble large volumes of data,” says Marc Matthys. “Volumes that would cost you a lot of money if you were to keep them in conventional databases or data warehouses. And, with Hadoop, you can bring together complex data sources such as social media, sound and video, sensors in the Internet of Things, etc. to analyze them. Other reasons for using Hadoop are the data migration from conventional databases/ data warehouses or, quite simply, the cheap archiving of information that’s always within easy reach.”
“First and foremost, experienced system engineers and big data experts. Of course, you also need a number of servers that you allow to cooperate with Hadoop as a cluster. This combines the strength of all the individual clusters. In principle, any server can be used for this, but it is best to work with similar systems that are called nodes in Hadoop. Alternatively, you could install Hadoop on a PC to start with, to get to know the technology.”
“The difficulties depend on the configuration you have chosen and how you want to integrate the rest of your IT installations,” said Matthys. “The main way to resolve problems is to have experienced IT people backed up by your Hadoop provider, or you find solutions yourself in the open-source communities.”
“It basically involves five stages:
“Hadoop is an open-source technology: it evolves thanks to contributions from universities, individuals and companies across the world. But, as a company, you need to be able to rely on a stable version that has undergone the necessary tests on the most common IT infrastructure. A handful of companies offer a version like this plus online support at a price that depends on the size of your work environment. Proximus chose Hortonworks,” Matthys concludes.