Being a Data Engineer is not only about moving the data but also about extracting value from it. Read an article on how we implemented anomalies detection for one of our clients that works in the podcasting industry, Acast. With the mechanisms we implemented, Acast employees are notified on the podcasts that suddenly gain or lose the audience. The results reveal trendsetting podcasts (the influencing ones, that grow episode after episode), hot topics (on shows that publish an episode that is listened all over the world) and also weird podcasts applications behaviour (sudden spikes in the listening pattern). All these anomalies notifications are based purely on the data and simple logarithm curve fitting - it's unbelievable what you can achieve with data&math!
Please dive in the third part of a blog series based on a project delivered for one of our clients. Please click part I, part II to read the…
Read more
A few months ago I was working on a project with a lot of geospatial data. Data was stored in HDFS, easily accessible through Hive. One of the tasks…
Read more
It’s been already more than a month after Big Data Tech Warsaw Summit 2019, but it’s spirit is still among us — that’s why we’ve decided to prolong it…
Read more
In the previous post on our Big Data Blog, we discussed the business reasons behind the failures of Big Data projects. We've listed five major…
Read more
Custom components As we probably know, the biggest strength of Apache Nifi is the large amount of ready-to-use components. There are, of course…
Read more
Apache NiFi, a big data processing engine with graphical WebUI, was created to give non-programmers the ability to swiftly and codelessly create data…
Read moreTogether, we will select the best Big Data solutions for your organization and build a project that will have a real impact on your organization.