
Up & Running: data pipeline with BigQuery and dbt
Nowadays, companies need to deal with the processing of data collected in the organization data lake. As a result, data pipelines are becoming more…
Read more
Being a Data Engineer is not only about moving the data but also about extracting value from it. Read an article on how we implemented anomalies detection for one of our clients that works in the podcasting industry, Acast. With the mechanisms we implemented, Acast employees are notified on the podcasts that suddenly gain or lose the audience. The results reveal trendsetting podcasts (the influencing ones, that grow episode after episode), hot topics (on shows that publish an episode that is listened all over the world) and also weird podcasts applications behaviour (sudden spikes in the listening pattern). All these anomalies notifications are based purely on the data and simple logarithm curve fitting - it's unbelievable what you can achieve with data&math!
Nowadays, companies need to deal with the processing of data collected in the organization data lake. As a result, data pipelines are becoming more…
Read moreIt’s been exactly two months since the last edition of the Big Data Technology Warsaw Summit 2020, so we decided to share some great statistics with…
Read moreApache NiFi, a big data processing engine with graphical WebUI, was created to give non-programmers the ability to swiftly and codelessly create data…
Read moreThis blog series is based on a project delivered for one of our clients. We splited the content in three parts, you can find a table of content below…
Read moreApache NiFi, a big data processing engine with graphical WebUI, was created to give non-programmers the ability to swiftly and codelessly create data…
Read moreCustom components As we probably know, the biggest strength of Apache Nifi is the large amount of ready-to-use components. There are, of course…
Read moreTogether, we will select the best Big Data solutions for your organization and build a project that will have a real impact on your organization.