Stream enrichment with Flink SQL
In today's world, real-time data processing is essential for businesses that want to remain competitive and responsive. The ability to obtain results…
Read moreRecently we published the first ebook in the area of MLOps: "Power Up Machine Learning Process. Build Feature Stores Faster - an Introduction to Vertex AI, Snowflake and dbt Cloud". In this short article, we will tell you what you can find inside the ebook, what questions and problems it addresses and share the first opinions.
In this ebook, we discuss in detail the Feature Store as one of the components of MLOps. From the general concept of MLOps and Feature Store as a solution, to specific problems that cause inefficiencies in ML processes to the technical details of building a Feature Store and how to integrate GCP with Snowflake using terraform. We demonstrate using the example of the Feature Store what risks are involved in not optimizing ML processes. This provides an easy-to-understand explanation of what MLOps is on the one hand, and on the other hand provides the technical details needed to adopt the solution right away.
That's why we've divided the ebook into two parts: the business perspective and the technical perspective, so everyone can easily find the content that interests them.
This e-book describes the real-life challenges of running Machine Learning on production systems from both business and technical perspectives. Moreover, it guides you through the practical solutions, based on our expert's experience. Check it out especially if you're struggling with latency, data silos, data drift or data skew!
Michał Bryś, Senior ML Engineer and Technical Product Owner
A very interesting position where the author describes the MLOps world and takes a look at it from a Feature Store perspective. This eBook contains solid theoretical information on what MLOps is and how Feature Stores can address its problems. The second part describes the first steps in Data Engineering work that will lead to creating the first features. This eBook provides very detailed information on how to start with dbt, Snowflake and Vertex AI tools.
I recommend it for everyone taking their first steps in the Data Engineering world or anyone who wants to extend his/her knowledge about Feature Stores.
Piotr Pękala, Project Architects Lead
“Ideas are worthless without execution”. This popular adage can be also applied perfectly to Data Science and Machine Learning results, where so many companies jump at the idea of using ML, but are struggling to execute it by delivering ML apps to production. That’s why the MLOps movement was shaped, to gather all the engineering practices in one place to deploy and maintain ML models in production efficiently and reliably. A lot has been developed, especially recently around Feature Stores - how data is prepared, stored and fed to ML models in training and production.
In this e-book, Getindata engineers introduce the reader to the MLOps concept and then focus on demonstrating how to build a Feature Store using managed cloud services and open-source technologies. Unlike many vendor e-books, these guys spare no technical details of the architecture and the solution. While they show the solution based on particular technologies like Vertex AI, Snowflake or dbt, the knowledge and design are presented abstractly with replaceable components.
If you are responsible for the data & AI strategy in your company, this source of information can help you accelerate and grasp the concepts of MLOps and Feature Stores without a vendor selling you anything.
If you’re an engineer, this very juicy tutorial will show you in detail how you can implement a Feature Store at your company. It will not only introduce you to the problem and show how to do a PoC - from configuring cloud services to running your first pipeline, but will also help you productionize the solution with infrastructure as a code, CICD and so on. All you need from start to finish in a concise writeup!
Krzysztof Zarzycki, GetInData CTO
In today's world, real-time data processing is essential for businesses that want to remain competitive and responsive. The ability to obtain results…
Read moreIn the fast-paced world of data processing, efficiency and reliability are paramount. Apache Flink SQL offers powerful tools for handling batch and…
Read moreSQL language was invented in 1970 and has powered databases for decades. It allows you not only to query the data, but also to modify it easily on the…
Read moreCan you build a data platform that offers scalability, reliability, ease of management and deployment that will allow multiple teams to work in…
Read moreApache Sedona is a distributed system which gives you the possibility to load, process, transform and analyze huge amounts of geospatial data across…
Read moreWe would like to announce the dbt-flink-adapter, that allows running pipelines defined in SQL in a dbt project on Apache Flink. Find out what the…
Read moreTogether, we will select the best Big Data solutions for your organization and build a project that will have a real impact on your organization.
What did you find most impressive about GetInData?