Free Data Engineering Courses
KDnuggets
MAY 30, 2022
Get into the highly in-demand world of data engineering for free and earn 6 figures salary.
2022
data-engineering-data-engineering 
The Complete Data Engineering Study Roadmap
KDnuggets
NOVEMBER 28, 2022
Everything you need to know to start your career in Data Engineering.
Join 17,000+
professionals
Sign Up for our Newsletter
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Introduction to SQL for Data Engineering
Analytics Vidhya
APRIL 23, 2022
This article was published as a part of the Data Science Blogathon. The post Introduction to SQL for Data Engineering appeared first on Analytics Vidhya. Introduction In this article, we will be looking for a very common yet very important topic i.e. SQL also pronounced as Ess-cue-ell.
Data Engineering – A Journal with Pragmatic Blueprint
Analytics Vidhya
JUNE 23, 2022
This article was published as a part of the Data Science Blogathon. Introduction to Data Engineering In recent days the consignment of data produced from innumerable sources is drastically increasing day-to-day. So, processing and storing of these data has also become highly strenuous.
The Ultimate Guide to Apache Airflow DAGS
Advertisement
With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code.
9 Skills You Need to Become a Data Engineer
KDnuggets
NOVEMBER 2, 2022
A data engineer is a fast-growing profession with amazing challenges and rewards. Which skills do you need to become a data engineer? In this post, we’ll take a look at both hard and soft skills.
We Don’t Need Data Scientists, We Need Data Engineers
KDnuggets
DECEMBER 9, 2022
As more people are entering the field of Data Science and more companies are hiring for data-centric roles, what type of jobs are currently in highest demand?
Airflow Best Practices for ETL/ELT Pipelines
Speaker: Kenten Danas, Senior Manager, Developer Relations
ETL and ELT are some of the most common data engineering use cases, but can come with challenges like scaling, connectivity to other systems, and dynamically adapting to changing data sources. Airflow is specifically designed for moving and transforming data in ETL/ELT pipelines, and new features in Airflow 3.0
A Guide to Debugging Apache Airflow® DAGs
Advertisement
In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs.
Apache Airflow® 101 Essential Tips for Beginners
Advertisement
Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage
💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI prototypes into impactful products! There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday.
Improving the Accuracy of Generative AI Systems: A Structured Approach
Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage
This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. Using this case study, he'll also take us through his systematic approach of iterative cycles of human feedback, engineering, and measuring performance.
LLMs in Production: Tooling, Process, and Team Structure
Speaker: Dr. Greg Loughnane and Chris Alexiuk
Greg Loughnane and Chris Alexiuk in this exciting webinar to learn all about: How to design and implement production-ready systems with guardrails, active monitoring of key evaluation metrics beyond latency and token count, managing prompts, and understanding the process for continuous improvement Best practices for setting up the proper mix of open- (..)
Monetizing Analytics Features: Why Data Visualizations Will Never Be Enough
Advertisement
Think your customers will pay more for data visualizations in your application? Five years ago they may have. But today, dashboards and visualizations have become table stakes. Discover which features will differentiate your application and maximize the ROI of your embedded analytics. Brought to you by Logi Analytics.
Agent Tooling: Connecting AI to Your Tools, Systems & Data
Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage
There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.
Let's personalize your content