ODSC - Open Data Science

MARCH 22, 2024

Be sure to check out his talk, “ Building Data Contracts with Open Source Tools ,” there! Data engineering is a critical function in all industries. However, data engineering grows exponentially as the company grows, acquires, or merges with others. He is passionate about software engineering and all things data.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

ODSC - Open Data Science

FEBRUARY 21, 2024

For the first time ever, the Data Engineering Summit will be in person! Co-located with the leading Data Science and AI Training Conference, ODSC East, this summit will gather the leading minds in Data Engineering in Boston on April 23rd and 24th. We’re currently hard at work on the lineup. Sign me up!

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Pickl AI

APRIL 6, 2023

Accordingly, one of the most demanding roles is that of Azure Data Engineer Jobs that you might be interested in. The following blog will help you know about the Azure Data Engineering Job Description, salary, and certification course. How to Become an Azure Data Engineer?

Azure 52

Azure Data Engineering Data Engineer Data Engineering 52

ODSC - Open Data Science

FEBRUARY 6, 2024

Data engineering has become an integral part of the modern tech landscape, driving advancements and efficiencies across industries. So let’s explore the world of open-source tools for data engineers, shedding light on how these resources are shaping the future of data handling, processing, and visualization.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Pickl AI

AUGUST 1, 2023

Aspiring and experienced Data Engineers alike can benefit from a curated list of books covering essential concepts and practical techniques. These 10 Best Data Engineering Books for beginners encompass a range of topics, from foundational principles to advanced data processing methods. What is Data Engineering?

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Smart Data Collective

OCTOBER 11, 2021

If you enjoy working with data, or if you’re just interested in a career with a lot of potential upward trajectory, you might consider a career as a data engineer. But what exactly does a data engineer do, and how can you begin your career in this niche? What Is a Data Engineer?

Data Engineering 113

Data Engineering Data Engineer Data Engineering Data Engineering 113

Analytics Vidhya

JULY 9, 2022

This article was published as a part of the Data Science Blogathon. Introduction to Apache Airflow “Apache Airflow is the most widely-adopted, open-source workflow management platform for data engineering pipelines. Most organizations today with complex data pipelines to […].

Data Pipeline 326

Data Pipeline Data Engineering Data Engineer Data Engineering 326

databricks

DECEMBER 12, 2023

Introduction Databricks Lakehouse Monitoring allows you to monitor all your data pipelines – from data to features to ML models – without additional too.

Data Pipeline 302

Data Pipeline ML ML AI 302

Analytics Vidhya

JUNE 6, 2022

This article was published as a part of the Data Science Blogathon. Introduction In this article, we will discuss advanced topics in hives which are required for Data-Engineering. Whenever we design a Big-data solution and execute hive queries on clusters it is the responsibility of a developer to optimize the hive queries.

Data Engineering 320

Data Engineering Data Engineer Data Engineering Data Engineering 320

phData

MARCH 20, 2023

In this blog, we’re going to try our best to remove as much of the uncertainty as possible by walking through the interview process here at phData for a Solution Engineer. Whether you’re officially job hunting or just curious about what it’s like to interview and work at phData as a Solutions Engineer, this is the blog for you!

Cloud Data 98

Cloud Data Azure AWS Data Engineering 98

databricks

JANUARY 29, 2024

Databricks recently announced the Data Intelligence Platform, a natural evolution of the lakehouse architecture we pioneered. The idea of a Data Intelligence Platform.

Data Engineering 130

Data Engineering Data Engineer Data Engineering Data Engineering 130

phData

DECEMBER 1, 2023

Ravi, our Solutions Architect, has earned a well-deserved promotion, and we’ve spruced up his Beyond the Data blog to celebrate. Ready to go beyond the data? Join us in celebrating Ravi’s promotion and dive into the dynamic world of data with a twist of fun! Exciting news! Yes, you heard that right.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Pickl AI

JULY 25, 2023

Unfolding the difference between data engineer, data scientist, and data analyst. Data engineers are essential professionals responsible for designing, constructing, and maintaining an organization’s data infrastructure. Read more to know.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

phData

FEBRUARY 3, 2023

In this blog, we’re going to try our best to remove as much of the uncertainty as possible by walking through the interview process here at phData for Data Engineers. Whether you’re officially job hunting or just curious about what it’s like to interview and work at phData as a Data Engineer, this is the blog for you!

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

ODSC - Open Data Science

FEBRUARY 14, 2023

We’ve just wrapped up our first-ever Data Engineering Summit. If you weren’t able to make it, don’t worry, you can watch the sessions on-demand and keep up-to-date on essential data engineering tools and skills. It will cover why data observability matters and the tactics you can use to address it today.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

ODSC - Open Data Science

JANUARY 11, 2024

Getting Started with AI in High-Risk Industries, How to Become a Data Engineer, and Query-Driven Data Modeling How To Get Started With Building AI in High-Risk Industries This guide will get you started building AI in your organization with ease, axing unnecessary jargon and fluff, so you can start today.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Smart Data Collective

SEPTEMBER 28, 2022

Data management is a growing field, and it’s essential for any business to have a data management solution in place. A data management solution helps your business run more efficiently by making sure that your data is reliable and secure. Data quality is important to achieving this goal.

Big Data 104

Big Data Big Data Big Data Analytics Big Data Analytics 104

ODSC - Open Data Science

JANUARY 4, 2024

Trending Data Engineering Topics, the Top AI News from 2023, and Mapping Out the Top Open-Source LLM Frameworks 10 Data Engineering Topics and Trends You Need to Know in 2024 Let’s dive in and explore 10 data engineering trends that are expected to shape the industry in 2024 and beyond.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

ODSC - Open Data Science

MAY 5, 2023

Data science and data engineering are incredibly resource intensive. By using cloud computing, you can easily address a lot of these issues, as many data science cloud options have databases on the cloud that you can access without needing to tinker with your hardware.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

ODSC - Open Data Science

FEBRUARY 8, 2024

A Beginner’s Guide to Build Your Own LLM-Based Solutions With the KNIME AI Extension In this blog, learn how you can build your own LLM-based solutions using KNIME, a low-code/no-code analytics platform.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Flipboard

SEPTEMBER 1, 2023

This article describes a large-scale data warehousing use case to provide reference for data engineers who are looking for log analytic solutions. It introduces the log processing architecture and real-case practice in data ingestion, storage, and queries.

Data Engineering 123

Data Engineering Data Engineer Data Engineering Data Engineering 123

ODSC - Open Data Science

OCTOBER 20, 2023

You’ll also learn about the latest tools in NLP, machine learning, MLOps, and more during the Solution Talks. Building and Deploying a Gen AI App in 20 Minutes Nick Schenone | Pre-Sales MLOps Engineer | Iguazio Building your own Generative AI application can be quite difficult. Check them out below.

AI 52

AI AI Data Science Machine Learning 52

AWS Machine Learning Blog

OCTOBER 27, 2023

Anna Grüebler is a Specialist Solutions Architect at AWS focusing on artificial intelligence. AI Specialist Solutions Architect with extensive experience in end-to-end personalization solutions. Technical Product Manager working with AWS AI/ML on the Amazon Personalize team. Tim Wu Kunpeng is a Sr.

AI 89

AI AI AWS ML 89

Alation

MARCH 22, 2022

Data people face a challenge. They must put high-quality data into the hands of users as efficiently as possible. DataOps has emerged as an exciting solution. As the latest iteration in this pursuit of high-quality data sharing, DataOps combines a range of disciplines. Accenture has a pre-built solution.

DataOps 52

DataOps Data Pipeline Data Engineering Data Engineer 52

DataRobot Blog

MAY 14, 2018

Recently I engaged in a guided “hands-on” evaluation of Infoworks, a “no code” big data engineering solution that expedites and automates Hadoop and cloud workflows. by Jen Underwood. Within four hours of logging. Read More.

Big Data 40

Big Data Big Data Data Engineering Data Engineer 40

Analytics Vidhya

OCTOBER 6, 2023

In today’s rapidly evolving digital landscape, seamless data, applications, and device integration are more pressing than ever. Enter Microsoft Fabric, a cutting-edge solution designed to revolutionize how we interact with technology.

Analytics 306

Analytics Analytics Power BI Data Lakes 306

KDnuggets

JANUARY 6, 2020

In this webinar, Jan 15 @ 12PM EST, we'll offer solutions to the common challenges data scientists and data engineers face when building a machine learning pipeline. Register now to attend live or to watch a recording afterwards.

Machine Learning 154

Machine Learning Machine Learning Data Scientist Data Engineering 154

databricks

MAY 22, 2023

Optimizing table file sizes has long been a necessary but complicated task for data engineers. Getting to the right file size for your.

Data Engineering 171

Data Engineering Data Engineer Data Engineering Data Engineering 171

Data Science Dojo

APRIL 16, 2024

With growing reliance on AI-powered solutions and digital transformation with generative AI, it is a highly valued skill with its demand only expected to grow. They play a critical role in translating cutting-edge AI technology into real-world solutions. Hence, they collect, clean, and organize data to prepare it for analysis.

AI 195

AI AI Machine Learning Machine Learning 195

KDnuggets

OCTOBER 30, 2023

A comparative overview of data warehouses, data lakes, and data marts to help you make informed decisions on data storage solutions for your data architecture.

Data Lakes 309

Data Lakes Data Warehouse Data Engineering Data Engineer 309

Analytics Vidhya

JULY 29, 2022

This article was published as a part of the Data Science Blogathon. Introduction Processing large amounts of raw data from various sources requires appropriate tools and solutions for effective data integration. Building an ETL pipeline using Apache […].

ETL 364

ETL Data Science Analytics Analytics 364

DataRobot

MAY 11, 2021

It 10x’s our world-class AI platform by dramatically increasing the flexibility of DataRobot for data scientists who love to code and share their expertise across teams of all skill levels. Data Exploration, Visualization, and First-Class Integration. Customize and automate your data science workflows. DataRobot + Zepl.

Data Scientist 98

Data Scientist Citizen Data Scientist Data Science AI 98

Data Science Blog

JUNE 21, 2023

It involves extracting data from source systems to gain insights into process behavior and uncover opportunities for optimization. While there are many approaches to create value with process mining, organizations often face challenges when it comes to the cost of implementing the necessary solution.

Big Data 130

Big Data Big Data Data Engineering Data Engineer 130

Analytics Vidhya

FEBRUARY 2, 2023

Introduction Data analytics solutions collect, process, and analyze data to extract insights and make informed business decisions. The need for a data analytics solution arises from the increasing amount of data organizations generate and the need to extract value from that data.

Analytics 239

Analytics Analytics Data Visualization Data Analysis 239

Towards AI

MARCH 26, 2024

From day one, my team and I at Team Internet Group were absolutely eager to explore this solution and start testing it in a business environment. As a case study, I’ll discuss the solution that we implemented for one of our products, Internet.bs (a country code of Bahamas). Since then, we’ve had a few successful implementations.

Natural Language Processing 102

Natural Language Processing Data Scientist Data Engineering Data Engineer 102

AWS Machine Learning Blog

JANUARY 10, 2024

Specialist Data Engineering at Merck, and Prabakaran Mathaiyan, Sr. ML Engineer at Tiger Analytics. In this post, we discuss how the AWS AI/ML team collaborated with the Merck Human Health IT MLOps team to build a solution that uses an automated workflow for ML model approval and promotion with human intervention in the middle.

ML 101

ML ML AWS Machine Learning 101

Snorkel AI

MAY 12, 2023

Kishore will then double click into some of the opportunities we find here at Capital One, and Bayan will finish us off with a lean into one of our open-source solutions that really is an important contribution to our data-centric AI community. Our data teams focus on three important processes.

Machine Learning 52

Machine Learning Machine Learning ML ML 52