ODSC - Open Data Science

MARCH 20, 2025

30% Off ODSC East, Fan-Favorite Speakers, Foundation Models for Times Series, and ETL Pipeline Orchestration The ODSC East 2025 Schedule isLIVE! Between an Expo & Demo Hall, amazing keynote speakers, and networking events, heres a rundown of everything you can do with a free ODSC East ExpoPass. Register by Friday for 30%off.

ETL 52

ETL Data Science Machine Learning Machine Learning 52

Hacker News

JULY 18, 2024

ABOUT EVENTUAL Eventual is a data platform that helps data scientists and engineers build data applications across ETL, analytics and ML/AI. OUR PRODUCT IS OPEN-SOURCE AND USED AT ENTERPRISE SCALE Our distributed data engine Daft [link] is open-sourced and runs on 800k CPU cores daily.

ML 126

ML ML ETL Python 126

Flipboard

DECEMBER 11, 2024

Data engineers use data warehouses, data lakes, and analytics tools to load, transform, clean, and aggregate data. SageMaker Unied Studio is an integrated development environment (IDE) for data, analytics, and AI. As AI and analytics use cases converge, transform how data teams work together with SageMaker Unified Studio.

SQL 135

SQL AWS Data Lakes ML 135

IBM Journey to AI blog

MARCH 14, 2024

The solution: IBM databases on AWS To solve for these challenges, IBM’s portfolio of SaaS database solutions on Amazon Web Services (AWS), enables enterprises to scale applications, analytics and AI across the hybrid cloud landscape. It enables secure data sharing for analytics and AI across your ecosystem.

AWS 93

AWS Database ETL AI 93

ODSC - Open Data Science

APRIL 3, 2023

As the sibling of data science, data analytics is still a hot field that garners significant interest. We looked at over 25,000 job descriptions, and these are the data analytics platforms, tools, and skills that employers are looking for in 2023. Competence in data quality, databases, and ETL (Extract, Transform, Load) are essential.

Analytics 52

Analytics Analytics Data Analyst Data Science 52

Flipboard

JULY 3, 2025

To address these challenges, AWS has expanded Amazon SageMaker with a comprehensive set of data, analytics, and generative AI capabilities. Data engineers can create and manage extract, transform, and load (ETL) pipelines directly within Unified Studio using Visual ETL. For Project name , enter a name (for example, demo ).

ML 89

ML ML AWS Data Engineering 89

IBM Journey to AI blog

SEPTEMBER 25, 2023

But what most people don’t realize is that behind the scenes, Uber is not just a transportation service; it’s a data and analytics powerhouse. This blog takes you on a journey into the world of Uber’s analytics and the critical role that Presto, the open source SQL query engine, plays in driving their success.

Data Lakes 102

Data Lakes Analytics Analytics Clustering 102

Dataconomy

MAY 16, 2025

Snowflake Dynamic Tables, Databricks Delta Live Tables) handling both analytical & streaming workloads Simplified ops, single security posture, but still maturing for extremelatency use cases Snowplow supports both paths. Trainingserving skew Source both phases from the same feature store. Ready to move from theory to throughput?

AI 103

AI AI ETL ML 103

IBM Journey to AI blog

JUNE 29, 2023

Learn more about IBM Planning Analytics Integrated business planning framework Integrated Business Planning (IBP) is a holistic approach that integrates strategic planning, operational planning, and financial planning within an organization. These tools enable the extraction, transformation, and loading (ETL) of data from various sources.

Analytics 94

Analytics Analytics Business Intelligence Business Intelligence 94

Alation

MAY 24, 2022

Higher data intelligence drives higher confidence in everything related to analytics and AI/ML. The Lineage & Dataflow API is a good example enabling customers to add ETL transformation logic to the lineage graph. Book a demo today. A pillar of Alation’s platform strategy is openness and extensibility. The post Alation 2022.2:

Data Quality 98

Data Quality Data Governance ETL Data Observability 98

ODSC - Open Data Science

APRIL 6, 2023

These are used to extract, transform, and load (ETL) data between different systems. Data integration tools allow for the combining of data from multiple sources. The most popular of these tools are Talend, Informatica, and Apache NiFi.

SQL 98

SQL Data Scientist Database Data Science 98

Pickl AI

APRIL 26, 2024

Additionally, it delves into case study questions, advanced technical topics, and scenario-based queries, highlighting the skills and knowledge required for success in data analytics roles. Additionally, we’ve got your back if you consider enrolling in the best data analytics courses.

Data Analyst 52

Data Analyst Data Analysis Data Analysis Machine Learning 52

Alation

JUNE 23, 2023

That’s going to be the view at the highly anticipated gathering of the global data, analytics, and AI community — Databricks Data + AI Summit — when it makes its grand return to San Francisco from June 26–29. How does a lakehouse overlooking the Golden Gate Bridge sound? Join us at Summit!

AI 52

AI AI ETL Data Quality 52

Precisely

MAY 31, 2023

In the same way that big cloud-platform providers offer simplified access to infrastructure, and data cloud providers like Databricks and Snowflake have vastly simplified access to data and analytics, modern data integrity tools must streamline and automate data integrity processes. In many cases, data arrived too late to be useful.

Data Quality 52

Data Quality Data Governance Data Observability ETL 52

databricks

JUNE 12, 2025

Get a Demo DATA + AI SUMMIT Data + AI Summit Happening Now Watch the free livestream of the keynotes! Join now Ready to get started? The design draws on years of observing real-world Apache Spark workloads, codifying what we’ve learned into a declarative API that covers the most common patterns - including both batch and streaming flows.

SQL 256

SQL Data Engineering Data Engineering Data Engineer 256

Alation

OCTOBER 19, 2021

New applications that don’t integrate with your tech or analytics stack will generate silos. For example, when your business users and data analytics teams collaborate, everyone makes better, more informed decisions and achieves better outcomes. The surge in data collection has only compounded this problem. New Applications.

Data Silos 52

Data Silos ETL Data Governance Cloud Data 52

phData

AUGUST 22, 2024

I used a demo project that I frequently work with and introduced syntax errors and data quality problems. The prompt is designed to instruct the LLM to approach the problem as if it were an analytics engineer and to summarize the data from the dictionary as feedback for a pull request. This leads to a prompt like: final_question = " ".join([

SQL 52

SQL Data Quality Python Data Warehouse 52

phData

JUNE 7, 2023

phData can help with this foundational strategy and platform along with your AI building needs by utilizing our teams of data engineering , analytics, and AI experts. As computational power increased and data became more abundant, AI evolved to encompass machine learning and data analytics.

AI 59

AI AI Natural Language Processing Machine Learning 59

Hacker News

JULY 1, 2025

I'm JD, a Software Engineer with experience touching many parts of the stack (frontend, backend, databases, data & ETL pipelines, you name it). I help businesses and public agencies improve their operations through industry-leading management analytics strategies. Email: hoglan (dot) jd (at) gmail Hello!

Python 55

Python AWS SQL ML 55

Alation

APRIL 14, 2023

Fivetran , the leader in cloud data integration and pioneer in the ETL space, not only coined the phrase “modern data stack” with the company’s conception 11 years ago, but has since grown to become an indispensable piece of that stack – as well as a trusted partner to Alation.

Data Pipeline 52

Data Pipeline Data Warehouse Cloud Data ETL 52

databricks

JUNE 16, 2025

Get a Demo Login Try Databricks Blog / Data Warehousing / Article Databricks at SIGMOD 2025 Databricks is proud to be a platinum sponsor of SIGMOD 2025 in Berlin, Germany. Accepted Demo Papers Blink twice - automatic workload pinning and regression detection for Versionless Apache Spark using retries.

Data Science 147

Data Science Artificial Intelligence Artificial Intelligence Business Intelligence 147

Flipboard

MAY 15, 2025

Data environments in data-driven organizations are changing to meet the growing demands for analytics , including business intelligence (BI) dashboarding, one-time querying, data science , machine learning (ML), and generative AI. For Project name , enter demo. For Lakehouse catalog name , enter rms-catalog-demo. Choose Choose.

AWS 102

AWS SQL Data Lakes Data Warehouse 102

phData

MAY 7, 2025

The ETL Pipeline failed in PROD. Additionally, understanding data growth patterns can help optimize partition strategies and tune performance for large-scale analytical workloads. Youll learn to monitor data file changes, audit data growth patterns, and reduce troubleshooting timewithout adding new tools or unnecessary complexity.

DataOps 52

DataOps AWS SQL Data Engineering 52

Hacker News

JUNE 29, 2025

Demos & tutorials: Harness Builder → https://www.youtube.com/watch?v=JfQVB_iTD1I reply efromvt 7 hours ago | prev | next [–] Continuing to plug away at Trilogy, a better SQL for data consumption and analytics. then publish privately or share publicly. It's coming along slowly, but steadily.

AI 79

AI AI Database Python 79