ODSC - Open Data Science

MAY 5, 2023

Data science and data engineering are incredibly resource intensive. By using cloud computing, you can easily address a lot of these issues, as many data science cloud options have databases on the cloud that you can access without needing to tinker with your hardware.

Data Science 52

Data Science Data Engineering Data Engineering Data Engineer 52

ODSC - Open Data Science

FEBRUARY 10, 2023

Faster Training and Inference Using the Azure Container for PyTorch in Azure ML If you’ve ever wished that you could speed up the training of a large PyTorch model, then this post is for you. In this post, we’ll cover the basics of this new environment, and we’ll show you how you can use it within your Azure ML project.

Azure 52

Azure ML ML Data Mining 52

Pickl AI

NOVEMBER 4, 2024

Summary: The fundamentals of Data Engineering encompass essential practices like data modelling, warehousing, pipelines, and integration. Understanding these concepts enables professionals to build robust systems that facilitate effective data management and insightful analysis. What is Data Engineering?

Data Engineer 52

Data Engineer Data Engineering Data Engineering Data Engineering 52

ODSC - Open Data Science

DECEMBER 7, 2023

ML Pros Deep-Dive into Machine Learning Techniques and MLOps Seth Juarez | Principal Program Manager, AI Platform | Microsoft Learn how new, innovative features in Azure machine learning can help you collaborate and streamline the management of thousands of models across teams.

Data Science 98

Data Science Data Wrangling Machine Learning Machine Learning 98

ODSC - Open Data Science

APRIL 27, 2023

5 Data Engineering and Data Science Cloud Options for 2023 AI development is incredibly resource intensive. As such, here are a few data science cloud options to help you handle some work virtually. Announcing the ODSC East 2023 Keynote Speakers We’re thrilled to announce the ODSC East 2023 Keynote speakers!

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

ODSC - Open Data Science

MARCH 30, 2023

Using Azure ML to Train a Serengeti Data Model, Fast Option Pricing with DL, and How To Connect a GPU to a Container Using Azure ML to Train a Serengeti Data Model for Animal Identification In this article, we will cover how you can train a model using Notebooks in Azure Machine Learning Studio.

Azure 52

Azure ML ML Data Modeling 52

ODSC - Open Data Science

MAY 26, 2023

ODSC Europe 2023 is coming up quickly and we’ve been hard at work finalizing the conference schedule. Tuesday, June 13th — Day 0: Pre-Conference Bootcamp Day The first unofficial day of ODSC Europe 2023 is the virtual-only Pre-Conference Bootcamp Day. And, if you want to save 40% on your pass , you’d better register soon.

Data Science 52

Data Science Data Wrangling Machine Learning Machine Learning 52

ODSC - Open Data Science

APRIL 3, 2023

Companies have plenty of data at their disposal and are looking for people who can make sense of it and make deductions quickly and efficiently. We looked at over 25,000 job descriptions, and these are the data analytics platforms, tools, and skills that employers are looking for in 2023. Sign up now, start learning today !

Analytics 52

Analytics Analytics Data Analyst Data Science 52

phData

NOVEMBER 8, 2024

Data Versioning and Time Travel Open Table Formats empower users with time travel capabilities, allowing them to access previous dataset versions. The first insert statement loads data having c_custkey between 30001 and 40000 – INSERT INTO ib_customers2 SELECT *, '11111111111111' AS HASHKEY FROM snowflake_sample_data.tpch_sf1.customer

Data Lakes 52

Data Lakes Data Warehouse Azure Database 52

ODSC - Open Data Science

JUNE 7, 2023

Since data is left in its raw form within the data lake, it’s easier for data teams to experiment with models and analysis techniques with greater flexibility. So let’s take a look at a few of the leading industry examples of data lakes. Snowflake Snowflake is a cross-cloud platform that looks to break down data silos.

Data Lakes 52

Data Lakes Azure Data Warehouse Hadoop 52

phData

MAY 25, 2023

How to Optimize Power BI and Snowflake for Advanced Analytics Spencer Baucke May 25, 2023 The world of business intelligence and data modernization has never been more competitive than it is today. In a perfect world, Microsoft would have clients push even more storage and compute to its Azure Synapse platform.

Power BI 84

Power BI Analytics Analytics Azure 84

ODSC - Open Data Science

MARCH 10, 2023

Building Both a Fraud & Not-Fraud Model, Leveraging Time-Series Segmentation, and Top AI News in 2023 So Far Opposites Don’t Always Attract: Building Both a Fraud & Not-Fraud Model If you ever have modeled fraud, have you considered creating a model to predict fraud as well as a model to predict not-fraud? Let’s explain some more.

Machine Learning 52

Machine Learning Machine Learning Data Science AI 52

ODSC - Open Data Science

MAY 4, 2023

Data Processing Agreements in 2023 Businesses and organizations rely on computer technology to handle clients’ data. This is why companies need data processing agreements and keep up with the latest information about them. There’s less than a week to go until ODSC East 2023. Register by Friday to save 20%.

Azure 52

Azure Deep Learning Deep Learning Artificial Intelligence 52

phData

DECEMBER 1, 2023

Additionally, review the code pushed by the Data Engineers. Depending on the requirements, it could involve developing Python/Scala/SQL programs on AWS/Azure/Snowflake cloud platforms and setting up CI/CD pipelines for the seamless deployment of the project code. Yes, you heard that right. I do write code daily.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

phData

AUGUST 6, 2024

What is Snowpark and Why Use It for Building Data Pipelines? The Snowpark API includes the DataFrame API and integrates with other popular open-source APIs developers can use to complete data engineering tasks. to collaborate within a single platform.

Data Pipeline 52

Data Pipeline Python Data Engineering Data Engineering 52

O'Reilly Media

MAY 15, 2025

About the Generative AI in the Real World podcast: In 2023, ChatGPT put AI on everyones agenda. 5:34 : You work with the folks at Azure, so presumably you know what actual enterprises are doing with generative AI. For data engineering, orchestration means something specific, and a lot goes into it, even for a single agent.

AI 78

AI AI Hadoop Python 78

phData

JULY 25, 2023

If you are looking for services to help create a data strategy, you’re at the right place. We’ll help you understand what it is and how much data strategy costs in 2023. Data strategy is more than just data collection and can help companies to solve these challenges by making data accessible and shared securely.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

phData

JULY 25, 2023

If you are looking for services to help create a data strategy, you’re at the right place. We’ll help you understand what it is and how much data strategy costs in 2023. Data strategy is more than just data collection and can help companies to solve these challenges by making data accessible and shared securely.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

Mlearning.ai

FEBRUARY 16, 2023

The platform enables quick, flexible, and convenient options for storing, processing, and analyzing data. The solution was built on top of Amazon Web Services and is now available on Google Cloud and Microsoft Azure. Simplify and Win Experienced data engineers value simplicity. What does Snowflake do?

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

ODSC - Open Data Science

JANUARY 29, 2024

Fine-tuning is important for applying domain-specific knowledge to an existing LLM which provides better performance and prompt results Inference Efficiency An emergent skill in late 2023, its inclusion speaks to its importance. Stable Diffusion seems favored, perhaps due to it being largely an open-source model.

Data Science 52

Data Science Machine Learning Machine Learning Natural Language Processing 52

phData

SEPTEMBER 20, 2023

However, Snowflake offers many of the capabilities needed for a self-service data platform, enabling a distributed, domain-driven architecture and offering capabilities to help implement data as a product and federated computational governance. Regularly communicate the progress, successes, and challenges of data mesh implementation.

Data Silos 52

Data Silos Database Data Quality Data Engineering 52

phData

DECEMBER 4, 2023

The software you might use OAuth with includes: Tableau Power BI Sigma Computing If so, you will need an OAuth provider like Okta, Microsoft Azure AD, Ping Identity PingFederate, or a Custom OAuth 2.0 When to use SCIM vs phData's Provision Tool SCIM manages users and groups with Azure Active Directory or Okta. authorization server.

Clustering 98

Clustering Database SQL Data Pipeline 98

The MLOps Blog

JANUARY 23, 2023

However, there are some key differences that we need to consider: Size and complexity of the data In machine learning, we are often working with much larger data. Basically, every machine learning project needs data. Given the range of tools and data types, a separate data versioning logic will be necessary.

ML 52

ML ML Data Lakes Machine Learning 52

phData

JULY 5, 2024

In a survey conducted in 2023 , over three-quarters of the executives surveyed believed that artificial intelligence would disrupt their business strategy. To provide an example, traditional structured data such as a user’s demographic information can be provided to an AI application to create a more personable experience.

AI 52

AI AI Database AWS 52

phData

NOVEMBER 28, 2023

In July 2023, Matillion launched their fully SaaS platform called Data Productivity Cloud, aiming to create a future-ready, everyone-ready, and AI-ready environment that companies can easily adopt and start automating their data pipelines coding, low-coding, or even no-coding at all. Contact phData today!

Data Warehouse 52

Data Warehouse Data Pipeline ETL Azure 52

Pickl AI

DECEMBER 10, 2024

billion in 2023, grows at a projected CAGR of 36.6% Assign an AI Ethics Officer to monitor fairness and compliance while cybersecurity teams focus on safeguarding models and data. Data engineers and scientists must implement bias detection tools and ensure transparency in model outputs.

AI 52

AI AI Artificial Intelligence Artificial Intelligence 52

phData

JULY 18, 2023

The Ultimate Modern Data Stack Migration Guide phData Marketing July 18, 2023 This guide was co-written by a team of data experts, including Dakota Kelley, Ahmad Aburia, Sam Hall, and Sunny Yan. Imagine a world where all of your data is organized, easily accessible, and routinely leveraged to drive impactful outcomes.

Data Warehouse 52

Data Warehouse Analytics Analytics Cloud Data 52

The MLOps Blog

MARCH 21, 2023

Other users Some other users you may encounter include: Data engineers , if the data platform is not particularly separate from the ML platform. Analytics engineers and data analysts , if you need to integrate third-party business intelligence tools and the data platform, is not separate. Allegro.io

Machine Learning 69

Machine Learning Machine Learning Data Scientist ML 69

Hacker News

JULY 1, 2025

Prior to that, I spent a couple years at First Orion - a smaller data company - helping found & build out a data engineering team as one of the first engineers. We were focused on building data pipelines and models to protect our users from malicious phonecalls. Expert technologist with expertise in everything.

Python 65

Python AWS SQL ML 65

Hacker News

JULY 1, 2025

We 4x’d ARR in both 2023 and 2024. Team: Our team includes many former unicorn early team members and founders, as well as multiple IMO/IOI medalists We're looking for experienced engineers and an EM. Senior Software Engineer – Portland, OR - Platform Architect – Córdoba, AR - Sr.

Python 93

Python AWS ML ML 93

Data Science Blog

SEPTEMBER 3, 2024

Der Gartner´s Magic Quadrant zu Process Mining Tools für 2024 zeigt einige Movements im Vergleich zu 2023. Process Mining Tool im Gartner Magic Quadrant Chart – 2023 vs 2024 Auch wenn ich große Ehrfurcht gegenüber Gartner als Quelle habe, bin ich jedoch nicht sicher, wie weit die Datengrundlage für die Feststellung geht.

Data Science 130

Data Science Power BI Azure Data Warehouse 130

phData

SEPTEMBER 27, 2024

In transitional modeling, we’d add new atoms: Subject: Customer#1234 Predicate: hasEmailAddress Object: "john.new@example.com" Timestamp: 2023-07-24T10:00:00Z The old email address atoms are still there, giving us a complete history of how to contact John. Building a composable CDP requires some serious data engineering chops.

Data Modeling 52

Data Modeling Data Models Apache Kafka Data Lakes 52