Data Science Blog

MAY 15, 2023

Synapse Analytics umfasst eine Data Lakehouse-Funktion, die das Beste aus Data Lakes und Data Warehouses kombiniert, um eine flexible und skalierbare Lösung für die Speicherung und Verarbeitung von Daten zu bieten. Databricks ist auf AWS, Azure und Google Cloud Platform verfügbar.

Data Warehouse 147

Data Warehouse Data Lakes Azure AWS 147

phData

MARCH 29, 2024

Founded in 2014 by three leading cloud engineers, phData focuses on solving real-world data engineering, operations, and advanced analytics problems with the best cloud platforms and products. Over the years, one of our primary focuses became Snowflake and migrating customers to this leading cloud data platform.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Mlearning.ai

FEBRUARY 16, 2023

Thus, the solution allows for scaling data workloads independently from one another and seamlessly handling data warehousing, data lakes , data sharing, and engineering. Snowflake Database Pros Extensive Storage Opportunities Snowflake provides affordability, scalability, and a user-friendly interface.

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

Data Science Blog

FEBRUARY 4, 2023

The fusion of data in a central platform enables smooth analysis to optimize processes and increase business efficiency in the world of Industry 4.0 using methods from business intelligence , process mining and data science. Cloud Data Platform for shopfloor management and data sources such like MES, ERP, PLM and machine data.

Cloud Data 147

Cloud Data Data Science Business Intelligence Business Intelligence 147

Data Science Blog

SEPTEMBER 19, 2023

By automating the provisioning and management of cloud resources through code, IaC brings a host of advantages to the development and maintenance of Data Warehouse Systems in the cloud. So why using IaC for Cloud Data Infrastructures? appeared first on Data Science Blog.

Data Warehouse 259

Data Warehouse Azure SQL Database 259

phData

JANUARY 24, 2024

Understanding Fivetran Fivetran is a user-friendly, code-free platform enabling customers to easily synchronize their data by automating extraction, transformation, and loading from many sources. Fivetran automates the time-consuming steps of the ELT process so your data engineers can focus on more impactful projects.

Data Warehouse 52

Data Warehouse Data Pipeline Data Governance Data Quality 52

AWS Machine Learning Blog

OCTOBER 18, 2023

AWS CodeBuild is a fully managed continuous integration service in the cloud. Amazon DynamoDB is a fast and flexible nonrelational database service for any scale. The ML model is trained from pet profiles pulled from Purina’s database, assuming the primary breed label is the true label.

AWS 94

AWS ML ML Machine Learning 94

Alation

AUGUST 30, 2022

Yet it was siloed and locked up in different databases and tools. We had data but no data intelligence and, as a result, insights remained hidden or hard to come by. This expansive map of tools constitutes today’s modern data stack. In a complex modern data stack, the need for intuitive search grows essential.

Data Governance 52

Data Governance Data Quality Tableau Data Analyst 52

Alation

MARCH 22, 2022

Accenture calls it the Intelligent Data Foundation (IDF), and it’s used by dozens of enterprises with very complex data landscapes and analytic requirements. Simply put, IDF standardizes data engineering processes. They can better understand data transformations, checks, and normalization.

DataOps 52

DataOps Data Pipeline Data Engineering Data Engineer 52

Analytics Vidhya

MARCH 10, 2023

Introduction Snowflake is a cloud-based data warehousing platform that enables enterprises to manage vast and complicated information by providing scalable storage and processing capabilities. It is intended to be a fully managed, multi-cloud solution that does not need clients to handle hardware or software.

Analytics 260

Analytics Analytics Data Warehouse Data Engineering 260

phData

JULY 17, 2023

Over the past few decades, the corporate data landscape has changed significantly. The shift from on-premise databases and spreadsheets to the modern era of cloud data warehouses and AI/ LLMs has transformed what businesses can do with data. What is the Modern Data Stack? Data modeling, data cleanup, etc.

Data Warehouse 52

Data Warehouse Data Pipeline Cloud Data ETL 52

Analytics Vidhya

MAY 24, 2023

As modern companies rely on data, establishing dependable, effective solutions for maintaining that data is a top task for each organization. The complexity of information storage technologies increases exponentially with the growth of data.

Cloud Computing 195

Cloud Computing Analytics Analytics Data Engineering 195

Data Science Blog

NOVEMBER 15, 2023

In addition to Business Intelligence (BI), Process Mining is no longer a new phenomenon, but almost all larger companies are conducting this data-driven process analysis in their organization. The Event Log Data Model for Process Mining Process Mining as an analytical system can very well be imagined as an iceberg.

Data Modeling 245

Data Modeling Data Models Business Intelligence Business Intelligence 245

phData

JANUARY 5, 2023

Python is the top programming language used by data engineers in almost every industry. Python has proven proficient in setting up pipelines, maintaining data flows, and transforming data with its simple syntax and proficiency in automation. Truly a must-have tool in your data engineering arsenal!

Python 52

Python Data Engineering Data Engineer Data Engineering 52

Towards AI

JANUARY 28, 2024

To start, get to know some key terms from the demo: Snowflake: The centralized source of truth for our initial data Magic ETL: Domo’s tool for combining and preparing data tables ERP: A supplemental data source from Salesforce Geographic: A supplemental data source (i.e., Instagram) used in the demo Why Snowflake?

ETL 102

ETL Python Database Data Preparation 102

Flipboard

NOVEMBER 24, 2023

JuMa is tightly integrated with a range of BMW Central IT services, including identity and access management, roles and rights management, BMW Cloud Data Hub (BMW’s data lake on AWS) and on-premises databases. He has a record of working with distributed teams across the globe within large enterprises.

ML 95

ML ML AWS AI 95

phData

MARCH 8, 2023

Fivetran is an automated data integration platform that offers a convenient solution for businesses to consolidate and sync data from disparate data sources. With over 160 data connectors available, Fivetran makes it easy to move data out of, into, and across any cloud data platform in the market.

Data Warehouse 96

Data Warehouse Data Engineering Data Engineer Data Engineering 96

Alation

JANUARY 17, 2023

These tools are used to manage big data, which is defined as data that is too large or complex to be processed by traditional means. How Did the Modern Data Stack Get Started? The rise of cloud computing and cloud data warehousing has catalyzed the growth of the modern data stack.

Data Warehouse 52

Data Warehouse ETL Cloud Data Tableau 52

phData

FEBRUARY 7, 2024

The Snowflake Data Cloud is a leading cloud data platform that provides various features and services for data storage, processing, and analysis. A new feature that Snowflake offers is called Snowpark, which provides an intuitive library for querying and processing data at scale in Snowflake.

Python 52

Python ML ML SQL 52

phData

SEPTEMBER 20, 2023

However, Snowflake offers many of the capabilities needed for a self-service data platform, enabling a distributed, domain-driven architecture and offering capabilities to help implement data as a product and federated computational governance. Regularly communicate the progress, successes, and challenges of data mesh implementation.

Data Silos 52

Data Silos Database Data Quality Data Engineering 52

Alation

AUGUST 16, 2022

This week, IDC released its second IDC MarketScape for Data Catalogs report, and we’re excited to share that Alation was recognized as a leader for the second consecutive time. These include data analysts, stewards, business users , and data engineers. Alation launched Alation Cloud Service (ACS) in April, 2021.

Data Quality 52

Data Quality Data Governance Cloud Data Data Engineering 52

Data Science Blog

JUNE 27, 2023

For existing event sources, listeners are utilized to stream writes directly from database logs or similar data stores. By treating every data point as a streaming event, the Kappa architecture enables the ability to near-realtime analytics and observe the state of all data in the organization at any given point.

Big Data 130

Big Data Big Data Apache Kafka Database 130

phData

DECEMBER 4, 2023

However, if there’s one thing we’ve learned from years of successful cloud data implementations here at phData, it’s the importance of: Defining and implementing processes Building automation, and Performing configuration …even before you create the first user account. This includes users, roles, schemas, databases, and warehouses.

Clustering 98

Clustering Database SQL Data Pipeline 98

phData

JANUARY 4, 2023

Data Sharing Enterprises can easily create data sharing relationships with direct, governed, and secure sharing in near-real time. With Snowflake, organizations can be data consumers, data providers, or both. Ready to Get Started in the Migration to Snowflake?

Data Warehouse 52

Data Warehouse SQL Database ETL 52

Alation

MARCH 1, 2022

Through Impact Analysis, users can determine if a problem occurred with data upstream, and locate the impacted data downstream. With robust data lineage, data engineers can find and fix issues fast and prevent them from recurring. Similarly, analysts gain a clear view of how data is created.

Data Warehouse 52

Data Warehouse Data Lakes Cloud Data Database 52

phData

MARCH 11, 2024

For years, marketing teams across industries have turned to implementing traditional Customer Data Platforms (CDPs) as separate systems purpose-built to unlock growth with first-party data. For behavioral data , Hightouch offers an event tracking SDK to deploy an SDK across your web, server, and mobile apps.

Data Warehouse 52

Data Warehouse Cloud Data Data Modeling Data Models 52

DataRobot Blog

MARCH 16, 2023

The DataRobot team has been working hard on new integrations that make data scientists more agile and meet the needs of enterprise IT, starting with Snowflake. We’ve tightened the loop between ML data prep , experimentation and testing all the way through to putting models into production.

Data Scientist 52

Data Scientist ML ML Data Preparation 52

Alation

JUNE 21, 2022

Why start with a data source and build a visualization, if you can just find a visualization that already exists, complete with metadata about it? Data scientists went beyond database tables to data lakes and cloud data stores. Data scientists want to catalog not just information sources, but models.

DataOps 52

DataOps Data Scientist Data Quality Data Pipeline 52

The MLOps Blog

MAY 17, 2023

This article explores the importance of ETL pipelines in machine learning, a hands-on example of building ETL pipelines with a popular tool, and suggests the best ways for data engineers to enhance and sustain their pipelines. We also need data profiling i.e. data discovery, to understand if the data is appropriate for ETL.

ETL 59

ETL Data Pipeline ML ML 59

Alation

MARCH 29, 2021

With more data than ever before, the ability to find the right data has become harder than ever. Yet businesses need to find data to make data-driven decisions. However, data engineers, data scientists, data stewards, and chief data officers face the challenge of finding data easily.

Machine Learning 59

Machine Learning Machine Learning Data Lakes Hadoop 59

phData

MAY 6, 2024

Another benefit of deterministic matching is that the process to build these identities is relatively simple, and tools your teams might already use, like SQL and dbt , can efficiently manage this process within your cloud data warehouse. Store this data in a customer data platform or data lake.

Data Lakes 52

Data Lakes Data Warehouse SQL Data Quality 52

IBM Journey to AI blog

JULY 17, 2023

Within watsonx.ai, users can take advantage of open-source frameworks like PyTorch, TensorFlow and scikit-learn alongside IBM’s entire machine learning and data science toolkit and its ecosystem tools for code-based and visual data science capabilities. Later this year, it will leverage watsonx.ai

AI 66

AI AI Machine Learning Machine Learning 66

phData

MAY 25, 2023

Having gone public in 2020 with the largest tech IPO in history, Snowflake continues to grow rapidly as organizations move to the cloud for their data warehousing needs. Importing data allows you to ingest a copy of the source data into an in-memory database.

Power BI 84

Power BI Analytics Analytics Azure 84

Snorkel AI

MAY 26, 2023

And that’s really key for taking data science experiments into production. The data scientists will start with experimentation, and then once they find some insights and the experiment is successful, then they hand over the baton to data engineers and ML engineers that help them put these models into production.

SQL 52

SQL ML ML Python 52

Snorkel AI

MAY 26, 2023

And that’s really key for taking data science experiments into production. The data scientists will start with experimentation, and then once they find some insights and the experiment is successful, then they hand over the baton to data engineers and ML engineers that help them put these models into production.

SQL 52

SQL ML ML Python 52

Flipboard

DECEMBER 18, 2023

Amazon Redshift powers data-driven decisions for tens of thousands of customers every day with a fully managed, AI-powered cloud data warehouse, delivering the best price-performance for your analytics workloads. Learn more about the AWS zero-ETL future with newly launched AWS databases integrations with Amazon Redshift.

AWS 112

AWS Data Warehouse ETL SQL 112

phData

NOVEMBER 9, 2023

Snowflake’s Data Cloud has emerged as a leader in cloud data warehousing. As a fundamental piece of the modern data stack , Snowflake is helping thousands of businesses store, transform, and derive insights from their data easier, faster, and more efficiently than ever before.

Data Warehouse 98

Data Warehouse Data Lakes Clustering Cloud Data 98