Towards AI

JULY 17, 2024

Back during my time as CTO of Locally, I was introduced to GraphDB as a mechanism for defining and discovering relationships between data, even using it as a simple definition store, it allows for depth and breadth-first searches to help discover relationships that might not have been explicitly defined.

Database 110

Database Data Modeling Data Models SQL 110

Hacker News

JULY 18, 2023

What if you could automatically shard your PostgreSQL database across any number of servers and get industry-leading performance at scale without any special data modelling steps? If you skip one of these steps, performance might be poor due to network overhead, or you might run into distributed SQL limitations.

Database 123

Database SQL Data Modeling Data Models 123

AWS Machine Learning Blog

SEPTEMBER 18, 2024

Additionally, Feast promotes feature reuse, so the time spent on data preparation is reduced greatly. It promotes a disciplined approach to data modeling, making it easier to ensure data quality and consistency across the ML pipelines. The following figure shows schema definition and model which reference it.

AWS 128

AWS Machine Learning Machine Learning ML 128

Tableau

OCTOBER 8, 2021

With its LookML modeling language, Looker provides a unique, modern approach to define governed and reusable data models to build a trusted foundation for analytics. Additionally, Tableau allows customers using BigQuery ML to easily visualize the results of predictive machine learning models run on data stored in BigQuery.

Tableau 138

Tableau Analytics Analytics Machine Learning 138

Pickl AI

OCTOBER 16, 2024

Summary: Relational Database Management Systems (RDBMS) are the backbone of structured data management, organising information in tables and ensuring data integrity. This article explores RDBMS’s features, advantages, applications across industries, the role of SQL, and emerging trends shaping the future of data management.

Database 52

Database SQL Big Data Big Data 52

phData

MAY 25, 2023

The June 2021 release of Power BI Desktop introduced Custom SQL queries to Snowflake in DirectQuery mode. While the loss of certain DAX functions is definitely a shortcoming that we hope Microsoft will address in the near future, the impact of these lost DAX functions is not necessarily as big as you would expect.

Power BI 84

Power BI Analytics Analytics Azure 84

ODSC - Open Data Science

JUNE 12, 2023

This article is an excerpt from the book Expert Data Modeling with Power BI, Third Edition by Soheil Bakhshi, a completely updated and revised edition of the bestselling guide to Power BI and data modeling. No-code/low-code experience using a diagram view in the data preparation layer similar to Dataflows.

Power BI 52

Power BI Data Warehouse ETL Data Preparation 52

ODSC - Open Data Science

SEPTEMBER 27, 2023

Understanding Data Lakes A data lake is a centralized repository that stores structured, semi-structured, and unstructured data in its raw format. Unlike traditional data warehouses or relational databases, data lakes accept data from a variety of sources, without the need for prior data transformation or schema definition.

Data Lakes 98

Data Lakes Data Warehouse Database Big Data 98

Tableau

OCTOBER 8, 2021

With its LookML modeling language, Looker provides a unique, modern approach to define governed and reusable data models to build a trusted foundation for analytics. Additionally, Tableau allows customers using BigQuery ML to easily visualize the results of predictive machine learning models run on data stored in BigQuery.

Tableau 98

Tableau Analytics Analytics Machine Learning 98

phData

JUNE 27, 2023

Using SQL-centric transformations to model data to be deployed. dbt is also great for data lineage and documentation to empower business analysts to make informed decisions on their data. Is dbt an Ideal Fit for YOUR Organization’s Data Stack? It is a compiler and a runner. Proceed as you see fit.

SQL 52

SQL Database Data Quality Data Warehouse 52

Mlearning.ai

JUNE 16, 2023

Generative AI can be used to automate the data modeling process by generating entity-relationship diagrams or other types of data models and assist in UI design process by generating wireframes or high-fidelity mockups. GPT-4 Data Pipelines: Transform JSON to SQL Schema Instantly Blockstream’s public Bitcoin API.

AI 52

AI AI Data Analysis Data Analysis 52

Pickl AI

AUGUST 9, 2024

Hierarchies align data modelling with business processes, making it easier to analyse data in a context that reflects real-world operations. Designing Hierarchies Designing effective hierarchies requires careful consideration of the business requirements and the data model.

Data Warehouse 52

Data Warehouse Data Quality ETL Business Intelligence 52

Alation

FEBRUARY 13, 2020

This achievement is a testament not only to our legacy of helping to create the data catalog category but also to our continued innovation in improving the effectiveness of self-service analytics. A broader definition of Business Intelligence. Enabling workers to find the right data is crucial to promoting self-service analytics.

Business Intelligence 52

Business Intelligence Business Intelligence Analytics Analytics 52

Mlearning.ai

FEBRUARY 13, 2023

With the use of keys, relational databases can easily define relationships between data elements, making them ideal for structured data like customer information, financial transactions, and product inventory. Some of the most popular relational databases include Oracle, MySQL, and Microsoft SQL Server. Popular relational DBs 2.

Database 52

Database Data Modeling Data Models Big Data 52

Pickl AI

AUGUST 11, 2024

Consider factors such as data volume, query patterns, and hardware constraints. Document and Communicate Maintain thorough documentation of fact table designs, including definitions, calculations, and relationships. Establish data governance policies and processes to ensure consistency in definitions, calculations, and data sources.

Data Quality 52

Data Quality Data Warehouse Data Governance Analytics 52

ODSC - Open Data Science

FEBRUARY 14, 2023

While this technology is definitely entertaining, it’s not quite clear yet how it can effectively be applied to the needs of the typical enterprise. The database would need to offer a flexible and expressive data model, allowing developers to easily store and query complex data structures.

Database 124

Database AI AI Natural Language Processing 124

AWS Machine Learning Blog

AUGUST 21, 2023

Data professionals such as data scientists want to use the power of Apache Spark , Hive , and Presto running on Amazon EMR for fast data preparation; however, the learning curve is steep. Solution overview We demonstrate this solution with an end-to-end use case using a sample dataset, the TPC data model.

AWS 98

AWS Data Lakes Clustering Data Preparation 98

Pickl AI

JUNE 7, 2024

It is a process for moving and managing data from various sources to a central data warehouse. This process ensures that data is accurate, consistent, and usable for analysis and reporting. Definition and Explanation of the ETL Process ETL is a data integration method that combines data from multiple sources.

ETL 40

ETL Data Quality Data Pipeline Data Warehouse 40

phData

JULY 14, 2023

Data Analysis Expressions (DAX) is the formula expression language employed in Power BI. With DAX, you can construct intricate calculations and queries on data residing in the Power BI data model. If you’re familiar with SQL, it is similar to a CASE statement, allowing for versatile conditional logic statements.

Power BI 52

Power BI Data Analyst Business Intelligence Business Intelligence 52

phData

NOVEMBER 13, 2023

Sidebar Navigation: Provides a catalog sidebar for browsing resources by type, package, file tree, or database schema, reflecting the structure of both dbt projects and the data platform. Version Tracking: Displays version information for models, indicating whether they are prerelease, latest, or outdated.

Database 52

Database Business Intelligence Business Intelligence Data Silos 52

Pickl AI

OCTOBER 21, 2024

It handles the underlying operations and ensures efficient data processing. The performance of the database engine significantly affects the overall efficiency of data transactions. Data Definition Language (DDL) DDL allows users to define the structure of the database.

Database 52

Database Apache Kafka Machine Learning Machine Learning 52

phData

JULY 18, 2023

Support for Numerous Data Sources: Fivetran supports over 200 data sources, including popular databases, applications, and cloud platforms like Salesforce, Google Analytics, SQL Server, Snowflake, and many more. Additionally, unsupported data sources can be integrated using Fivetran’s cloud function connectors.

Data Warehouse 52

Data Warehouse Analytics Analytics Cloud Data 52

Pickl AI

DECEMBER 4, 2023

and ‘‘What is the difference between Data Intelligence and Artificial Intelligence ?’. Criteria Data Intelligence Data Information Artificial Intelligence Data Analysis Definition Data Intelligence involves the analysis and interpretation of data to derive actionable insights. Look at the table below.

Data Analysis 52

Data Analysis Data Analysis Artificial Intelligence Artificial Intelligence 52

DagsHub

OCTOBER 23, 2024

Here’s the structured equivalent of this same data in tabular form: With structured data, you can use query languages like SQL to extract and interpret information. In contrast, such traditional query languages struggle to interpret unstructured data. This text has a lot of information, but it is not structured.

Machine Learning 52

Machine Learning Machine Learning Data Lakes AI 52

phData

SEPTEMBER 27, 2024

Introduction: The Customer Data Modeling Dilemma You know, that thing we’ve been doing for years, trying to capture the essence of our customers in neat little profile boxes? For years, we’ve been obsessed with creating these grand, top-down customer data models. Yeah, that one.

Data Modeling 52

Data Modeling Data Models Apache Kafka Data Lakes 52

The MLOps Blog

OCTOBER 3, 2023

Mikiko Bazeley: You definitely got the details correct. I definitely don’t think I’m an influencer. You see them all the time with a headline like: “data science, machine learning, Java, Python, SQL, or blockchain, computer vision.” It’s almost like a very specialized data storage solution.

ML 52

ML ML Data Scientist Machine Learning 52

Dataconomy

MARCH 18, 2025

Definition and examples An ACID database efficiently manages transactions according to ACID properties. Microsoft SQL Server: Widely used for business applications with strong transaction support. Consistency model: ACID systems prioritize consistency, whereas NoSQL may allow eventual consistency for better performance.

Database 91

Database SQL Data Modeling Data Models 91

phData

MAY 6, 2025

A dataset is a reusable data model that empowers users to create reports, dashboards, and analyses without directly accessing the underlying database. Its functionality comprises standing as an intermediary between raw data and visualizations and, thereby, acts as the place to facilitate ease of data exploration and analysis.

SQL 52

SQL Database Data Warehouse Analytics 52