Hacker News

NOVEMBER 14, 2023

OnPrem - Geospatial database D2. OnPrem - SAP database D4. OnCloud - Large mirror database D10. OnPrem - LotusNotes database D11. OnPrem - LotusNotes database D11. OnPrem - IBM BPM database D12. In 2000s many of our systems were built on top of IBM Lotus Notes databases. OnPrem - Sharepoint D7.

Power BI 121

Power BI Database Algorithm Azure 121

Pickl AI

MARCH 4, 2024

How do you load data into Power BI? Loading data into Power BI is a straightforward process. Using Power Query, users can connect to various data sources such as Excel files, SQL databases, or cloud services like Azure. Once connected, data can be transformed and loaded into Power BI for analysis.

Power BI 52

Power BI Data Analysis Data Analysis Data Modeling 52

Data Science Blog

SEPTEMBER 19, 2023

So why using IaC for Cloud Data Infrastructures? This ensures that the data models and queries developed by data professionals are consistent with the underlying infrastructure. Enhanced Security and Compliance Data Warehouses often store sensitive information, making security a paramount concern.

Data Warehouse 259

Data Warehouse Azure SQL Database 259

Mlearning.ai

FEBRUARY 16, 2023

The solution was built on top of Amazon Web Services and is now available on Google Cloud and Microsoft Azure. Pros and Cons of a Snowflake Data Warehouse We will guide you through the fundamental advantages and drawbacks of the Snowflake data cloud to provide you with a closer look at the solution. What does Snowflake do?

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

Pickl AI

JULY 25, 2023

Data engineers are essential professionals responsible for designing, constructing, and maintaining an organization’s data infrastructure. They create data pipelines, ETL processes, and databases to facilitate smooth data flow and storage. Data Warehousing: Amazon Redshift, Google BigQuery, etc.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Cambridge Intelligence

OCTOBER 19, 2023

That’s why our data visualization SDKs are database agnostic: so you’re free to choose the right stack for your application. There have been a lot of new entrants and innovations in the graph database category, with some vendors slowly dipping below the radar, or always staying on the periphery.

Database 59

Database Azure SQL AWS 59

Data Science Blog

NOVEMBER 15, 2023

In addition to Business Intelligence (BI), Process Mining is no longer a new phenomenon, but almost all larger companies are conducting this data-driven process analysis in their organization. The Event Log Data Model for Process Mining Process Mining as an analytical system can very well be imagined as an iceberg.

Data Modeling 245

Data Modeling Data Models Business Intelligence Business Intelligence 245

Precisely

MARCH 9, 2023

Processing speeds were considerably slower than they are today, so large volumes of data called for an approach in which data was staged in advance, often running ETL (extract, transform, load) processes overnight to enable next-day visibility to key performance indicators. It is often used as a foundation for enterprise data lakes.

Data Lakes 59

Data Lakes Data Warehouse Hadoop Apache Hadoop 59

Dataconomy

SEPTEMBER 4, 2023

Key features of cloud analytics solutions include: Data models , Processing applications, and Analytics models. Data models help visualize and organize data, processing applications handle large datasets efficiently, and analytics models aid in understanding complex data sets, laying the foundation for business intelligence.

Analytics 203

Analytics Analytics Big Data Analytics Big Data Analytics 203

phData

SEPTEMBER 28, 2023

Dataflows represent a cloud-based technology designed for data preparation and transformation purposes. Dataflows have different connectors to retrieve data, including databases, Excel files, APIs, and other similar sources, along with data manipulations that are performed using Online Power Query Editor.

Power BI 78

Power BI Data Preparation Machine Learning Machine Learning 78

Revolutions

JANUARY 21, 2021

by Hong Ooi Last week , I announced AzureCosmosR, an R interface to Azure Cosmos DB , a fully-managed NoSQL database service in Azure. Explaining what Azure Cosmos DB is can be tricky, so here’s an excerpt from the official description : Azure Cosmos DB is a fully managed NoSQL database for modern app development.

Azure 40

Azure SQL Database Administration Database 40

phData

MAY 25, 2023

Having gone public in 2020 with the largest tech IPO in history, Snowflake continues to grow rapidly as organizations move to the cloud for their data warehousing needs. In a perfect world, Microsoft would have clients push even more storage and compute to its Azure Synapse platform.

Power BI 84

Power BI Analytics Analytics Azure 84

Snorkel AI

JUNE 7, 2023

student Zachary Huang took the second-place prize of $5,000 dollars worth of cloud GPU credits from Lamba with a presentation on JoinBoost, a package he created that allows users to train tree models inside databases faster and more safely than traditional methods. Columbia University Ph.D. Rutgers Universit Ph.D.

Data Scientist 52

Data Scientist AI AI Machine Learning 52

Snorkel AI

JUNE 7, 2023

student Zachary Huang took the second-place prize of $5,000 dollars worth of cloud GPU credits from Lamba with a presentation on JoinBoost, a package he created that allows users to train tree models inside databases faster and more safely than traditional methods. Columbia University Ph.D. Rutgers Universit Ph.D.

Data Scientist 52

Data Scientist AI AI Machine Learning 52

ODSC - Open Data Science

APRIL 6, 2023

It’s a foundational skill for working with relational databases Just about every data scientist or analyst will have to work with relational databases in their careers. So by learning to use SQL, you’ll write efficient and effective queries, as well as understand how the data is structured and stored.

SQL 98

SQL Data Scientist Database Data Analysis 98

Hacker News

JULY 18, 2023

What if you could automatically shard your PostgreSQL database across any number of servers and get industry-leading performance at scale without any special data modelling steps? Schema-based sharding has almost no data modelling restrictions or special steps compared to unsharded PostgreSQL.

Database 123

Database SQL Data Modeling Data Models 123

phData

JULY 11, 2023

Power BI Datamarts provides a low/no code experience directly within Power BI Service that allows developers to ingest data from disparate sources, perform ETL tasks with Power Query, and load data into a fully managed Azure SQL database. Expand the databases and schemas to show the associated tables.

Power BI 40

Power BI SQL Azure ETL 40

DagsHub

APRIL 21, 2024

Amazon SageMaker pricing is based on a pay-as-you-go model, with costs calculated based on factors such as instance type, storage usage, and training hours. Similar to SageMaker, Azure ML offers a range of tools and services for the entire machine learning lifecycle, from data preparation and model development to deployment and monitoring.

Machine Learning 59

Machine Learning Machine Learning ML ML 59

DagsHub

DECEMBER 11, 2023

DagsHub DagsHub is a centralized Github-based platform that allows Machine Learning and Data Science teams to build, manage and collaborate on their projects. In addition to versioning code, teams can also version data, models, experiments and more. However, these tools have functional gaps for more advanced data workflows.

Machine Learning 98

Machine Learning Machine Learning Data Lakes Database 98

The MLOps Blog

JUNE 27, 2023

SageMaker Studio offers built-in algorithms, automated model tuning, and seamless integration with AWS services, making it a powerful platform for developing and deploying machine learning solutions at scale. Model versioning, lineage, and packaging : Can you version and reproduce models and experiments?

Machine Learning 134

Machine Learning Machine Learning ML ML 134

Mlearning.ai

SEPTEMBER 4, 2023

Turbo model, this may be a better fit for some businesses.[2],[3] 2],[3] It’s important to note that even with a million-dollar investment, it may be challenging to match the general performance and latency of these commercial models.[4] 4] Private instances: Microsoft Azure provides a private instance of ChatGPT.

AI 52

AI AI Azure Machine Learning 52

O'Reilly Media

OCTOBER 19, 2021

We need robust versioning for data, models, code, and preferably even the internal state of applications—think Git on steroids to answer inevitable questions: What changed? ML use cases rarely dictate the master data management solution, so the ML stack needs to integrate with existing data warehouses.

ML 138

ML ML Data Scientist AWS 138

Mlearning.ai

JUNE 16, 2023

Generative AI can be used to automate the data modeling process by generating entity-relationship diagrams or other types of data models and assist in UI design process by generating wireframes or high-fidelity mockups. diagram Using ChatGPT to build system diagrams — Part II Generate C4 diagrams using mermaid.js

AI 52

AI AI Data Analysis Data Analysis 52

phData

FEBRUARY 13, 2024

Employing a modular structure, SAP ERP encompasses modules such as finance, human resources, supply chain , and more, facilitating real-time collaboration and data sharing across different departments through a centralized database. SAP is relatively easy to work with. What is SNP Glue?

Analytics 59

Analytics Analytics Data Scientist Data Modeling 59

phData

NOVEMBER 13, 2023

Sidebar Navigation: Provides a catalog sidebar for browsing resources by type, package, file tree, or database schema, reflecting the structure of both dbt projects and the data platform. Version Tracking: Displays version information for models, indicating whether they are prerelease, latest, or outdated.

Database 52

Database Business Intelligence Business Intelligence Data Silos 52

phData

JULY 18, 2023

First up, let’s dive into the foundation of every Modern Data Stack, a cloud-based data warehouse. Central Source of Truth for Analytics A Cloud Data Warehouse (CDW) is a type of database that provides analytical data processing and storage capabilities within a cloud-based infrastructure.

Data Warehouse 52

Data Warehouse SQL Cloud Data Analytics 52