ODSC - Open Data Science

SEPTEMBER 27, 2023

In this article, we will delve into the concept of data lakes, explore their differences from data warehouses and relational databases, and discuss the significance of data version control in the context of large-scale data management. Schema Enforcement: Data warehouses use a “schema-on-write” approach.

Data Lakes 98

Data Lakes Data Warehouse Database Big Data 98

IBM Journey to AI blog

APRIL 25, 2023

In a prior blog , we pointed out that warehouses, known for high-performance data processing for business intelligence, can quickly become expensive for new data and evolving workloads. To do so, Presto and Spark need to readily work with existing and modern data warehouse infrastructures.

Data Warehouse 57

Data Warehouse Data Engineering Data Engineer Data Engineering 57

Data Science Blog

MARCH 30, 2023

Jedes Process Mining Tool benötigt pro Use Case mindestens ein Event Log. Eine bessere Idee ist es daher, Event Logs nicht in einzelnen Process Mining Tools aufzubereiten, sondern zentral in einem dafür vorgesehenen Data Warehouse zu erstellen, zu katalogisieren und darüber auch die grundsätzliche Data Governance abzusichern.

Data Warehouse 147

Data Warehouse Business Intelligence Business Intelligence Power BI 147

AWS Machine Learning Blog

MARCH 11, 2024

In this post, we show you how VistaPrint uses a combination of Amazon Personalize , Twilio Segment , and auxiliary AWS services and partner solutions to better understand their customers’ needs and provide personalized product recommendations. Transform the data to create Amazon Personalize training data.

AWS 93

AWS Data Warehouse Machine Learning Machine Learning 93

phData

APRIL 29, 2024

Recognizing these specific needs, Fivetran has developed a range of connectors, including dedicated applications, databases, files, and events, which can accommodate the diverse formats used by healthcare systems. Coming up next is a list of frequently used connectors based on insights gathered from engagements with our customers.

SQL 52

SQL Azure Data Warehouse Cloud Data 52

Smart Data Collective

APRIL 8, 2020

Demands from business decision makers for real-time data access is also seeing an unprecedented rise at present, in order to facilitate well-informed, educated business decisions. One of the most lucrative ways to do this is through data warehousing.

Data Warehouse 134

Data Warehouse Big Data Big Data Business Intelligence 134

Smart Data Collective

MAY 31, 2022

It’s more than just allowing access to data warehouses that were becoming dangerously close to data silos. Data activation is about giving businesses the power to make data serve them. Data activation is an exciting tool for companies to take advantage of to use their data to its fullest potential.

ETL 134

ETL Data Silos Data Warehouse Big Data 134

Tableau

JUNE 8, 2021

Domain experts, for example, feel they are still overly reliant on core IT to access the data assets they need to make effective business decisions. In all of these conversations there is a sense of inertia: Data warehouses and data lakes feel cumbersome and data pipelines just aren't agile enough.

Tableau 92

Tableau Data Lakes Data Warehouse SQL 92

phData

SEPTEMBER 19, 2023

With the amount of data companies are using growing to unprecedented levels, organizations are grappling with the challenge of efficiently managing and deriving insights from these vast volumes of structured and unstructured data. Avro and Parquet File Formats Avro and Parquet are file formats commonly used in data lakes.

Data Lakes 52

Data Lakes Data Modeling Data Models Data Warehouse 52

phData

AUGUST 9, 2023

With ELT, we first extract data from source systems, then load the raw data directly into the data warehouse before finally applying transformations natively within the data warehouse. This is unlike the more traditional ETL method, where data is transformed before loading into the data warehouse.

ETL 52

ETL Data Warehouse Cloud Data Big Data 52

Smart Data Collective

MAY 16, 2022

Data is becoming more important to modern organizations than ever before. However, many companies are still struggling to use it effectively. One poll found that 74% of companies feel they are still struggling to use data effectively. One of the problems is that they don’t manage their data well.

Data Warehouse 128

Data Warehouse Data Mining Data Mining Data Mining 128

Mlearning.ai

FEBRUARY 16, 2023

The ultimate need for vast storage spaces manifests in data warehouses: specialized systems that aggregate data coming from numerous sources for centralized management and consistency. In this article, you’ll discover what a Snowflake data warehouse is, its pros and cons, and how to employ it efficiently.

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

ODSC - Open Data Science

JUNE 22, 2023

Rather than using paper records, data is now collected and stored using digital tools. While databases were the traditional way to store large amounts of data, a new storage method has developed that can store even more significant and varied amounts of data. These are called data lakes. What Are Data Lakes?

Data Lakes 98

Data Lakes Data Warehouse Database Data Science 98

phData

MARCH 7, 2023

After a year of working with this innovative technology, and it being announced for Public Preview, we’d love to share with you our thoughts on this technology and how to best use it. Currently, Snowflake supports loading most data through bulk loads using Snowpipe. Once this step is complete, you can then insert the data.

Data Warehouse 98

Data Warehouse Database 98

phData

NOVEMBER 28, 2023

Matillion is also built for scalability and future data demands, with support for cloud data platforms such as Snowflake Data Cloud , Databricks, Amazon Redshift, Microsoft Azure Synapse, and Google BigQuery, making it future-ready, everyone-ready, and AI-ready. Let’s take the first option, Use a Matillion Trial Warehouse.

Data Warehouse 52

Data Warehouse Data Pipeline ETL Azure 52

Pickl AI

NOVEMBER 15, 2023

Discover the nuanced dissimilarities between Data Lakes and Data Warehouses. Data management in the digital age has become a crucial aspect of businesses, and two prominent concepts in this realm are Data Lakes and Data Warehouses. It acts as a repository for storing all the data.

Data Lakes 52

Data Lakes Data Warehouse Database ETL 52

phData

APRIL 4, 2023

Customers who don’t necessarily want to put their data directly into a data warehouse like the Snowflake Data Cloud can now use Fivetran to build a performant, governed, managed dataset on top of S3 which can still be efficiently queried and manipulated from within their query engine of choice.

Data Lakes 52

Data Lakes Data Warehouse Cloud Data AWS 52

IBM Journey to AI blog

JANUARY 5, 2023

The right data architecture can help your organization improve data quality because it provides the framework that determines how data is collected, transported, stored, secured, used and shared for business intelligence and data science use cases. Developing a standardized nomenclature.

Data Quality 52

Data Quality Data Lakes Data Warehouse Business Intelligence 52

Tableau

JUNE 8, 2021

Domain experts, for example, feel they are still overly reliant on core IT to access the data assets they need to make effective business decisions. In all of these conversations there is a sense of inertia: Data warehouses and data lakes feel cumbersome and data pipelines just aren't agile enough.

Tableau 52

Tableau Data Lakes Data Warehouse SQL 52

phData

DECEMBER 12, 2023

A complete view of the fan, rather than pieces of information spread across various departments, means less guesswork and more data insights. Step 2: Analyze the Data Once you have centralized your data, use a business intelligence tool like Sigma Computing , Power BI , Tableau , or another to craft analytics dashboards.

Data Warehouse 52

Data Warehouse Machine Learning Machine Learning Tableau 52

IBM Journey to AI blog

NOVEMBER 15, 2023

The most common use cases from partners often combine several of these AI tasks. ISVs need the flexibility to choose models appropriate to their industry, domain and use case. Let’s explore a few AI use cases that span different industries. Ubotica is leveraging IBM Cloud and watsonx.ai

AI 92

AI AI Data Warehouse Database 92

DataRobot Blog

MARCH 8, 2023

Leveraging DataRobot’s JDBC connectors, enterprise teams can work together to train ML models on their data residing in SAP HANA Cloud and SAP Data Warehouse Cloud, as well as have an option to enrich it with data from external data sources.

Machine Learning 105

Machine Learning Machine Learning ML ML 105

phData

MARCH 7, 2023

Additionally, data does not only have to be replicated from one database to another but can be extracted from multiple sources or written to multiple target databases. Why Use GoldenGate? There are many benefits to using GoldenGate for data replication, with a wide array of use cases.

Hadoop 59

Hadoop Database Data Warehouse AWS 59

phData

MAY 12, 2023

The integration capabilities of KNIME and the scalable data warehousing of Snowflake combine to offer a flexible and powerful platform for financial data analytics. In this blog, we will delve into three specific use cases where the KNIME-Snowflake combination is effectively deployed in the financial services industry.

Data Warehouse 72

Data Warehouse Machine Learning Machine Learning Database 72

phData

JULY 19, 2023

Are you tired of spending hours manually extracting, transforming, and loading data into your business systems? In this blog post, we’ll dive into the amazing advantages of using Fivetran , a powerful data integration platform that will revolutionize the way you handle your data pipelines. Look no further!

Data Warehouse 52

Data Warehouse Database Data Pipeline SQL 52

phData

JULY 19, 2023

Are you tired of spending hours manually extracting, transforming, and loading data into your business systems? In this blog post, we’ll dive into the amazing advantages of using Fivetran , a powerful data integration platform that will revolutionize the way you handle your data pipelines. Look no further!

Data Warehouse 52

Data Warehouse Database Data Pipeline SQL 52

Alation

JULY 28, 2022

It’s costly and time-consuming to manage on-premises data warehouses — and modern cloud data architectures can deliver business agility and innovation. However, CIOs declare that agility, innovation, security, adopting new capabilities, and time to value — never cost — are the top drivers for cloud data warehousing.

Data Warehouse 69

Data Warehouse Cloud Data Data Governance Database 69

phData

MAY 14, 2024

The Snowflake Data Cloud offers unparalleled flexibility, performance, and ease of use; however, migrating to a new data platform is not without its challenges. Snowflake is a cloud-native data warehousing platform that separates computing and storage, allowing for automatic scaling and pay-per-use pricing.

SQL 52

SQL Data Warehouse Data Engineering Data Engineer 52

IBM Journey to AI blog

NOVEMBER 6, 2023

Generative AI can turn SMB needs into product use cases, and the appropriate tech systems can allow SMBs to test products in a sandbox. With usage-based pricing of products, SMBs pay for only what they use. Watsonx.data allows enterprises to centrally gather, categorize and filter data from multiple sources.

AI 110

AI AI Data Warehouse Clean Data 110

Dataconomy

SEPTEMBER 4, 2023

The modern corporate world is more data-driven, and companies are always looking for new methods to make use of the vast data at their disposal. Here are some of the key types of cloud analytics: Descriptive analytics: This type focuses on summarizing historical data to provide insights into what has happened in the past.

Analytics 203

Analytics Analytics Big Data Analytics Big Data Analytics 203

Tableau

MAY 11, 2022

You’re tasked with managing a sprawling data ecosystem that likely requires costly maintenance, and at the same time, your analysts can’t find the data they need or worse, are building their findings on poor data. . If that's the case, you aren't alone. Address technical debt. Here’s a look at what we provide today.

Tableau 95

Tableau Data Warehouse Database Data Analyst 95

Tableau

MAY 11, 2022

You’re tasked with managing a sprawling data ecosystem that likely requires costly maintenance, and at the same time, your analysts can’t find the data they need or worse, are building their findings on poor data. . If that's the case, you aren't alone. Address technical debt. Here’s a look at what we provide today.

Tableau 93

Tableau Data Warehouse Database Data Analyst 93

ODSC - Open Data Science

FEBRUARY 8, 2023

Common databases appear unable to cope with the immense increase in data volumes. This is where the BigQuery data warehouse comes into play. Google BigQuery is a potent tool for working with Big Data, but surprisingly its distributed architecture makes it an equally attractive solution in cases of smaller data volumes.

Database 97

Database Business Intelligence Business Intelligence Big Data 97

Precisely

MAY 13, 2024

If you’re in the market for a data integration solution, there are many things to consider – including the flexibility of integration solutions, the availability of a strong network of service providers, and the vendor’s reputation for thought leadership in the integration space. A notable capability that achieves this is the data catalog.

Data Governance 52

Data Governance Data Pipeline Data Quality Cloud Data 52

Data Science Dojo

SEPTEMBER 6, 2023

M aintaining the security and governance of data within a data warehouse is of utmost importance. Data Security: A Multi-layered Approach In data warehousing, data security is not a single barrier but a well-constructed series of layers, each contributing to protecting valuable information.

Data Warehouse 195

Data Warehouse Data Governance ETL Data Quality 195

IBM Journey to AI blog

OCTOBER 16, 2023

As more businesses use AI systems and the technology continues to mature and change, improper use could expose a company to significant financial, operational, regulatory and reputational risks. Using AI for certain business tasks or without guardrails in place may also not align with an organization’s core values.

AI 77

AI AI Data Warehouse ML 77

phData

FEBRUARY 9, 2023

In this blog, we’ll take a closer look into how analytics can be useful in manufacturing. Quality Control One common use case for analytics in manufacturing is quality control. Production Planning Another use case for analytics in manufacturing is production planning.

Analytics 52

Analytics Analytics Power BI Data Warehouse 52