phData

FEBRUARY 7, 2023

As administrators of the Snowflake Data Cloud platform begin to see adoption grow, they have to deal with an increasing backlog of requests for user onboarding, data access, and project resources such as databases, schemas, warehouses, etc. The end goal is to make resource provisioning to Snowflake easier, faster, and more secure.

SQL 52

SQL Database Data Governance 52

phData

MARCH 29, 2023

Services such as the Snowflake Data Cloud can house massive amounts of data and allows users to write queries to rapidly transform raw data into reports and further analyses. How Can Snowflake Work with KNIME? One of these—the KNIME Snowflake Extension—provides nodes dedicated to connecting to a Snowflake instance.

Database 52

Database SQL Analytics Analytics 52

phData

MAY 2, 2024

For example, Snowflake, one of the forefront cloud data platforms, is designed with parameters such as auto-suspend, resource monitors, statement timeout, and many others that facilitate cost and performance controls across the platform. This approach ensures a scalable, efficient, and cost-effective Snowflake environment.

Cloud Data 52

Cloud Data Data Governance 52

DataRobot

JUNE 9, 2021

With Snowflake’s announcement of Snowpark and Java UDFs (user-defined functions), DataRobot has continued to expand on this theme. With Snowpark, data preparation tasks in Zepl can be pushed down into Snowflake for in-database feature engineering. Snowflake has always delivered performance and ease-of-use for users familiar with SQL.

Machine Learning 52

Machine Learning Machine Learning Database Data Preparation 52

phData

DECEMBER 11, 2023

Our focus was on connecting to the Snowflake Data Cloud , and authentication was achieved via encrypted private keys. dbt-snowflake == 1.5.1 Then start Astro: astro dev start Snowflake Account If you don’t have a Snowflake account, go grab a free one. astronomer-cosmos==1.1.1

Database 52

Database AWS Python Algorithm 52

phData

OCTOBER 12, 2022

It allows you to tag which final models are being used for a particular data product or dashboard. The great thing about this is that you can tag your final models, and thanks to the DAG, the parent models will all be brought into that exposure. Need help getting started with Snowflake or dbt ? Reach out today!

SQL 52

SQL Data Warehouse Data Visualization Data Quality 52

Flipboard

MARCH 22, 2023

In this post, we show how to configure a new OAuth-based authentication feature for using Snowflake in Amazon SageMaker Data Wrangler. Snowflake is a cloud data platform that provides data solutions for data warehousing to data science. Configure Snowflake. Configure SageMaker Studio.

AWS 100

AWS Data Preparation Azure ML 100

Alation

JULY 15, 2021

The BAE, here too, does much of the work of tagging and automating, removing the burden of glossary management from people and streamlining approvals. In fact, in June of 2021, Snowflake recognized Alation officially for excellence in data governance, naming us their Data Governance Partner of the Year.

Data Governance 98

Data Governance ML ML Data Analyst 98

phData

JANUARY 15, 2024

In this blog, we’ll equip you with an overview of the security and compliance features in the Snowflake Data Cloud that help keep your data safe while following best practice compliance rules. What are the Security Features in Snowflake? Snowflake is a system with different parts: your data, Snowflake itself, and a secure network.

Data Governance 52

Data Governance Database Data Warehouse Cloud Computing 52

phData

FEBRUARY 14, 2023

This blog will examine how Insurance companies can effectively utilize the Snowflake Data Cloud to better manage data and take advantage of Snowflake’s innovative capabilities including data sharing, governance , and scalability. What is the Significance of Snowflake in Insurance?

Data Governance 52

Data Governance Data Silos Predictive Analytics Data Wrangling 52

Alation

JUNE 20, 2023

After its 2021 acquisition of Heights Finance Corporation, CURO needed to catalog and tag its legacy data while integrating Heights’ data — quickly. Katie: Heights had moved to Snowflake by the time the acquisition had taken place and Will and I started working together. CURO Financial Technologies Corp. and Canada.

Data Governance 52

Data Governance Database SQL Data Engineering 52

phData

NOVEMBER 6, 2023

Config Examples: Transient: You can use the transient parameter to declare a table as a transient table in Snowflake. Cluster By: You can use the cluster_by config parameter to specify which column Snowflake should cluster the table. It is a boolean parameter which can be set to true or false.

Clustering 52

Clustering SQL Python Database 52

phData

APRIL 15, 2024

Lots of cloud-based services like Snowflake will bill you based on usage, so if you’re using Direct Query with lots of users, you’re going to be using quite a bit of their services. Add in multiple reports and teams, and then you might start running into a big price tag from the service provider.

Power BI 52

Power BI Database Data Modeling Data Models 52

Tableau

JULY 20, 2022

Securely access Snowflake, Google BigQuery, Google Drive, Salesforce (Sales Cloud), and Microsoft OneDrive. You can also perform a variety of maintenance tasks like tagging stale content, or backing up content. Your data remains protected, even in transit, through encrypted TLS connections. Explore the endless possibilities.

Tableau 89

Tableau Azure Analytics Analytics 89

Alation

SEPTEMBER 9, 2021

Tagging data types. With appropriate tagging, data governance helps you meet compliance requirements by establishing appropriate security and access controls. In banks, this means: Setting data format standards. Identifying structured and unstructured data that needs to be protected. Creating roles and assigning responsibilities.

Data Governance 52

Data Governance Data Silos Analytics Analytics 52

Tableau

JULY 20, 2022

Securely access Snowflake, Google BigQuery, Google Drive, Salesforce (Sales Cloud), and Microsoft OneDrive. You can also perform a variety of maintenance tasks like tagging stale content, or backing up content. Your data remains protected, even in transit, through encrypted TLS connections. Explore the endless possibilities.

Tableau 87

Tableau Azure Analytics Analytics 87

AWS Machine Learning Blog

MAY 17, 2023

In this post, aimed primarily at those who are already using Snowflake, we explain how you can import both training and validation data for a facies classification task from Snowflake into Amazon SageMaker Canvas and subsequently train the model using a 3+ category prediction model. Import Snowflake directly into Canvas.

AWS 75

AWS ML ML Database 75

phData

APRIL 18, 2023

In this blog, we’ll explore how Investment Banks and AMCs can best leverage the Snowflake Data Cloud with its unique data sharing , governance, and scalability capabilities to address these challenges. Snowflake Marketplace offers data from leading industry providers such as Axiom, S&P Global, and FactSet.

Data Silos 52

Data Silos ETL Clustering Data Warehouse 52

phData

JANUARY 19, 2024

Matillion is also built for scalability and future data demands, with support for cloud data platforms such as Snowflake Data Cloud , Databricks, Amazon Redshift, Microsoft Azure Synapse, and Google BigQuery, making it future-ready, everyone-ready, and AI-ready.

Data Pipeline 52

Data Pipeline Data Warehouse ETL Azure 52

Smart Data Collective

SEPTEMBER 8, 2020

Ask people to tag both of your brands and choose a winner from among the participants. Soon enough, your little marketing snowflakes will turn into a giant, cartoon snowball (made of MONEY! Even if most of your sales are online, try to maintain a presence in local retail spaces. You can even create a raffle. 6 Get into Video.

Big Data 109

Big Data Big Data Natural Language Processing Analytics 109

Alation

MARCH 1, 2022

Manual lineage will give ARC a fuller picture of how data was created between AWS S3 data lake, Snowflake cloud data warehouse and Tableau (and how it can be fixed). This expands the data source compatibility, which was limited to Snowflake in 21.4. ARC also plans to leverage automated column-level lineage for Snowflake.

Data Warehouse 52

Data Warehouse Data Lakes Cloud Data Database 52

phData

SEPTEMBER 14, 2023

Suppose you have to analyze such extensive data without loading them into the Snowflake data cloud warehouse platform. In that case, Snowflake offers a schema-level object called an external table that can reference this data set and can be queried without loading them into the Snowflake table.

Data Analysis 52

Data Analysis Data Analysis SQL Azure 52

Alation

NOVEMBER 16, 2021

Alation and Snowflake are tightly integrated, bringing robust governance capabilities to the Snowflake Data Cloud. The Snowflake Data Cloud is one unified environment where organizations can bring different workloads together in a secure, governed manner. Alation and Snowflake Help You Scale Governance.

Data Governance 52

Data Governance Data Scientist SQL Data Silos 52

Alation

MARCH 29, 2023

They help our customers architect their modern data stack , tying in Snowflake or Fivetran where they’re needed, for example. It will also allow them to find curated, tagged data and use it more efficiently and compliantly. What role do partners play in the process? Our partners bring everything together.

Data Governance 52

Data Governance 52

phData

MAY 1, 2023

We’ve also spent a good amount of time upgrading our Netezza to Snowflake SQL translations. Provision Tool At its core, The Provision tool is a command line tool that uses a templated approach to manage Snowflake Data Cloud resources. What might be a VARCHAR with a specific size in SQL Server might just be a STRING in Snowflake.

SQL 52

SQL 52

Alation

OCTOBER 5, 2021

Data discovery and classification: Alation’s automated data discovery platform saves time and effort by classifying and tagging global policies. Consistent data privacy: Alation has made it much easier for data teams to control the handling and employee access of sensitive data in a Snowflake data ecosystem.

Data Governance 96

Data Governance Data Quality Data Silos Analytics 96

phData

OCTOBER 20, 2023

Snowflake Data Cloud has a number of powerful features that empower organizations to make more data-driven decisions for both Structured and Semi-Structured data. We will look at semi-structured data formats and how to parse XML & JSON using different methods in Snowflake. What is Semi-structured Data?

Big Data 52

Big Data Big Data Database Hadoop 52

phData

AUGUST 1, 2023

In this blog, we will cover what plugins are, why they are useful, and an example of how to develop one using the NeuralProphet Python package and Snowflake Data Cloud. The first thing I’m going to do is connect to a time series dataset currently residing in Snowflake called Airline Stock Prices.

Python 52

Python Database ML ML 52

phData

AUGUST 1, 2023

In this blog, we will cover what plugins are, why they are useful, and an example of how to develop one using the NeuralProphet Python package and Snowflake Data Cloud. The first thing I’m going to do is connect to a time series dataset currently residing in Snowflake called Airline Stock Prices.

Python 52

Python Database ML ML 52

phData

FEBRUARY 8, 2024

The dbt artifacts also contain valuable information about the concerned dbt projects, such as connections between the model tags, between the test and models, owners, etc. It is an internal file that serves as the point of integration with MetricFlow.

Data Modeling 52

Data Modeling Data Models Database Data Warehouse 52

Alation

OCTOBER 27, 2022

Adrian Lievano, Senior Data Scientist, Alation : Most of our data sources are connected and extracted using Fivetran , and then transported to raw storage in Snowflake. Next, we ingest the Google Sheet data into the Snowflake Data Cloud using Fivetran. Next, we ingest the Google Sheet data into the Snowflake Data Cloud using Fivetran.

Data Analyst 52

Data Analyst Data Scientist Data Warehouse Analytics 52

phData

OCTOBER 2, 2023

As a managed solution on top of Feast, Tecton comes with a higher price tag but will be easier for organizations to adopt and leverage. It also supports a vast selection of data sources, including the Snowflake Data Cloud , Redshift, and HDFS. It also includes a web UI to browse and explore features.

Data Warehouse 98

Data Warehouse ML ML Data Scientist 98

Snorkel AI

JANUARY 11, 2023

Rich information was buried within titles, descriptions, content, and tags and was difficult to normalize. As an example, they used the unstructured video title tags and descriptions stored in their Snowflake data warehouse and created prompts that asked the FM to classify videos based on the description.

Data Warehouse 52

Data Warehouse Natural Language Processing Data Scientist Data Quality 52

Alation

MAY 24, 2022

For example, a data steward can filter all data by ‘“endorsed data’” in a Snowflake data warehouse, tagged with ‘bank account’. This builds on existing column-level lineage support for AWS Redshift, Google BigQuery, and Snowflake. Alation is extending automated column level lineage in 2022.2 for the popular database SQL Server.

Data Quality 98

Data Quality Data Governance ETL Data Observability 98

phData

AUGUST 9, 2023

Any code or SQL logic placed between the opening and closing tags ( {% macro %} and {% endmacro %} ) will be processed and rendered at the location where you call the macro. . {% endmacro %} dbt macros are defined using the syntax {% macro macro_name(arg1, arg2) %} to start the macro block and we end it with {% endmacro %}.

SQL 52

SQL Python 52

Alation

APRIL 4, 2023

A critical part of this release is expanded lineage for Snowflake, Redshift, and PostgreSQL, showing dbt transformation code (SQL & Jinja) in the Data Flow Object within Alation’s lineage graph. Joint users can search, curate, tag, and flag lineage easily, accelerating productivity and accuracy.

DataOps 52

DataOps Data Engineering Data Engineer Data Engineering 52

AWS Machine Learning Blog

MARCH 10, 2023

Data Wrangler enables you to access data from a wide variety of popular sources ( Amazon S3 , Amazon Athena , Amazon Redshift , Amazon EMR and Snowflake) and over 40 other third-party sources. You can confirm this by clicking on the File system ID and confirming the tag ManagedByAmazonSageMakerResource on the Tags tab.

Clustering 76

Clustering AWS ML ML 76