Data Science Dojo

FEBRUARY 20, 2023

These tools will help you streamline your machine learning workflow, reduce operational overheads, and improve team collaboration and communication. Machine learning (ML) is the technology that automates tasks and provides insights. It allows data scientists to build models that can automate specific tasks.

Machine Learning 195

Machine Learning Machine Learning AWS Azure 195

AWS Machine Learning Blog

DECEMBER 15, 2023

We are excited to announce the launch of Amazon DocumentDB (with MongoDB compatibility) integration with Amazon SageMaker Canvas , allowing Amazon DocumentDB customers to build and use generative AI and machine learning (ML) solutions without writing code. Analyze data using generative AI. Prepare data for machine learning.

Machine Learning 82

Machine Learning Machine Learning AWS ML 82

AWS Machine Learning Blog

OCTOBER 18, 2023

Purina used artificial intelligence (AI) and machine learning (ML) to automate animal breed detection at scale. The AWS Cloud Development Kit (AWS CDK) is an open-source software development framework for defining cloud infrastructure as code with modern programming languages and deploying it through AWS CloudFormation.

AWS 88

AWS ML ML Machine Learning 88

Data Science Dojo

JULY 6, 2023

Data engineering tools are software applications or frameworks specifically designed to facilitate the process of managing, processing, and transforming large volumes of data. Amazon Redshift: Amazon Redshift is a cloud-based data warehousing service provided by Amazon Web Services (AWS).

Data Engineering 195

Data Engineering Data Engineer Data Engineering Data Engineering 195

AWS Machine Learning Blog

SEPTEMBER 18, 2023

Machine learning (ML) is becoming increasingly complex as customers try to solve more and more challenging problems. This complexity often leads to the need for distributed ML, where multiple machines are used to train a single model. The full code can be found on the aws-samples-for-ray GitHub repository.

Machine Learning 93

Machine Learning Machine Learning ML ML 93

AWS Machine Learning Blog

MARCH 1, 2023

Statistical methods and machine learning (ML) methods are actively developed and adopted to maximize the LTV. In this post, we share how Kakao Games and the Amazon Machine Learning Solutions Lab teamed up to build a scalable and reliable LTV prediction solution by using AWS data and ML services such as AWS Glue and Amazon SageMaker.

AWS 84

AWS ML ML ETL 84

Mlearning.ai

APRIL 6, 2023

Automate and streamline our ML inference pipeline with SageMaker and Airflow Building an inference data pipeline on large datasets is a challenge many companies face. The Batch job automatically launches an ML compute instance, deploys the model, and processes the input data in batches, producing the output predictions.

Data Pipeline 52

Data Pipeline ML ML AWS 52

DagsHub

APRIL 7, 2024

Image generated with Midjourney In today’s fast-paced world of data science, building impactful machine learning models relies on much more than selecting the best algorithm for the job. A primer on ML workflows and pipelines Before exploring the tools, we first need to explain the difference between ML workflows and pipelines.

Machine Learning 59

Machine Learning Machine Learning ML ML 59

AWS Machine Learning Blog

FEBRUARY 23, 2023

To address the large value challenge, you can utilize the Amazon SageMaker distributed data parallelism feature (SMDDP). SageMaker is a fully managed machine learning (ML) service. With data parallelism, a large volume of data is split into batches. This reduces the development velocity and ability to fail fast.

AWS 85

AWS ML ML Machine Learning 85

AWS Machine Learning Blog

FEBRUARY 1, 2024

Consider the following picture, which is an AWS view of the a16z emerging application stack for large language models (LLMs). This pipeline could be a batch pipeline if you prepare contextual data in advance, or a low-latency pipeline if you’re incorporating new contextual data on the fly.

AWS 105

AWS AI AI Database 105

AWS Machine Learning Blog

FEBRUARY 13, 2024

Amazon SageMaker Feature Store is a fully managed, purpose-built repository to store, share, and manage features for machine learning (ML) models. SageMaker Feature Store now makes it effortless to share, discover, and access feature groups across AWS accounts. Features are inputs to ML models used during training and inference.

AWS 98

AWS ML ML Machine Learning 98

Pickl AI

MAY 15, 2024

As a Data Analyst, you’ve honed your skills in data wrangling, analysis, and communication. But the allure of tackling large-scale projects, building robust models for complex problems, and orchestrating data pipelines might be pushing you to transition into Data Science architecture.

Data Analyst 52

Data Analyst Data Scientist Data Science Machine Learning 52

The MLOps Blog

MARCH 21, 2023

Moving across the typical machine learning lifecycle can be a nightmare. From gathering and processing data to building models through experiments, deploying the best ones, and managing them at scale for continuous value in production—it’s a lot. How to understand your users (data scientists, ML engineers, etc.).

Machine Learning 69

Machine Learning Machine Learning Data Scientist ML 69

AWS Machine Learning Blog

FEBRUARY 1, 2024

To unlock the potential of generative AI technologies, however, there’s a key prerequisite: your data needs to be appropriately prepared. In this post, we describe how use generative AI to update and scale your data pipeline using Amazon SageMaker Canvas for data prep.

Data Preparation 81

Data Preparation AWS AI AI 81

AWS Machine Learning Blog

FEBRUARY 24, 2023

AWS recently released Amazon SageMaker geospatial capabilities to provide you with satellite imagery and geospatial state-of-the-art machine learning (ML) models, reducing barriers for these types of use cases. In the following sections, we dive into each pipeline in more detail.

AWS 82

AWS Data Pipeline ML ML 82

AWS Machine Learning Blog

MARCH 14, 2024

In this post we highlight how the AWS Generative AI Innovation Center collaborated with the AWS Professional Services and PGA TOUR to develop a prototype virtual assistant using Amazon Bedrock that could enable fans to extract information about any event, player, hole or shot level details in a seamless interactive manner.

SQL 94

SQL AWS AI AI 94

Flipboard

NOVEMBER 24, 2023

In an increasingly digital and rapidly changing world, BMW Group’s business and product development strategies rely heavily on data-driven decision-making. With that, the need for data scientists and machine learning (ML) engineers has grown significantly.

ML 95

ML ML AWS AI 95

AWS Machine Learning Blog

DECEMBER 20, 2023

Whether logs are coming from Amazon Web Services (AWS), other cloud providers, on-premises, or edge devices, customers need to centralize and standardize security data. After the security log data is stored in Amazon Security Lake, the question becomes how to analyze it. Subscribe an AWS Lambda function to the SQS queue.

AWS 98

AWS ML ML Algorithm 98

AWS Machine Learning Blog

MARCH 15, 2024

This approach can help heart stroke patients, doctors, and researchers with faster diagnosis, enriched decision-making, and more informed, inclusive research work on stroke-related health issues, using a cloud-native approach with AWS services for lightweight lift and straightforward adoption. Stroke victims can lose around 1.9

AWS 92

AWS ML ML Data Silos 92

Pickl AI

JULY 25, 2023

Data engineers are essential professionals responsible for designing, constructing, and maintaining an organization’s data infrastructure. They create data pipelines, ETL processes, and databases to facilitate smooth data flow and storage. Read more to know.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

AWS Machine Learning Blog

SEPTEMBER 28, 2023

This process significantly benefits from the MLOps features of SageMaker, which streamline the data science workflow by harnessing the powerful cloud infrastructure of AWS. Click here to open the AWS console and follow along. About the Authors Nick Biso is a Machine Learning Engineer at AWS Professional Services.

AWS 84

AWS Machine Learning Machine Learning ML 84

Mlearning.ai

MARCH 15, 2023

Build a Stocks Price Prediction App powered by Snowflake, AWS, Python and Streamlit — Part 2 of 3 A comprehensive guide to develop machine learning applications from start to finish. Introduction Welcome Back, Let's continue with our Data Science journey to create the Stock Price Prediction web application.

Python 52

Python AWS Exploratory Data Analysis EDA 52

Flipboard

AUGUST 17, 2023

Amazon Redshift is the most popular cloud data warehouse that is used by tens of thousands of customers to analyze exabytes of data every day. It provides a single web-based visual interface where you can perform all ML development steps, including preparing data and building, training, and deploying models.

ML 93

ML ML AWS Data Warehouse 93

AWS Machine Learning Blog

MARCH 8, 2023

Amazon SageMaker is a fully managed machine learning (ML) service. With SageMaker, data scientists and developers can quickly and easily build and train ML models, and then directly deploy them into a production-ready hosted environment. Store your Snowflake account credentials in AWS Secrets Manager.

ML 98

ML ML AWS Python 98

ODSC - Open Data Science

FEBRUARY 17, 2023

Knowing how spaCy works means little if you don’t know how to apply core NLP skills like transformers, classification, linguistics, question answering, sentiment analysis, topic modeling, machine translation, speech recognition, named entity recognition, and others. The chart below shows what’s hot right now.

Deep Learning 111

Deep Learning Deep Learning Data Science Natural Language Processing 111

The MLOps Blog

JUNE 27, 2023

How to evaluate MLOps tools and platforms Like every software solution, evaluating MLOps (Machine Learning Operations) tools and platforms can be a complex task as it requires consideration of varying factors. For example, if you use AWS, you may prefer Amazon SageMaker as an MLOps platform that integrates with other AWS services.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

AWS Machine Learning Blog

NOVEMBER 1, 2023

Organizations can search for PII using methods such as keyword searches, pattern matching, data loss prevention tools, machine learning (ML), metadata analysis, data classification software, optical character recognition (OCR), document fingerprinting, and encryption.

AWS 82

AWS Machine Learning Machine Learning Clustering 82

AWS Machine Learning Blog

DECEMBER 5, 2023

AWS is especially well suited to provide enterprises the tools necessary for deploying LLMs at scale to enable critical decision-making. In their implementation of generative AI technology, enterprises have real concerns about data exposure and ownership of confidential information that may be sent to LLMs.

AI 90

AI AI AWS ML 90

AWS Machine Learning Blog

APRIL 5, 2024

SageMaker geospatial capabilities make it straightforward for data scientists and machine learning (ML) engineers to build, train, and deploy models using geospatial data. Janosch Woschitz is a Senior Solutions Architect at AWS, specializing in AI/ML. Outside work, he is a travel enthusiast.

Clustering 97

Clustering ML ML AWS 97

AWS Machine Learning Blog

APRIL 12, 2023

In this post, we describe how AWS Partner Airis Solutions used Amazon Lookout for Equipment , AWS Internet of Things (IoT) services, and CloudRail sensor technologies to provide a state-of-the-art solution to address these challenges. It’s an easy way to run analytics on IoT data to gain accurate insights.

AWS 76

AWS ML ML Machine Learning 76

The MLOps Blog

MARCH 15, 2023

Based on the McKinsey survey , 56% of orgs today are using machine learning in at least one business function. This article is a real-life study of building a CI/CD MLOps pipeline. AWS provides several tools to create and manage ML model deployments. An example would be AWS recognition. S3 buckets.

AWS 52

AWS ETL ML ML 52

Flipboard

NOVEMBER 24, 2023

In this post, we show you how SnapLogic , an AWS customer, used Amazon Bedrock to power their SnapGPT product through automated creation of these complex DSL artifacts from human language. SnapLogic background SnapLogic is an AWS customer on a mission to bring enterprise automation to the world.

Database 112

Database AWS ETL SQL 112

Smart Data Collective

SEPTEMBER 8, 2021

A lot of Open-Source ETL tools house a graphical interface for executing and designing Data Pipelines. It can be used to manipulate, store, and analyze data of any structure. It generates Java code for the Data Pipelines instead of running Pipeline configurations through an ETL Engine.

ETL 93

ETL Hadoop Data Warehouse Data Pipeline 93

Precisely

JANUARY 18, 2024

With the emergence of cloud hyperscalers like AWS, Google, and Microsoft, the shift to the cloud has accelerated significantly. Instead of performing major surgery on their critical business systems, enterprises are opting for real-time data integration built around inherently reliable and scalable change data capture (CDC) technology.

AWS 52

AWS Artificial Intelligence Artificial Intelligence Cloud Computing 52

ODSC - Open Data Science

FEBRUARY 2, 2023

Just as a writer needs to know core skills like sentence structure, grammar, and so on, data scientists at all levels should know core data science skills like programming, computer science, algorithms, and so on. Scikit-learn also earns a top spot thanks to its success with predictive analytics and general machine learning.

Data Science 98

Data Science Data Scientist Computer Science Computer Science 98

phData

JANUARY 31, 2024

We’ll cover how to get the data via the Snowflake Marketplace, how to apply machine learning with Snowpark , and then bring it all together to create an automated ML model to forecast energy prices. Python has long been the favorite programming language of data scientists.

Machine Learning 52

Machine Learning Machine Learning Python Data Scientist 52

The MLOps Blog

JANUARY 23, 2023

Data versioning control is an important concept in machine learning, as it allows for the tracking and management of changes to data over time. As data is the foundation of any machine learning project, it is essential to have a system in place for tracking and managing changes to data over time.

ML 52

ML ML Data Lakes Machine Learning 52