Flipboard

NOVEMBER 17, 2023

Amazon SageMaker enables enterprises to build, train, and deploy machine learning (ML) models. Amazon SageMaker JumpStart provides pre-trained models and data to help you get started with ML. Set up a MongoDB cluster To create a free tier MongoDB Atlas cluster, follow the instructions in Create a Cluster.

K-nearest Neighbors 169

K-nearest Neighbors AWS Clustering Database 169

AWS Machine Learning Blog

SEPTEMBER 18, 2024

The ZMP analyzes billions of structured and unstructured data points to predict consumer intent by using sophisticated artificial intelligence (AI) to personalize experiences at scale. Hosted on Amazon ECS with tasks run on Fargate, this platform streamlines the end-to-end ML workflow, from data ingestion to model deployment.

AWS 123

AWS Machine Learning Machine Learning ML 123

AWS Machine Learning Blog

SEPTEMBER 3, 2024

With the introduction of EMR Serverless support for Apache Livy endpoints , SageMaker Studio users can now seamlessly integrate their Jupyter notebooks running sparkmagic kernels with the powerful data processing capabilities of EMR Serverless. This same interface is also used for provisioning EMR clusters.

AWS 120

AWS Clustering Big Data Big Data 120

AWS Machine Learning Blog

APRIL 18, 2025

Amazon MSK is a streaming data service that manages Apache Kafka infrastructure and operations, making it straightforward to run Apache Kafka applications on Amazon Web Services (AWS). Configure the architecture To try this architecture, deploy the AWS CloudFormation template from this GitHub repository in your AWS account.

Apache Kafka 96

Apache Kafka AWS Clustering Database 96

AWS Machine Learning Blog

AUGUST 15, 2024

With over 50 connectors, an intuitive Chat for data prep interface, and petabyte support, SageMaker Canvas provides a scalable, low-code/no-code (LCNC) ML solution for handling real-world, enterprise use cases. Organizations often struggle to extract meaningful insights and value from their ever-growing volume of data.

ML 127

ML ML Data Preparation AWS 127

AWS Machine Learning Blog

SEPTEMBER 19, 2023

Amazon SageMaker Feature Store provides an end-to-end solution to automate feature engineering for machine learning (ML). For many ML use cases, raw data like log files, sensor readings, or transaction records need to be transformed into meaningful features that are optimized for model training. SageMaker Studio set up.

ML 127

ML ML AWS SQL 127

AWS Machine Learning Blog

DECEMBER 13, 2024

Amazon SageMaker HyperPod is designed to support large-scale machine learning (ML) operations, providing a robust environment for training foundation models (FMs) over extended periods. This blog post specifically applies to HyperPod clusters using Slurm as the orchestrator.

Clustering 101

Clustering AWS ML ML 101

AWS Machine Learning Blog

MARCH 25, 2025

As organizations increasingly deploy foundation models (FMs) and other machine learning (ML) models to production, they face challenges related to resource utilization, cost-efficiency, and maintaining high availability during updates. The minimum AWS service quota value for ml.g5.12xlarge is ROUNDUP(2 x 1 / 4) + 8 = 9.

AI 112

AI AI AWS ML 112

AWS Machine Learning Blog

APRIL 5, 2024

SageMaker geospatial capabilities make it straightforward for data scientists and machine learning (ML) engineers to build, train, and deploy models using geospatial data. Now, with the specialized geospatial container in SageMaker, managing and running clusters for geospatial processing has become more straightforward.

Clustering 135

Clustering ML ML AWS 135

AWS Machine Learning Blog

AUGUST 8, 2023

You can run Spark applications interactively from Amazon SageMaker Studio by connecting SageMaker Studio notebooks and AWS Glue Interactive Sessions to run Spark jobs with a serverless cluster. With interactive sessions, you can choose Apache Spark or Ray to easily process large datasets, without worrying about cluster management.

AWS 97

AWS Clustering Machine Learning Machine Learning 97

AWS Machine Learning Blog

DECEMBER 15, 2023

We are excited to announce the launch of Amazon DocumentDB (with MongoDB compatibility) integration with Amazon SageMaker Canvas , allowing Amazon DocumentDB customers to build and use generative AI and machine learning (ML) solutions without writing code. On the Import data page, for Data Source , choose DocumentDB and Add Connection.

Machine Learning 123

Machine Learning Machine Learning AWS ML 123

AWS Machine Learning Blog

DECEMBER 18, 2023

By using these capabilities, businesses can efficiently store, manage, and analyze time-series data, enabling data-driven decisions and gaining a competitive edge. If you need an automated workflow or direct ML model integration into apps, Canvas forecasting functions are accessible through APIs. Note we have two folders.

Clustering 123

Clustering AWS Database ML 123

AWS Machine Learning Blog

OCTOBER 9, 2024

Amazon Lookout for Metrics is a fully managed service that uses machine learning (ML) to detect anomalies in virtually any time-series business or operational metrics—such as revenue performance, purchase transactions, and customer acquisition and retention rates—with no ML experience required. To learn more, see the documentation.

AWS 96

AWS ML ML Data Quality 96

AWS Machine Learning Blog

MARCH 10, 2023

Amazon SageMaker Data Wrangler reduces the time it takes to aggregate and prepare data for machine learning (ML) from weeks to minutes in Amazon SageMaker Studio. Starting today, you can connect to Amazon EMR Hive as a big data query engine to bring in large datasets for ML.

Clustering 101

Clustering AWS ML ML 101

AWS Machine Learning Blog

APRIL 17, 2023

You can quickly launch the familiar RStudio IDE and dial up and down the underlying compute resources without interrupting your work, making it easy to build machine learning (ML) and analytics solutions in R at scale. Data scientists and data engineers use Apache Spark, Hive, and Presto running on Amazon EMR for large-scale data processing.

Clustering 96

Clustering AWS Machine Learning Machine Learning 96

AWS Machine Learning Blog

DECEMBER 29, 2022

You can quickly launch the familiar RStudio IDE and dial up and down the underlying compute resources without interrupting your work, making it easy to build machine learning (ML) and analytics solutions in R at scale. AWS offers tools such as RStudio on SageMaker and Amazon Redshift to help tackle these challenges. 1 Public subnet.

AWS 140

AWS Machine Learning Machine Learning Natural Language Processing 140

AWS Machine Learning Blog

FEBRUARY 13, 2024

The BigBasket team was running open source, in-house ML algorithms for computer vision object recognition to power AI-enabled checkout at their Fresho (physical) stores. Their objective was to fine-tune an existing computer vision machine learning (ML) model for SKU detection. Their starting training data size was over 1.5

AWS 133

AWS AI AI ML 133

AWS Machine Learning Blog

APRIL 19, 2023

Since 2018, our team has been developing a variety of ML models to enable betting products for NFL and NCAA football. Then we needed to Dockerize the application, write a deployment YAML file, deploy the gRPC server to our Kubernetes cluster, and make sure it’s reliable and auto scalable. The architecture of DJL is engine agnostic.

ML 98

ML ML Deep Learning Deep Learning 98

AWS Machine Learning Blog

FEBRUARY 7, 2025

This post, part of the Governing the ML lifecycle at scale series ( Part 1 , Part 2 , Part 3 ), explains how to set up and govern a multi-account ML platform that addresses these challenges. An enterprise might have the following roles involved in the ML lifecycles. This ML platform provides several key benefits.

ML 65

ML ML Data Scientist AWS 65

AWS Machine Learning Blog

MAY 3, 2023

For any machine learning (ML) problem, the data scientist begins by working with data. This includes gathering, exploring, and understanding the business and technical aspects of the data, along with evaluation of any manipulations that may be needed for the model building process.

AWS 106

AWS Machine Learning Machine Learning ML 106

AWS Machine Learning Blog

JUNE 21, 2024

To accomplish this, eSentire built AI Investigator, a natural language query tool for their customers to access security platform data by using AWS generative artificial intelligence (AI) capabilities. eSentire has over 2 TB of signal data stored in their Amazon Simple Storage Service (Amazon S3) data lake.

AWS 128

AWS AI AI Natural Language Processing 128

AWS Machine Learning Blog

MAY 16, 2024

The main AWS services used are SageMaker, Amazon EMR , AWS CodeBuild , Amazon Simple Storage Service (Amazon S3), Amazon EventBridge , AWS Lambda , and Amazon API Gateway. When the preprocessing batch was complete, the training/test data needed for training was partitioned based on runtime and stored in Amazon S3.

AWS 128

AWS ML ML Deep Learning 128

AWS Machine Learning Blog

NOVEMBER 1, 2023

Organizations can search for PII using methods such as keyword searches, pattern matching, data loss prevention tools, machine learning (ML), metadata analysis, data classification software, optical character recognition (OCR), document fingerprinting, and encryption.

AWS 123

AWS Machine Learning Machine Learning ML 123

ODSC - Open Data Science

MARCH 27, 2023

Botnets Detection at Scale — Lesson Learned from Clustering Billions of Web Attacks into Botnets. ML Governance: A Lean Approach Ryan Dawson | Principal Data Engineer | Thoughtworks Meissane Chami | Senior ML Engineer | Thoughtworks During this session, you’ll discuss the day-to-day realities of ML Governance.

Machine Learning 98

Machine Learning Machine Learning ML ML 98

ODSC - Open Data Science

APRIL 24, 2023

Botnet Detection at Scale — Lessons Learned From Clustering Billions of Web Attacks Into Botnets Editor’s note: Ori Nakar is a speaker for ODSC Europe this June. Be sure to check out his talk, “ Botnet detection at scale — Lesson learned from clustering billions of web attacks into botnets ,” there!

Clustering 52

Clustering SQL Algorithm Data Science 52

ODSC - Open Data Science

FEBRUARY 17, 2023

Cloud Computing, APIs, and Data Engineering NLP experts don’t go straight into conducting sentiment analysis on their personal laptops. TensorFlow is desired for its flexibility for ML and neural networks, PyTorch for its ease of use and innate design for NLP, and scikit-learn for classification and clustering.

Data Science 111

Data Science Deep Learning Deep Learning Natural Language Processing 111

The MLOps Blog

JUNE 27, 2023

For example, if you use AWS, you may prefer Amazon SageMaker as an MLOps platform that integrates with other AWS services. Knowledge and skills in the organization Evaluate the level of expertise and experience of your ML team and choose a tool that matches their skill set and learning curve.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

AWS Machine Learning Blog

AUGUST 14, 2024

We use an example of an illustrative ServiceNow platform to discuss technical topics related to AWS services. When preparing to connect Amazon Q Business applications to AWS IAM Identity Center , you need to enable ACL indexing and identity crawling and re-synchronize your connector. John has access to all ServiceNow document types.

AWS 122

AWS AI AI Clustering 122

AWS Machine Learning Blog

MAY 15, 2023

Getir used Amazon Forecast , a fully managed service that uses machine learning (ML) algorithms to deliver highly accurate time series forecasts, to increase revenue by four percent and reduce waste cost by 50 percent. Mutlu Polatcan is a Staff Data Engineer at Getir, specializing in designing and building cloud-native data platforms.

Algorithm 100

Algorithm Data Scientist Machine Learning Machine Learning 100

AWS Machine Learning Blog

FEBRUARY 10, 2023

Through a collaboration between the Next Gen Stats team and the Amazon ML Solutions Lab , we have developed the machine learning (ML)-powered stat of coverage classification that accurately identifies the defense coverage scheme based on the player tracking data.

ML 99

ML ML Machine Learning Machine Learning 99

ODSC - Open Data Science

AUGUST 15, 2023

Build Classification and Regression Models with Spark on AWS Suman Debnath | Principal Developer Advocate, Data Engineering | Amazon Web Services This immersive session will cover optimizing PySpark and best practices for Spark MLlib.

Data Science 52

Data Science Machine Learning Machine Learning Data Scientist 52

The MLOps Blog

MARCH 21, 2023

From gathering and processing data to building models through experiments, deploying the best ones, and managing them at scale for continuous value in production—it’s a lot. As the number of ML-powered apps and services grows, it gets overwhelming for data scientists and ML engineers to build and deploy models at scale.

Machine Learning 69

Machine Learning Machine Learning Data Scientist ML 69

DagsHub

OCTOBER 23, 2024

Managing unstructured data is essential for the success of machine learning (ML) projects. Without structure, data is difficult to analyze and extracting meaningful insights and patterns is challenging. This article will discuss managing unstructured data for AI and ML projects. What is Unstructured Data?

Machine Learning 52

Machine Learning Machine Learning Data Lakes AI 52

ODSC - Open Data Science

JANUARY 7, 2025

Theyre looking for people who know all related skills, and have studied computer science and software engineering. As MLOps become more relevant to ML demand for strong software architecture skills will increase aswell. Environments Data science environments encompass the tools and platforms where professionals perform their work.

Data Scientist 40

Data Scientist Data Science Machine Learning Machine Learning 40

Pickl AI

MAY 15, 2024

Strategies for Overcoming Challenges Now that we understand the hurdles, let’s explore strategies to overcome them and successfully scale Data Science projects. Embrace Distributed Processing Frameworks Frameworks like Apache Spark and Spark Streaming enable distributed processing of large datasets across clusters of machines.

Data Analyst 52

Data Analyst Data Scientist Data Science Machine Learning 52

ODSC - Open Data Science

JANUARY 29, 2024

These outputs, stored in vector databases like Weaviate, allow Prompt Enginers to directly access these embeddings for tasks like semantic search, similarity analysis, or clustering. This versatility allows prompt engineers to adapt it to different projects and needs.

Data Science 52

Data Science Machine Learning Machine Learning Natural Language Processing 52

Hacker News

JULY 1, 2025

Prior to that, I spent a couple years at First Orion - a smaller data company - helping found & build out a data engineering team as one of the first engineers. We were focused on building data pipelines and models to protect our users from malicious phonecalls.

Python 56

Python AWS SQL ML 56