Flipboard

NOVEMBER 21, 2023

Graph database company Neo4j Inc. said today it’s embarking on a multiyear strategic collaboration with the cloud computing giant Amazon Web Services …

Database 149

Database Cloud Computing AWS AI 149

AWS Machine Learning Blog

DECEMBER 4, 2024

SageMaker Unified Studio combines various AWS services, including Amazon Bedrock , Amazon SageMaker , Amazon Redshift , Amazon Glue , Amazon Athena , and Amazon Managed Workflows for Apache Airflow (MWAA) , into a comprehensive data and AI development platform. Navigate to the AWS Secrets Manager console and find the secret -api-keys.

AWS 110

AWS AI AI SQL 110

AWS Machine Learning Blog

OCTOBER 30, 2023

Amazon Bedrock is a fully managed service provided by AWS that offers developers access to foundation models (FMs) and the tools to customize them for specific applications. The workflow steps are as follows: AWS Lambda running in your private VPC subnet receives the prompt request from the generative AI application.

AWS 143

AWS ML ML Computer Science 143

AWS Machine Learning Blog

OCTOBER 23, 2024

Agent Creator is a versatile extension to the SnapLogic platform that is compatible with modern databases, APIs, and even legacy mainframe systems, fostering seamless integration across various data environments. Pre-built templates tailored to various use cases are included, significantly enhancing both employee and customer experiences.

AI 95

AI AI Database AWS 95

Flipboard

NOVEMBER 27, 2023

Amazon AWS, the cloud computing giant, has been perceived as playing catch-up with its rivals Microsoft Azure and Google Cloud in the emerging and exciting field of generative AI. But this week, at its annual AWS Re:Invent conference, Amazon plans to showcase its ambitious vision for generative AI, …

AWS 167

AWS Cloud Computing Azure AI 167

AWS Machine Learning Blog

SEPTEMBER 19, 2023

Technical challenges with multi-modal data further include the complexity of integrating and modeling different data types, the difficulty of combining data from multiple modalities (text, images, audio, video), and the need for advanced computer science skills and sophisticated analysis tools.

AWS 137

AWS AI AI ML 137

Flipboard

MAY 15, 2025

The content and opinions in this post are those of the third-party author and AWS is not responsible for the content or accuracy of this post. It uses managed AWS services like SageMaker and Amazon Bedrock to enable the entire ML lifecycle. This post is co-authored by Jay Kshirsagar and Ronald Quan from Qualtrics.

ML 132

ML ML AI AI 132

AWS Machine Learning Blog

OCTOBER 23, 2024

By automating document ingestion, chunking, and embedding, it eliminates the need to manually set up complex vector databases or custom retrieval systems, significantly reducing development complexity and time. The solution’s scalability quickly accommodates growing data volumes and user queries thanks to AWS serverless offerings.

AWS 98

AWS Natural Language Processing AI AI 98

AWS Machine Learning Blog

SEPTEMBER 15, 2023

Often, LLMs need to interact with other software, databases, or APIs to accomplish complex tasks. In this post, we introduce LLM agents and demonstrate how to build and deploy an e-commerce LLM agent using Amazon SageMaker JumpStart and AWS Lambda. Next, we show how to implement a simple agent loop using AWS services.

AWS 134

AWS Database Python Computer Science 134

AWS Machine Learning Blog

JANUARY 13, 2023

In this two-part series, we demonstrate how you can deploy a cloud-based FL framework on AWS. In the second post , we present the use cases and dataset to show its effectiveness in analyzing real-world healthcare datasets, such as the eICU data , which comprises a multi-center critical care database collected from over 200 hospitals.

AWS 106

AWS Analytics Analytics Machine Learning 106

Flipboard

NOVEMBER 24, 2023

In this post, we show you how SnapLogic , an AWS customer, used Amazon Bedrock to power their SnapGPT product through automated creation of these complex DSL artifacts from human language. SnapLogic background SnapLogic is an AWS customer on a mission to bring enterprise automation to the world.

Database 159

Database AWS ETL SQL 159

PyImageSearch

MAY 19, 2025

run_opensearch.sh Running OpenSearch Locally A script to start OpenSearch using Docker for local testing before deploying to AWS. Register the Sentence Transformer model in AWS OpenSearch: AWS users must ensure that OpenSearch can access the model before indexing. These can be used for evaluation and comparison.

K-nearest Neighbors 91

K-nearest Neighbors AWS Deep Learning Deep Learning 91

AWS Machine Learning Blog

JANUARY 13, 2023

To mitigate these challenges, we propose a federated learning (FL) framework, based on open-source FedML on AWS, which enables analyzing sensitive HCLS data. In this two-part series, we demonstrate how you can deploy a cloud-based FL framework on AWS. In the first post , we described FL concepts and the FedML framework.

AWS 102

AWS Analytics Analytics Machine Learning 102

AWS Machine Learning Blog

NOVEMBER 22, 2023

Building a production-ready solution in AWS involves a series of trade-offs between resources, time, customer expectation, and business outcome. The AWS Well-Architected Framework helps you understand the benefits and risks of decisions you make while building workloads on AWS.

AWS 121

AWS ML ML Machine Learning 121

AWS Machine Learning Blog

JUNE 25, 2024

The customer review analysis workflow consists of the following steps: A user uploads a file to dedicated data repository within your Amazon Simple Storage Service (Amazon S3) data lake, invoking the processing using AWS Step Functions. In the first step, an AWS Lambda function reads and validates the file, and extracts the raw data.

AWS 131

AWS Natural Language Processing Machine Learning Machine Learning 131

AWS Machine Learning Blog

NOVEMBER 7, 2023

Instead of relying solely on their pre-trained knowledge, RAG allows models to pull data from documents, databases, and more. This means that as new data becomes available, it can be added to the retrieval database without needing to retrain the entire model. Prerequisites You must have the following prerequisites: An AWS account.

AWS 125

AWS AI AI Database 125

Flipboard

FEBRUARY 7, 2025

This post shows you how to set up RAG using DeepSeek-R1 on Amazon SageMaker with an OpenSearch Service vector database as the knowledge base. You will execute scripts to create an AWS Identity and Access Management (IAM) role for invoking SageMaker, and a role for your user to create a connector to SageMaker.

Database 87

Database AWS Python ML 87

AWS Machine Learning Blog

AUGUST 30, 2024

With the rapid growth of generative artificial intelligence (AI), many AWS customers are looking to take advantage of publicly available foundation models (FMs) and technologies. This democratizes access to generative AI and improves efficiency in writing complex queries without needing to learn SQL or understand complex database schemas.

SQL 96

SQL AWS Database AI 96

AWS Machine Learning Blog

JUNE 26, 2024

This post is a follow-up to Generative AI and multi-modal agents in AWS: The key to unlocking new value in financial markets. Action groups – Action groups are interfaces that an agent uses to interact with the different underlying components such as APIs and databases.

AWS 139

AWS AI AI Database 139

AWS Machine Learning Blog

OCTOBER 15, 2024

Despite the existence of AWS Application Discovery Service or the presence of some form of configuration management database (CMDB), customers still face many challenges. Customization and adaptability : Action groups allow users to customize migration workflows to suit specific AWS environments and requirements.

AWS 98

AWS Database AI AI 98

AWS Machine Learning Blog

OCTOBER 8, 2024

Our solution provides practical guidance on addressing this challenge by using a generative AI assistant on AWS. The approach uses Retrieval Augmented Generation (RAG) , which combines text generation capabilities with database querying to provide contextually relevant responses to customer inquiries.

AWS 125

AWS Database Machine Learning Machine Learning 125

Flipboard

DECEMBER 13, 2024

This content is then transformed into a vector database optimized for efficient information retrieval. In the RAG pipeline, the retriever taps into this vector database to surface relevant information, and the LLM generates tailored responses to Twitch user queries submitted through a Slack assistant.

AWS 139

AWS Database AI AI 139

AWS Machine Learning Blog

AUGUST 9, 2024

This post provides an overview of a custom solution developed by the AWS Generative AI Innovation Center (GenAIIC) for Deltek , a globally recognized standard for project-based businesses in both government contracting and professional services. It uses a vector database structure to efficiently store and query large volumes of data.

AWS 135

AWS Database AI AI 135

Flipboard

AUGUST 17, 2023

Amazon Redshift uses SQL to analyze structured and semi-structured data across data warehouses, operational databases, and data lakes, using AWS-designed hardware and ML to deliver the best price-performance at any scale. Prerequisites To continue with the examples in this post, you need to create the required AWS resources.

ML 123

ML ML AWS Data Warehouse 123

AWS Machine Learning Blog

JANUARY 21, 2025

In this post, we show you how Amazon Web Services (AWS) helps in solving forecasting challenges by customizing machine learning (ML) models for forecasting. In this post, we access Amazon SageMaker Canvas through the AWS console. About the Authors Aditya Pendyala is a Principal Solutions Architect at AWS based out of NYC.

ML 103

ML ML Algorithm AWS 103

AWS Machine Learning Blog

SEPTEMBER 12, 2024

The application sends the user query to the vector database to find similar documents. The QnA application submits a request to the SageMaker JumpStart model endpoint with the user query and context returned from the vector database. Basic familiarity with SageMaker and AWS services that support LLMs.

AWS 137

AWS ML ML AI 137

AWS Machine Learning Blog

SEPTEMBER 14, 2023

This post takes you through the most common challenges that customers face when searching internal documents, and gives you concrete guidance on how AWS services can be used to create a generative AI conversational bot that makes internal information more useful. The web application front-end is hosted on AWS Amplify.

AWS 129

AWS AI AI Data Silos 129

AWS Machine Learning Blog

AUGUST 14, 2023

The final retrieval augmentation workflow covers the following high-level steps: The user query is used for a retriever component, which does a vector search, to retrieve the most relevant context from our database. A vector database provides efficient vector similarity search by providing specialized indexes like k-NN indexes.

AWS 98

AWS Database AI AI 98

AWS Machine Learning Blog

MAY 3, 2023

Moreover, as of November 2022, Studio supports shared spaces to accelerate real-time collaboration and multiple Amazon SageMaker domains in a single AWS Region for each account. First, we demonstrate how to perform backup and recovery if you create a new Studio domain, user, and space profiles using AWS CloudFormation templates.

AWS 93

AWS Data Scientist Machine Learning Machine Learning 93

AWS Machine Learning Blog

NOVEMBER 29, 2023

Browse to locate loan dataset from the Snowflake database Select the two loans datasets by dragging and dropping them from the left side of the screen to the right. For more information on how to accelerate your journeys from data to business insights, see SageMaker Canvas immersion day and AWS user guide. Product Manager at AWS.

Data Preparation 130

Data Preparation ML ML Data Quality 130

Data Science Dojo

JULY 3, 2024

Big Data Technologies : Handling and processing large datasets using tools like Hadoop, Spark, and cloud platforms such as AWS and Google Cloud. Databases and SQL : Managing and querying relational databases using SQL, as well as working with NoSQL databases like MongoDB.

Data Science 150

Data Science Machine Learning Machine Learning Data Visualization 150

AWS Machine Learning Blog

JANUARY 20, 2023

In this post, we discuss how CCC Intelligent Solutions (CCC) combined Amazon SageMaker with other AWS services to create a custom solution capable of hosting the types of complex artificial intelligence (AI) models envisioned. Step-by-step solution Step 1 A client makes a request to the AWS API Gateway endpoint.

AWS 96

AWS AI AI Computer Science 96

AWS Machine Learning Blog

SEPTEMBER 11, 2024

Examples of other PBAs now available include AWS Inferentia and AWS Trainium , Google TPU, and Graphcore IPU. Around this time, industry observers reported NVIDIA’s strategy pivoting from its traditional gaming and graphics focus to moving into scientific computing and data analytics.

AWS 121

AWS ML ML Clustering 121

Pickl AI

APRIL 21, 2025

Data Science extracts insights and builds predictive models from processed data. Big Data technologies include Hadoop, Spark, and NoSQL databases. Data Science uses Python, R, and machine learning frameworks. This might involve querying databases, scraping websites, accessing APIs, or using existing datasets.

Big Data 52

Big Data Big Data Data Science Machine Learning 52

AWS Machine Learning Blog

SEPTEMBER 28, 2023

In this post, we define what a Generative AI Gateway is, its benefits, and how to architect one on AWS. AWS services can help in building a model abstraction layer (MAL) as follows: The generative AI manager creates a registry table using Amazon DynamoDB. Finally, a retroactive audit is available through AWS CloudTrail.

AI 125

AI AI AWS ML 125

AWS Machine Learning Blog

MAY 21, 2024

Solution architecture The mmRAG solution is based on a straightforward concept: to extract different data types separately, you generate text summarization using a VLM from different data types, embed text summaries along with raw data accordingly to a vector database, and store raw unstructured data in a document store.

ML 139

ML ML Database Natural Language Processing 139

AWS Machine Learning Blog

JUNE 29, 2023

Automatically deriving context is achieved through Amazon CloudFront headers that are included in requests such as a REST API in Amazon API Gateway that calls an AWS Lambda function to retrieve recommendations. We provide a AWS CloudFormation template to create the necessary resources.

AWS 96

AWS ML ML Computer Science 96