Hacker News

JUNE 29, 2025

reply egypturnash 21 minutes ago | prev | next [–] Figuring out the plot and character designs for the next chapter of my graphic novel about a utopia run by AIs who have found that taking the form of unctuous, glazing clowns is the best way to get humans to behave in ways that fulfil the AI's reward functions. Name is pending.

AI 78

AI AI Database Python 78

AWS Machine Learning Blog

APRIL 22, 2024

Amazon SageMaker HyperPod is purpose-built to accelerate foundation model (FM) training, removing the undifferentiated heavy lifting involved in managing and optimizing a large training compute cluster. In this solution, HyperPod cluster instances use the LDAPS protocol to connect to the AWS Managed Microsoft AD via an NLB.

Clustering 121

Clustering AWS Machine Learning Machine Learning 121

AWS Machine Learning Blog

JULY 9, 2025

It’s happening today in our customers’ AI production environments. The scale of the AI systems that our customers are building today—across drug discovery, enterprise search, software development, and more—is truly remarkable. P6e-GB200 UltraServers are designed for training and deploying the largest, most sophisticated AI models.

AWS 142

AWS AI AI Clustering 142

AWS Machine Learning Blog

JULY 17, 2023

In this post, we walk through step-by-step instructions to establish a cross-account connection to any Amazon Redshift node type (RA3, DC2, DS2) by connecting the Amazon Redshift cluster located in one AWS account to SageMaker Studio in another AWS account in the same Region using VPC peering.

Clustering 96

Clustering AWS ML ML 96

AWS Machine Learning Blog

SEPTEMBER 3, 2024

From deriving insights to powering generative artificial intelligence (AI) -driven applications, the ability to efficiently process and analyze large datasets is a vital capability. This same interface is also used for provisioning EMR clusters. The following diagram illustrates this solution.

AWS 117

AWS Clustering Big Data Big Data 117

AWS Machine Learning Blog

JUNE 6, 2025

Organizations building or adopting generative AI use GPUs to run simulations, run inference (both for internal or external usage), build agentic workloads, and run data scientists’ experiments. Account A hosts the SageMaker HyperPod cluster. They are also highly adaptable to many different use cases.

Clustering 77

Clustering AWS Data Scientist ML 77

O'Reilly Media

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” A basic, production-ready cluster priced out to the low-six-figures.

Hadoop 135

Hadoop Algorithm ML ML 135

Flipboard

AUGUST 17, 2023

Here we use RedshiftDatasetDefinition to retrieve the dataset from the Redshift cluster. In the processing job API, provide this path to the parameter of submit_jars to the node of the Spark cluster that the processing job creates. We attached the IAM role to the Redshift cluster that we created earlier.

ML 123

ML ML AWS Data Warehouse 123

Mlearning.ai

APRIL 8, 2023

What is Natural Language Processing (NLP) Natural Language Processing (NLP) is a subfield of artificial intelligence (AI) that deals with interactions between computers and human languages. Additionally, Papers published by NVIDIA AI on efficiently pre-training models has really helped push the boundaries of efficiency and speed.

Natural Language Processing 98

Natural Language Processing Algorithm Machine Learning Machine Learning 98

AWS Machine Learning Blog

AUGUST 22, 2023

Usually, if the dataset or model is too large to be trained on a single instance, distributed training allows for multiple instances within a cluster to be used and distribute either data or model partitions across those instances during the training process. Each account or Region has its own training instances.

Machine Learning 98

Machine Learning Machine Learning AWS ML 98

AWS Machine Learning Blog

SEPTEMBER 11, 2024

And finally, some activities, such as those involved with the latest advances in artificial intelligence (AI), are simply not practically possible, without hardware acceleration. The following figure illustrates the idea of a large cluster of GPUs being used for learning, followed by a smaller number for inference.

AWS 113

AWS ML ML Clustering 113

AWS Machine Learning Blog

MARCH 15, 2023

Cluster resources are provisioned for the duration of your job, and cleaned up when a job is complete. Shyam Namavaram is a senior artificial intelligence (AI) and machine learning (ML) specialist solutions architect at Amazon Web Services (AWS). He specializes in AI and ML, containers, and analytics technologies.

Machine Learning 144

Machine Learning Machine Learning AWS Data Scientist 144

AWS Machine Learning Blog

MAY 10, 2023

In addition to the IAM user and assumed role session scheduling the job, you also need to provide a role for the notebook job instance to assume for access to your data in Amazon Simple Storage Service (Amazon S3) or to connect to Amazon EMR clusters as needed. Durga Sury is an ML Solutions Architect on the Amazon SageMaker Service SA team.

AWS 100

AWS Data Scientist ML ML 100

AWS Machine Learning Blog

APRIL 16, 2024

To learn more about SageMaker Studio JupyterLab Spaces, refer to Boost productivity on Amazon SageMaker Studio: Introducing JupyterLab Spaces and generative AI tools. For Secret type , choose Credentials for Amazon Redshift cluster. Choose the Redshift cluster associated with the secrets. or later image versions.

SQL 126

SQL AWS Database Data Scientist 126

Google Research AI blog

DECEMBER 8, 2022

Posted by Alexis Morvan and Trond Andersen, Research Scientists, Google Quantum AI When quantum computers were first proposed, they were hoped to be a way to better understand the quantum world. A group of photons initially clustered on neighboring sites will evolve into a superposition of all possible paths each photon might have taken.

Clustering 52

Clustering AI AI 52

Hacker News

JANUARY 9, 2024

By the way, in modern times we need to explain the Wolfram Language not just to humans, but also to AIs—and our very extensive documentation and examples have proved extremely valuable in training LLMs to use the Wolfram Language. For now it was not only humans who’d need the tools we’d built; it was also AIs. of “ Chat Notebooks ”.

Python 182

Python Algorithm Machine Learning Machine Learning 182

DrivenData Labs

MAY 1, 2025

The final sub-models use broad semantic clustering, an ensemble of the provided acoustic features, a Whisper classification fine-tune, and a contrastive Whisper fine-tune, designed to focus the model on identifying features independent of age, gender, and semantic group. Cluster 0 was in English and included many people talking to an Alexa.

Decision Trees 147

Decision Trees Clustering Algorithm Machine Learning 147

Hacker News

MARCH 20, 2023

He used a suite of professional AI tools to create a lifelike reconstruction of the Somerton Man. In 2012, with the permission of the police, Janette used a magnifying glass to find where several hairs came together in a cluster. Interestingly, the AI reconstruction had best captured his likeness. police sketch artist.

Database 182

Database Clustering AI AI 182

AWS Machine Learning Blog

JULY 15, 2025

Amazon Bedrock Knowledge Bases has extended its vector store options by enabling support for Amazon OpenSearch Service managed clusters, further strengthening its capabilities as a fully managed Retrieval Augmented Generation (RAG) solution. Why use OpenSearch Service Managed Cluster as a vector store?

Clustering 17

Clustering AWS K-nearest Neighbors Database 17

AWS Machine Learning Blog

OCTOBER 11, 2024

Customers across all industries are experimenting with generative AI to accelerate and improve business outcomes. They contribute to the effectiveness and feasibility of generative AI applications across various domains.

Database 106

Database AWS Clustering Data Lakes 106