Machine Learning Research at Apple

MAY 5, 2024

Vision Foundation Models (VFMs) pretrained on massive datasets exhibit impressive performance on various downstream tasks, especially with limited labeled target data. However, due to their high inference compute cost, these models cannot be deployed for many real-world applications.

130

130

KDnuggets

MAY 23, 2023

Foundation models represent a significant advancement in AI, enabling versatile and high-performing models that can be applied across various domains, such as NLP, computer vision, and multimodal tasks.

AI 261

AI AI Machine Learning Machine Learning 261

Hacker News

MARCH 25, 2024

TL;DR: Moirai is a cutting-edge time series foundation model, offering universal forecasting capabilities. It stands out as a versatile time series forecasting model capable of addressing diverse forecasting tasks across multiple domains, frequencies, and variables in a zero-shot manner.

176

176

Hacker News

MARCH 3, 2024

Introducing Evo, a biological foundation model that generalizes across the fundamental languages of biology: DNA, RNA and proteins. Evo is capable of both prediction tasks, and generative design from molecular to whole genome scale.

181

181

databricks

MAY 3, 2024

Moving generative AI applications from the proof of concept stage into production requires control, reliability and data governance. Organizations are turning to open.

Data Governance 300

Data Governance AI AI 300

Hacker News

MAY 7, 2024

Granite Code Models: A Family of Open Foundation Models for Code Intelligence - ibm-granite/granite-code-models

139

139

Towards AI

JANUARY 10, 2024

Everybody is talking about ChatGPT, BARD, and Large Language Models (LLMs). By fundamentals, I mean to understand the whole landscape of Generative AI, which is not just a synonym for Large Language Models (LLMs). Here, we are focused on data and models. These models are called foundational models or generative models.

Machine Learning 101

Machine Learning Machine Learning Exploratory Data Analysis Supervised Learning 101

Snorkel AI

JUNE 12, 2023

In 2007, Google researchers published a paper on a class of statistical language models they dubbed “large language models”, which they reported as achieving a new state of the art in performance. They used a very standard model and a decoding algorithm so simple they named it “Stupid Backoff” 1. The key differentiator?

AI 145

AI AI Algorithm Azure 145

Snorkel AI

JUNE 12, 2023

In 2007, Google researchers published a paper on a class of statistical language models they dubbed “large language models”, which they reported as achieving a new state of the art in performance. They used a very standard model and a decoding algorithm so simple they named it “Stupid Backoff” 1. The key differentiator?

AI 141

AI AI Algorithm Azure 141

Hacker News

SEPTEMBER 7, 2023

DSPy: The framework for programming with foundation models - GitHub - stanfordnlp/dspy: DSPy: The framework for programming with foundation models

139

139

Hacker News

NOVEMBER 30, 2023

Generalist foundation models such as GPT-4 have displayed surprising capabilities in a wide variety of domains and tasks. Yet, there is a prevalent assumption that they cannot match specialist capabilities of fine-tuned models.

Machine Learning 181

Machine Learning Machine Learning 181

IBM Journey to AI blog

FEBRUARY 22, 2024

The rise of foundation models that power the growth of generative AI and other AI use cases offers exciting possibilities—yet it also raises new questions and concerns about their ethical design, development, deployment, and use. Emerging risks intrinsic to foundation models and their inherent generative capabilities.

AI 66

AI AI Analytics Analytics 66

Machine Learning Research at Apple

NOVEMBER 29, 2023

The landscape of publicly available vision foundation models (VFMs), such as CLIP and Segment Anything Model (SAM), is expanding rapidly. In this work, we introduce a simple recipe to efficiently merge VFMs into a unified model that absorbs their expertise. This paper was accepted at the UniReps Workshop at NeurIPS 2023.

113

113

IBM Journey to AI blog

MAY 1, 2023

This wave of AI is attributable to what are known as foundation models. What are foundation models? As the name suggests, foundation models can be the foundation for many kinds of AI systems. This wave of AI looks to replace the task-specific models that have dominated the landscape.

Artificial Intelligence 99

Artificial Intelligence Artificial Intelligence AI AI 99

databricks

DECEMBER 11, 2023

Following the announcements we made last week about Retrieval Augmented Generation (RAG), we're excited to announce major updates to Model Serving. Databricks Model.

275

275

Hacker News

DECEMBER 7, 2023

Audiobox is Meta’s new foundation research model for audio generation.

139

139

IBM Journey to AI blog

OCTOBER 17, 2023

Foundation models make AI more scalable by consolidating the cost and effort of model training by up to 70%. The most common use of foundation models is in natural-language processing (NLP) applications. When stitched together with an optimizer this group of models represents the overall behavior of the process.

Natural Language Processing 105

Natural Language Processing AI AI Artificial Intelligence 105

Hacker News

AUGUST 3, 2023

geospatial foundation model – built from NASA's satellite data – will now be openly available on Hugging Face. It will be the largest geospatial foundation model on Hugging Face and the first-ever open-source AI foundation model built in collaboration with NASA.

AI 123

AI AI 123

Flipboard

JUNE 13, 2023

The remarkable zero-shot learning capabilities demonstrated by large foundation models (LFMs) like ChatGPT and GPT-4 have sparked a question: Can these models autonomously supervise their behavior or other models with minimal human intervention? Therefore,

AI 175

AI AI Computer Science Computer Science 175

Snorkel AI

APRIL 30, 2024

Foundation models like CLIP are fantastic tools for classification applications, but they sometimes focus on the wrong features due to biases in their training data. The ROBOSHOT method improves the robustness of pre-trained model embeddings in a fully zero-shot fashion, without any additional fine-tuning required.

Machine Learning 59

Machine Learning Machine Learning Data Scientist AI 59

Flipboard

AUGUST 3, 2023

However, as we explained in a recent op-ed piece … The post The Economic Case for Generative AI and Foundation Models appeared first on Andreessen Horowitz. Over the years, it has also made a lot of money for the businesses able to deploy it effectively.

Computer Science 114

Computer Science Computer Science Artificial Intelligence Artificial Intelligence 114

Hacker News

DECEMBER 21, 2023

How Meta Learning might be the future for creating better foundation models

140

140

Snorkel AI

APRIL 30, 2024

Foundation models like CLIP are fantastic tools for classification applications, but they sometimes focus on the wrong features due to biases in their training data. The ROBOSHOT method improves the robustness of pre-trained model embeddings in a fully zero-shot fashion, without any additional fine-tuning required.

Machine Learning 52

Machine Learning Machine Learning Data Scientist AI 52

insideBIGDATA

AUGUST 29, 2023

In this contributed article, editorial consultant Jelani Harper takes a lok at some contemporary topics in quantum computing including quantum annealing, when the quantum computer reaches its lowest energy state.

Cloud Data 195

Cloud Data Deep Learning Deep Learning Data Science 195

IBM Journey to AI blog

FEBRUARY 29, 2024

The transition to the foundation model era signifies a substantial change in how professionals use technology to enhance their digital strategies. In essence, IBM’s comprehensive suite, centered on watsonx, aims to usher in a new era by empowering businesses to use foundation models.

Cloud Computing 54

Cloud Computing Artificial Intelligence Artificial Intelligence AI 54

MoorInsights for Forbes

AUGUST 4, 2023

Vice President of AI & Quantum Computing, Paul Smith-Goodson discusses AWS's recently announced AI capability that adds key functionality to its foundation models.

AWS 83

AWS AI AI 83

Towards AI

JANUARY 11, 2024

Models provide more coherent and consistent answers, with a progressive and significant reduction of hallucinations. Models provide more coherent and consistent answers, with a progressive and significant reduction of hallucinations. Pruning in LLMs is strikingly similar to synaptic pruning in neurodevelopment.

Artificial Intelligence 99

Artificial Intelligence Artificial Intelligence AI AI 99

Hacker News

AUGUST 5, 2023

geospatial foundation model – built from NASA's satellite data – will now be openly available on Hugging Face. It will be the largest geospatial foundation model on Hugging Face and the first-ever open-source AI foundation model built in collaboration with NASA.

AI 95

AI AI 95

Towards AI

JULY 6, 2023

NSQL is a new family of open-source large foundation models (FMs) designed specifically for SQL generation tasks Raise your hand if you have tried to use ChatGPT or any of the other LLMs to generate SQL queries. I have, and I currently am! Its name is NSQL. It has got multiple versions starting from NSQL-350M, NSQL-2B, and NSQL-6B.

SQL 85

SQL AI AI Data Science 85

Towards AI

JULY 22, 2023

With the advent of ChatGPT last year, the popularity of the Generative AI world increased with the rising of many words generating confusion, such as Foundation Models, Large Language Models, GPT-3 and GPT-4, PaLM and PaLM 2, LLaMA and LLaMA 2, Falcon, ChatGPT, Bard, Claude 2 and so on. Ok, give us some examples….

AI 87

AI AI Deep Learning Deep Learning 87

Flipboard

FEBRUARY 7, 2023

Foundation models are changing the way that artificial intelligence (AI) and machine learning (ML) are able to be used. All that power comes with a cost though, as building AI foundation models is a resource-intensive task. IBM announced today that it has built out its own AI supercomputer to serve …

Artificial Intelligence 110

Artificial Intelligence Artificial Intelligence Machine Learning Machine Learning 110

Towards AI

MAY 20, 2023

With AI on a private cloud, organizations can ensure that everything, including custom Language Models (LLMs), remains within their secure cloud environment, preserving data privacy and allowing for complete control over their proprietary models and sensitive information. which serves as the foundation for ChatGPT.

Natural Language Processing 89

Natural Language Processing Machine Learning Machine Learning Data Quality 89

IBM Journey to AI blog

JUNE 14, 2023

And then you need highly specialized, expensive and difficult to find skills to work the magic of training an AI model. But that’s all changing thanks to pre-trained, open source foundation models. Sometimes, you don’t know what data a model was trained on because the creators of those models won’t tell you.

AI 91

AI AI Natural Language Processing Data Lakes 91

NYU Center for Data Science

FEBRUARY 29, 2024

Self-supervised pre-trained foundation models are increasingly used in disease screening, promising early detection and improved patient outcomes. The heart of the issue lies in how models trained on biased datasets tend to adopt these biases, favoring spurious correlations over meaningful insights.

Supervised Learning 81

Supervised Learning AI AI Predictive Analytics 81

Flipboard

OCTOBER 24, 2023

• Foundation models in medicine hold immense potential for improving diagnostic accuracy and efficiency. • Big tech companies are investing in advanced AI …

AI 65

AI AI Computer Science Computer Science 65

Snorkel AI

JANUARY 2, 2024

Alex Ratner: I’d like to start with the term “foundation model.” We now see people using a number of different terms (large language model, foundation model, generative AI) synonymously. We now see people using a number of different terms (large language model, foundation model, generative AI) synonymously.

Machine Learning 52

Machine Learning Machine Learning Computer Science Computer Science 52