Machine Learning Research at Apple

DECEMBER 17, 2023

*= Equal Contributors Federated Learning (FL) is a technique to train models using data distributed across devices. Differential Privacy (DP) provides a formal privacy guarantee for sensitive data. Our goal is to train a large neural network language model (NNLM) on compute-constrained devices while preserving privacy using FL and DP. However, the DP-noise introduced to the model increases as the model size grows, which often prevents convergence.

162

162

Hacker News

DECEMBER 17, 2023

More than 60 percent of French speakers now live in Africa. Despite growing resentment at France, Africans are contributing to the evolution and spread of the French language.

182

182

Machine Learning Research at Apple

DECEMBER 17, 2023

With the help of creative prompt engineering and in-context learning, large language models (LLMs) are known to generalize well on a variety of text-based natural language processing (NLP) tasks. However, for performing well on spoken language understanding (SLU) tasks, LLMs either need to be equipped with in-built speech modality or they need to rely on speech-to-text conversion from an off-the-shelf automation speech recognition (ASR) system.

Natural Language Processing 162

Natural Language Processing 162

Hacker News

DECEMBER 17, 2023

Researchers at the National Ignition Facility are consistently creating reactions that make more energy than they consume. Researchers at the National Ignition Facility are consistently creating reactions that make more energy than they consume.

182

182

Advertisement

Generative AI is upending the way product developers & end-users alike are interacting with data. Despite the potential of AI, many are left with questions about the future of product development: How will AI impact my business and contribute to its success? What can product managers and developers expect in the future with the widespread adoption of AI?

AI

Machine Learning Research at Apple

DECEMBER 17, 2023

This paper was accepted at the workshop Self-Supervised Learning - Theory and Practice at NeurIPS 2023. *=Equal Contributors Understanding model uncertainty is important for many applications. We propose Bootstrap Your Own Variance (BYOV), combining Bootstrap Your Own Latent (BYOL), a negative-free Self-Supervised Learning (SSL) algorithm, with Bayes by Backprop (BBB), a Bayesian method for estimating model posteriors.

Supervised Learning 162

Supervised Learning Algorithm 162

Hacker News

DECEMBER 17, 2023

Lund University in Sweden reorganizes in the face of years of accusations against two professors. Lund University in Sweden reorganizes in the face of years of accusations against two professors.

181

181

Hacker News

DECEMBER 17, 2023

AMD continued to engage with Nvidia's claims by showing some of its results, including further optimizations, while others accounted for latency, typically the situation with servers.

181

181

Flipboard

DECEMBER 17, 2023

Researchers have taken photographs of children’s retinas and screened them using a deep learning AI algorithm to diagnose autism with 100% accuracy.

Deep Learning 181

Deep Learning Deep Learning AI AI 181

Hacker News

DECEMBER 17, 2023

AMD has a long history of vying for GPU compute market share. Ever since Nvidia got first dibs with their Tesla architecture, AMD has been playing catch up. Terascale 3 moved from VLIW5 to VLIW4 to improve execution unit utilization in compute workloads.

179

179

Flipboard

DECEMBER 17, 2023

A software company is offering a free artificial intelligence system that can help security detect weapons at schools in an effort to combat school shootings. Iterate.

Artificial Intelligence 164

Artificial Intelligence Artificial Intelligence AI AI 164

Advertisement

Many organizations today are unlocking the power of their data by using graph databases to feed downstream analytics, enahance visualizations, and more. Yet, when different graph nodes represent the same entity, graphs get messy. Watch this essential video with Senzing CEO Jeff Jonas on how adding entity resolution to a graph database condenses network graphs to improve analytics and save your analysts time.

Database

Hacker News

DECEMBER 17, 2023

I gave a talk on my Masters Thesis Project in Architecture focusing on Altering Soundscapes in Exterior Environments using Helmholtz Resonators in Ceramic Br.

181

181

Flipboard

DECEMBER 17, 2023

As the generative AI boom took off in early 2023 , there were plenty of predictions about how soon — and to what extent — companies would start using generative AI in their marketing. Nearly a year later, it’s clear many are feeling increasingly comfortable. Just last week, the global hotel search company Trivago released a new ad campaign as part of a broader rebrand.

AI 157

AI AI 157

Hacker News

DECEMBER 17, 2023

Hiring even one person creates a lot less profit than you'd think, and launching a product rarely works out. Here are some tips for consulting companies.

180

180

Flipboard

DECEMBER 17, 2023

Transparency and authenticity are critical for organizations that intend to use AI in any shape and form. As 2023 comes to a close, it has become evident that the once-unstoppable global AI race is quickly transforming into a mad dash.

AI 145

AI AI Computer Science Computer Science 145

Advertisement

Start-ups & SMBs launching products quickly must bundle dashboards, reports, & self-service analytics into apps. Customers expect rapid value from your product (time-to-value), data security, and access to advanced capabilities. Traditional Business Intelligence (BI) tools can provide valuable data analysis capabilities, but they have a barrier to entry that can stop small and midsize businesses from capitalizing on them.

Analytics

Hacker News

DECEMBER 17, 2023

More than 72 million years ago, the western seas of the Pacific Ocean were home to one of the fiercest ocean predators of all time.

180

180

Flipboard

DECEMBER 17, 2023

Cook up an AI-powered recipe with Taste Bud, summarize a YouTube video with Summarize.tech, and more. You can do some amazing things with AI in a minute or less. Read on for eight ways to start making something new. They’re all free, fast, and fun. 1.

AI 144

AI AI Computer Science Computer Science 144

Hacker News

DECEMBER 17, 2023

Ventoy is an open source tool to create bootable USB drive for ISO files. With ventoy, you don't need to format the disk again and again, you just need to copy the iso file to the USB drive and boot it.

163

163

Machine Learning Research at Apple

DECEMBER 17, 2023

*=Equal Contributors Multimodal datasets are a critical component in recent breakthroughs such as Stable Diffusion and GPT-4, yet their design does not receive the same research attention as model architectures or training algorithms. To address this shortcoming in the ML ecosystem, we introduce DataComp, a testbed for dataset experiments centered around a new candidate pool of 12.8 billion image-text pairs from Common Crawl.

ML 124

ML ML Algorithm 124

Speaker: Scott Sehlhorst

We know we want to create products which our customers find to be valuable. Whether we label it as customer-centric or product-led depends on how long we've been doing product management. There are three challenges we face when doing this. The obvious challenge is figuring out what our users need; the non-obvious challenges are in creating a shared understanding of those needs and in sensing if what we're doing is meeting those needs.

Hacker News

DECEMBER 17, 2023

To reach the Senior level, you need to increase your scope, impact, and ownership. One of the best ways to do that is to become a “go-to” person or an expert. You could be the “database expert”, “Python expert”, “caching expert”, “frontend expert”, “Typescript expert”, etc.

Database 162

Database Python 162

Flipboard

DECEMBER 17, 2023

In an audacious move that defies conventional wisdom, generative AI companies have embraced a cutting-edge approach to quality assurance: Releasing large language models (LLMs) directly into the wild, untamed realms of the internet.

AI 137

AI AI Computer Science Computer Science 137

Hacker News

DECEMBER 17, 2023

Qatar Airways has banned YouTube flight reviewer Josh Cahill for posting a negative review. Here's the backstory.

180

180

Flipboard

DECEMBER 17, 2023

AI use is skyrocketing in the workplace, with over half of companies now employing generative AI tools to enhance productivity and creativity, despite concerns about regulation and job loss. At JLL, a proprietary AI tool streamlines tedious tasks, allowing employees to focus on high-level work, demonstrating AI’s ability to reveal insights quickly and aid in complex decision-making.

AI 130

AI AI Artificial Intelligence Artificial Intelligence 130

Advertisement

While data platforms, artificial intelligence (AI), machine learning (ML), and programming platforms have evolved to leverage big data and streaming data, the front-end user experience has not kept up. Holding onto old BI technology while everything else moves forward is holding back organizations. Traditional Business Intelligence (BI) aren’t built for modern data platforms and don’t work on modern architectures.

Artificial Intelligence

Hacker News

DECEMBER 17, 2023

Caspar Hauser died on 17 December 1833, but was it murder or a self-inflicted wound? Hauser’s mysterious death raised as many questions as his mysterious life.

166

166

Flipboard

DECEMBER 17, 2023

The tech industry is obsessed with the idea of being able to remember everything, but when it comes to your personal life, there need to be limits.

AI 118

AI AI Computer Science Computer Science 118

Hacker News

DECEMBER 17, 2023

3M knew its chemicals were toxic decades ago, but didn’t tell the public or government, internal documents show.

179

179

Flipboard

DECEMBER 17, 2023

In the rapidly evolving world of language processing, the integration of advanced tools like Gemini Pro with LangChain is a significant step forward for …

AI 113

AI AI Computer Science Computer Science 113

Speaker: Timothy Chan, PhD., Head of Data Science

Are you ready to move beyond the basics and take a deep dive into the cutting-edge techniques that are reshaping the landscape of experimentation? 🌐 From Sequential Testing to Multi-Armed Bandits, Switchback Experiments to Stratified Sampling, Timothy Chan, Data Science Lead, is here to unravel the mysteries of these powerful methodologies that are revolutionizing how we approach testing.

Data Science

Hacker News

DECEMBER 17, 2023

Motivation To support high-performance GEMM code generation on Intel GPU, we propose XeGPU dialect. XeGPU dialect provides an abstraction that closely models Xe instructions. XeGPU ops are introduced when a special Xe instruction can’t be expressed by LLVM/SPIR-V dialect, for example, like matrix instruction (AKA DPAS) and 2D block load. It matches the hardware instructions’ semantics including the matrix sizes.

148

148

Flipboard

DECEMBER 17, 2023

Last month, Amdocs and NVIDIA announced a strategic collaboration aimed at optimising LLMs to accelerate the adoption of generative AI applications …

AI 112

AI AI Machine Learning Machine Learning 112

Hacker News

DECEMBER 17, 2023

by Jennifer Jenkins, Director, Duke Center for the Study of the Public Domain CC BY 4.0 On January 1, 2024, after almost a century of copyright protection, Mickey Mouse, or at least a version of Mickey Mouse, will enter the public domain. The first movies in which the iconic mouse appeared – most famously, Steamboat Willie­[1] – were made in 1928 and works from that year go into the public domain in the United States on New Year’s Day 2024.[2] The public domain has had some famous recent arrival

140

140

Flipboard

DECEMBER 17, 2023

Intel rolled out a portfolio of AI products aimed at the data center, cloud, network, edge and PC at its AI Everywhere event in New York City last week. "Intel is on a mission to bring AI everywhere through exceptionally engineered platforms, secure solutions and support for open ecosystems," CEO.

AI 97

AI AI 97

Advertisement

In the rapidly-evolving world of embedded analytics and business intelligence, one important question has emerged at the forefront: How can you leverage artificial intelligence (AI) to enhance your application’s analytics capabilities? Imagine having an AI tool that answers your user’s questions with a deep understanding of the context in their business and applications, nuances of their industry, and unique challenges they face.

AI