Sun.Feb 09, 2025

article thumbnail

Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Machine Learning Research at Apple

*Primary Contributors Attention is a key part of the transformer architecture. It is a sequence-to-sequence mapping that transforms each sequence element into a weighted sum of values. The weights are typically obtained as the softmax of dot products between keys and queries. Recent work has explored alternatives to softmax attention in transformers, such as ReLU and sigmoid activations.

130
130
article thumbnail

Don't "optimize" conditional moves in shaders with mix()+step()

Hacker News

Tutorials and articles of Inigo Quilez on computer graphics, fractals, demoscene, shaders and more.

182
182
professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

OpenAI CEO Sam Altman admits that AI’s benefits may not be widely distributed

Flipboard

In a new essay on his personal blog, OpenAI CEO Sam Altman said the company is open to a compute budget, among other strange-sounding ideas, to enable everyone on Earth to use a lot of AI and ensure the benefits of the technology are widely distributed.

AI 181
article thumbnail

UnitedHealth Is Sick of Everyone Complaining About Its Claim Denials

Hacker News

Two months after UnitedHealthcare CEO Brian Thompson was killed, the insurer's parent company is going after people who say it denies too many claims.

181
181
article thumbnail

How to Achieve High-Accuracy Results When Using LLMs

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

article thumbnail

The New Wave of AI Is Here

Flipboard

Yes, some work will be replaced, but new jobs will be discovered in emerging industries. A recent meme captures the gnawing artificial-intelligence backlash: A worker says, AI turns this single bullet point into a long email I can pretend I wrote.

article thumbnail

Dear Mr. Vice President, Please Take Off Your Apple Watch

Hacker News

An Open Letter To JD Vance From A Former CIA Officer On The Counterintelligence Risks Of Smartwatches Mr. Vice President, Congratulations on your ascendancy to the Vice President of the United States of America. While we are an apolitical platform, we wish you nothing but success, the country depends on you.

181
181

More Trending

article thumbnail

Modern-Day Oracles or B t Machines

Hacker News

Comments

181
181
article thumbnail

'I encountered the terror of never finding anything': The hollowness of AI art proves machines can never emulate genuine human intelligence

Flipboard

Looking at AI-generated art shows that machines may never truly understand the human mind, because there are states of mind that can never be automated.

AI 171
article thumbnail

Sky skimmers: The race to fly satellites at the lowest orbits yet

Hacker News

There's a new race in space, but it's not where you might think. It's happening close to home in the nearest bit of space, right on the edge of Earth's atmosphere.

181
181
article thumbnail

AI execs at big consulting firms share their favorite prompts and how they use the technology

Flipboard

Working with artificial intelligence can sometimes feel more like an art than a science. That's why many companies are turning to consulting firms for guidance on how to maximize the technology.

article thumbnail

The 2nd Generation of Innovation Management: A Survival Guide

Speaker: Chris Townsend, VP of Product Marketing, Wellspring

Over the past decade, companies have embraced innovation with enthusiasm—Chief Innovation Officers have been hired, and in-house incubators, accelerators, and co-creation labs have been launched. CEOs have spoken with passion about “making everyone an innovator” and the need “to disrupt our own business.” But after years of experimentation, senior leaders are asking: Is this still just an experiment, or are we in it for the long haul?

article thumbnail

U.S. facing most intense flu season in at least 15 years

Hacker News

One indicator of flu activity is the percentage of doctors office visits driven by flu-like symptoms. Last week, that number was clearly higher than the peak of any winter flu season since 2009-2010.

181
181
article thumbnail

Researchers Replicate OpenAI's Hot New AI Tool in 24 Hours

Flipboard

OpenAI has a problem: each time it releases an advanced new AI, it's getting copied almost instantly.

AI 168
article thumbnail

Thomas Aquinas' Skull Reveals Appearance and Cause of Death

Hacker News

Dominican priests react to the visage of a holy man they have grown to know and love.

178
178
article thumbnail

People cannot tell AI-generated from human-written poetry and they like AI poetry more

Flipboard

Can you tell the difference between a poem written by a human and one crafted by AI? New research suggests most people cantand surprisingly, they even prefer AI-generated poetry for its rhythm and beauty.

AI 164
article thumbnail

Apache Airflow® Best Practices: DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

TL;DR of Deep Dive into LLMs Like ChatGPT by Andrej Karpathy

Hacker News

A TL;DR version of Andrej Karpathy's "Deep dive into LLMs like ChatGPT" video.

177
177
article thumbnail

Fears About AI Job Loss: New Study Answers If They’re Justified

Flipboard

The writing is on the wall. AI will replace many more jobs this year. Experts predict that AI will replace full-time careers in 2025reducing the number of jobs and creating a greater reliance on gig employment and freelancers.

AI 159
article thumbnail

Forget Psychedelics. Everyone's Microdosing Ozempic Now

Hacker News

Sure, who wouldnt want to lose a few pounds?

170
170
article thumbnail

Creative React: OpenAI’s Super Bowl Ad Dumbs Down AI for Average Joes

Flipboard

OpenAI made a last-minute Super Bowl debut, pitching its flagship product, ChatGPT, as humanitys latest breakthrough innovation.

AI 158
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

AI Demos by Meta

Hacker News

Try experimental demos featuring the latest AI research from Meta.

AI 164
article thumbnail

AI is being used in social services – but we must make sure it doesn’t traumatise clients

Flipboard

Late last year, ChatGPT was used by a Victorian child protection worker to draft documents.

AI 156
article thumbnail

Intel ruined an Israeli startup it bought for $2B–and lost the AI race

Hacker News

Habana Labs was supposed to challenge Nvidia. Instead, Intel drove it into the ground.

AI 157
article thumbnail

Business Tech News: OpenAI Launches A Powerful New AI Research Tool

Flipboard

Here are five things in business tech news that happened this week and how they affect your business.Did you miss them? Business Tech News #1 OpenAI launches new AI tool to facilitate research tasks.

AI 155
article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Apple's Best Option: Decentralize iCloud

Hacker News

What can Apple do in the face of a UK order to weaken encryption worldwide? Decentralize iCloud, to start.

156
156
article thumbnail

5 Amazing Things You Can Do With ChatGPT's New Operator Mode?

Flipboard

ChatGPTs new Operator mode is its first step towards becoming an AI agent a new type of AI tool that carries out far more complex tasks without the need for human intervention. But what exactly can it do?

AI 154
article thumbnail

L.A. power utility found irregularities on equipment where wildfire broke out

Hacker News

Southern California Edison said video evidence had led it to look more broadly at whether its equipment might have been the cause of the deadly blaze.

154
154
article thumbnail

OpenAI Enters Super Bowl 59 With a Bold AI Pitch

Flipboard

OpenAI made its Super Bowl debut with a 60-second spot positioning ChatGPT as the next major leap in human innovation.

AI 154
article thumbnail

The Cloud Development Environment Adoption Report

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

article thumbnail

PostgreSQL Best Practices

Hacker News

PostgreSQL (Postgres) is one of the most powerful and popular relational database management systems available today.

article thumbnail

Four Big Questions About AI In 2025

Flipboard

Its still January, and theres already been quite a lot of discourse in and around MIT about the state of technology right now. Breaking news includes this concern about DeepSeeks new model and how it affects the U.S. tech industry.

AI 145
article thumbnail

Reflect Orbital: Sunlight after dark using a constellation of spatial reflectors

Hacker News

Sunlight after dark

150
150
article thumbnail

Deep Dive: Chinese AI firm DeepSeek challenges ChatGPT with new chatbot

Flipboard

Deep Dive delves into hot issues in Hong Kong and mainland China.

AI 138
article thumbnail

Marketing Operations in 2025: A New Framework for Success

Speaker: Mike Rizzo, Founder & CEO, MarketingOps.com and Darrell Alfonso, Director of Marketing Strategy and Operations, Indeed.com

Though rarely in the spotlight, marketing operations are the backbone of the efficiency, scalability, and alignment that define top-performing marketing teams. In this exclusive webinar led by industry visionaries Mike Rizzo and Darrell Alfonso, we’re giving marketing operations the recognition they deserve! We will dive into the 7 P Model —a powerful framework designed to assess and optimize your marketing operations function.