Hacker News

JANUARY 25, 2024

Note: as in my previous post about arbitrage on Avalanche, there are a lot of concepts in here that may not be familiar to the casual reader. I did my best to make simplifications, define terms in the glossary at … Continue reading →

171

171

Hacker News

NOVEMBER 15, 2023

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents - GitHub - vectara/hallucination-leaderboard: Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

140

140

Analytics Vidhya

MAY 29, 2022

Over a weekend, more than 600 participants competed to build and improve their solutions and climb the leaderboard. Introduction on Machine Learning Last month, I participated in a Machine learning approach Hackathon hosted on Analytics Vidhya’s Datahack platform. In this article, I will […].

Machine Learning 398

Machine Learning Machine Learning Data Science Analytics 398

DataRobot

SEPTEMBER 2, 2021

The baseball season is in full swing, overflowing with excitement for teams hoping to get onto the top of the leaderboard and play through the postseason. During my tenure, they continue to “top the leaderboard” within the AI/machine learning/data science industry. So, what about my new team, DataRobot? See DataRobot in Action.

Citizen Data Scientist 52

Citizen Data Scientist Artificial Intelligence Artificial Intelligence Data Scientist 52

Dataconomy

DECEMBER 25, 2023

y23 is not as visually appealing as Fortnite Wrapped 2023, but it is a leaderboard where you can see how you did against other players. y23, you can see stats such as: Level leaderboard Wins leaderboard Kills leaderboard Time leaderboard Using it is quite simple, just like in Fortnite Wrapped 2023. y23 fortnite.gg/y23

183

183

Hacker News

JANUARY 26, 2024

Comments (..)

139

139

Hacker News

MAY 25, 2023

Comments (..)

123

123

Hacker News

JUNE 15, 2023

Falcon went quickly top of the Open LLM leaderboard and has become one of the most interesting foundation models in the space. Currently, the 40B parameter model holds the top position on the Open LLM Leaderboard, while the 7B model excels within its specific weight class.

125

125

Dataconomy

MARCH 11, 2024

Digital fitness frontrunner, Flex, is redefining the world of AI fitness with new social features and leaderboards that let you turn even your toughest workouts into a game. Using artificial intelligence, the platform has recently announced a new global leaderboard feature as well as social sharing functionality.

AI 121

AI AI Artificial Intelligence Artificial Intelligence 121

Towards AI

JUNE 6, 2023

Last Updated on June 8, 2023 by Editorial Team Author(s): Jesus Rodriguez Originally published on Towards AI. The model has become one of the most interesting open-source foundation models in the space. Created Using Midjourney I recently started an AI-focused educational newsletter, that already has over 160,000 subscribers.

Machine Learning 92

Machine Learning Machine Learning Artificial Intelligence Artificial Intelligence 92

Hacker News

DECEMBER 3, 2023

Comments (..)

110

110

Hacker News

JANUARY 18, 2024

leaderboard, including Claude 2, Gemini Pro, and GPT-4 0613. We show that during Iterative DPO training that not only does instruction following ability improve, but also the ability to provide high-quality rewards to itself.

140

140

Ocean Protocol

JANUARY 25, 2024

This year welcomes season 2 of the championship and leaderboard points. Additionally, leaderboard points for the championship season will be rewarded for every challenge, scaled to the top 10 on a given data challenge. All participants outside of the top 10 will not receive points towards the season leaderboard.

Data Science 52

Data Science Hypothesis Testing Data Scientist Predictive Analytics 52

Hacker News

JANUARY 3, 2024

Empirically, we evaluate our method on several benchmark datasets including the HuggingFace Open LLM Leaderboard, MT-Bench, and datasets from Big-Bench. Theoretically, we prove that the global optimum to the training objective function of our method is achieved only when the LLM policy aligns with the target data distribution.

139

139

Google Research AI blog

MARCH 30, 2023

In this blogpost, we outline dataset development bottlenecks confronting researchers and discuss the role of benchmarks and leaderboards in incentivizing researchers to address these challenges. DataPerf: The first leaderboard for data We believe good benchmarks and leaderboards can drive rapid progress in data-centric technology.

ML 96

ML ML Algorithm Natural Language Processing 96

Towards AI

FEBRUARY 12, 2024

A great example of such a leaderboard is the Massive Text Embedding Benchmark (MTEB) Leaderboard: MTEB Leaderboard – a Hugging Face Space by mteb Discover amazing ML apps made by the community huggingface.co I’ve noticed that top-10 embeddings on the leaderboard usually have similar quality.

Database 96

Database Machine Learning Machine Learning ML 96

Towards AI

AUGUST 17, 2023

Platypus is now (August 16th) at the first rank on the OpenLLM leaderboard. In the same trend, Boston University proposes Platypus (Lee et al., 2023), Llama 2 fine-tuned with adapters and curated datasets. The method proposed in this work is nothing really new. It relies on LoRa adapters and careful dataset curation.

AI 94

AI AI Data Science Artificial Intelligence 94

Dataconomy

NOVEMBER 7, 2023

OpenAI says the Store will have leaderboards for popular GPTs, and eventually, GPT creators will be able to earn money based on how many people are using it. Once in the store, GPTs become searchable and may climb the leaderboards. Starting today, you can create GPTs and share them publicly.

AI 103

AI AI Artificial Intelligence Artificial Intelligence 103

Hacker News

JANUARY 15, 2024

There's also a leaderboard where participants are scored based on how fast they submitted a solution. In fact last year (2022) it was big news that users of ChatGPT were able, in multiple days, to reach the top of the global leaderboard. Difficulty is very hard to gauge objectively.

Python 122

Python AI AI 122

Dataconomy

DECEMBER 12, 2023

Collect goat emote heads (yes, you read that right) as you sprint through the year, accumulating points that propel you towards the coveted top spot on the global leaderboard. But here’s the twist: if you’re a streamer, it’s your chance to shine!

103

103

Towards AI

FEBRUARY 6, 2024

Introducing the Enterprise Scenarios Leaderboard for Real-World Use Cases The Enterprise Scenarios Leaderboard, developed by the Patronus team in partnership with Hugging Face, is a new benchmarking tool designed to assess language model performance across six business-oriented tasks.

AI 105

AI AI Machine Learning Machine Learning 105

Data Science Dojo

MARCH 13, 2024

MTEB (Massive Text Embedding Benchmark) An outlook of the MTEB – Source: Hugging Face The MTEB leaderboard is available on Hugging Face. It provides datasets for retrieving relevant documents or passages based on a query, allowing for a comprehensive evaluation of a model’s capabilities.

AI 221

AI AI Database Clustering 221

Kaggle

APRIL 20, 2020

on the leaderboard. on the leaderboard. The randomForest classifiers on the combined feature sets can improve the leaderboard ROC to 95.1x-95.3x, With that I got 94.9x I kept tuning along this way but the accuracy cannot be improved further. With this feature transformation strategy I got 94.6x

Data Analysis 55

Data Analysis Data Analysis 55

Explosion

OCTOBER 11, 2019

Transformer models like BERT have set a new standard for accuracy on almost every NLP leaderboard. However, these models are very new, and most of the software ecosystem surrounding them is oriented towards the many opportunities for further research.

52

52

Applied Data Science

OCTOBER 16, 2021

The leaderboard for the ‘trappiest’ chess openings —  [link] The definitive guide to ranking the best chess traps using stats In this blog post, we will use cold hard stats (and Python) to calculate the best chess traps! ? ? Here’s the leaderboard so far ? What’s a chess trap? Results How do other traps compare?

Data Science 130

Data Science Python AWS AI 130

DataRobot

MARCH 4, 2019

So, I clicked submit and waited for my competition leaderboard ranking – and discovered that I had placed second to last! I had spent a busy week at my computer coding up a cool-looking solution, and I was ready to submit my first entry to the competition.

Artificial Intelligence 68

Artificial Intelligence Artificial Intelligence Data Science AI 68

Ocean Protocol

FEBRUARY 1, 2024

Aviation Weather Forecasting Using METAR Data’ is the second data challenge in 2024, and the second opportunity to score points in the Championship Leaderboard for this season. 2024 marks the 3rd year of the Ocean Protocol Data Challenge Program initiative.

Exploratory Data Analysis 52

Exploratory Data Analysis Cross Validation Data Science Machine Learning 52

Explosion

AUGUST 1, 2019

Huge transformer models like BERT, GPT-2 and XLNet have set a new standard for accuracy on almost every NLP leaderboard. You can now use these models in spaCy, via a new interface library we've developed that connects spaCy to Hugging Face's awesome implementations.

40

40

Towards AI

JULY 21, 2023

Microsoft created the first leaderboard BLURB which includes their SOTA PubMedBERT models and several biomedical datasets. BLURB Leaderboard The Overall score is calculated as the macro-average performance over tasks. Transformers and ONNX runtime. pip install… github.com BioMedical NLP Interested in language models for biomedical NLP?

Natural Language Processing 78

Natural Language Processing Python AI AI 78

DataRobot Blog

JUNE 14, 2022

Mitigate the top three models found on the leaderboard by configuring mitigation to run automatically as part of Autopilot. Our mitigated model can be identified on the leaderboard by the Bias Mitigation badge. We’ve filtered the leaderboard on the Bias Mitigation badge. Mitigation Workflows. Evaluating the Mitigated Model.

Algorithm 59

Algorithm AI AI 59

NYU Center for Data Science

NOVEMBER 9, 2023

The course also employs incentives like a public leaderboard to motivate students. This focus on intuition and visualization is a core part of LeCun and Canziani’s approach. “A A lot of math is just the symbolic formalization of mental pictures,” Canziani explains.

Deep Learning 98

Deep Learning Deep Learning Computer Science Computer Science 98

Snorkel AI

JANUARY 24, 2024

LLM leaderboard. We have some cool news to share! Snorkel AI ranked 2nd, behind only GPT-4 Turbo, in our recent submission to AlpacaEval 2.0 This benchmark measures the ability of well-known LLMs such as Gemini, Claude 2, Llama 2, Mixtral, etc. to follow general user instructions.

AI 69

AI AI 69

Towards AI

SEPTEMBER 26, 2023

Object Detection Leaderboard Hugging Face has introduced the Object Detection Leaderboard, featuring top-performing models based on the DETA and DETR architectures. Backed by influential figures and companies, Suleyman introduces Pi, a friendly AI that advocates for interactive AI to connect technology with societal impact.

AI 64

AI AI AWS Artificial Intelligence 64

Data Science Dojo

FEBRUARY 15, 2024

Read more By making their models openly available, Meta and similar entities encourage widespread innovation, allowing researchers and developers to improve upon these models, which in turn, has seen them topping performance leaderboards.

AI 284

AI AI Machine Learning Machine Learning 284

DrivenData Labs

FEBRUARY 19, 2024

Remember that this score will be computed on your local test set, and your score on the public leaderboard will be based on an unseen test set. To develop your submission locally, you should add a subset of the challenge data to /data and treat this as your local test set. We'll demonstrate one way to do that next. python scripts/score.py

Python 130

Python Algorithm Azure 130

Dataconomy

JULY 24, 2023

Remember, the Reddit r/place end date is approaching, so this leaderboard is bound to see some last-minute shifts. France : 6,625 – 0.78% Netherlands : 6,300 – 0.75% Morocco : 5,250 – 0.62% Turkey : 5,100 – 0.6% Argentina : 5,000 – 0.59% Romania : 4,800 – 0.57% The United States : 4,275 – 0.5% Numbers were then rounded off, and flags under 0.1%

91

91

Snorkel AI

JANUARY 24, 2024

LLM leaderboard. We have some cool news to share! Snorkel AI ranked 2nd, behind only GPT-4 Turbo, in our recent submission to AlpacaEval 2.0 This benchmark measures the ability of well-known LLMs such as Gemini, Claude 2, Llama 2, Mixtral, etc. to follow general user instructions.

AI 52

AI AI 52