Scale Unveils New AI Model Leaderboard System to Rival LMArena

Data-labeling startup Scale AI is launching a new public benchmarking system to rank the best-performing artificial intelligence models for different regions, professions and age groups.

The ranking system, called SEAL Showdown, builds on Scale’s existing leaderboards and relies on votes from contributors in more than 100 countries to gauge everyday usability of models.

“Participation is voluntary and unpaid, with contributors viewing it as a perk because they get free access to frontier models that typically cost hundreds of dollars a month,” said Janie Gu, a product manager at Scale AI. Unlike other platforms that draw mostly tech enthusiasts, Scale’s pool ...