AI Evaluation AI News & Updates
Laude Institute Launches Slingshots Grant Program to Accelerate AI Research and Evaluation
The Laude Institute announced its first Slingshots grants program, providing fifteen AI research projects with funding, compute resources, and engineering support. The initial cohort focuses heavily on AI evaluation chal...
OpenAI Research Identifies Evaluation Incentives as Key Driver of AI Hallucinations
OpenAI researchers have published a paper examining why large language models continue to hallucinate despite improvements, arguing that current evaluation methods incentivize confident guessing over admitting uncertaint...
Hugging Face Scientist Challenges AI's Creative Problem-Solving Limitations
Thomas Wolf, Hugging Face's co-founder and chief science officer, expressed concerns that current AI development paradigms are creating "yes-men on servers" rather than systems capable of revolutionary scientific thinkin...
Experts Criticize IQ as Inappropriate Metric for AI Capabilities
OpenAI CEO Sam Altman's comparison of AI progress to annual IQ improvements is drawing criticism from AI ethics experts. Researchers argue that IQ tests designed for humans are inappropriate measures for AI systems as th...
OpenAI Tests AI Persuasion Capabilities Using Reddit's r/ChangeMyView
OpenAI has revealed it uses the Reddit forum r/ChangeMyView to evaluate its AI models' persuasive capabilities by having them generate arguments aimed at changing users' minds on various topics. While OpenAI claims its m...