AI experts are raising concerns about the validity and ethics of crowdsourced benchmarking platforms like Chatbot Arena that are increasingly used by major AI labs to evaluate their models. Critics argue these platforms...
Databricks CEO Ali Ghodsi and Anthropic CEO Dario Amodei are hosting a virtual fireside chat to discuss their collaboration on advancing domain-specific AI agents. The event will include three additional sessions explori...
Independent testing by Epoch AI revealed OpenAI's publicly released o3 model scores significantly lower on the FrontierMath benchmark (10%) than the company's initially claimed 25% figure. OpenAI clarified that the publi...
Geoff Ralston, former president of Y Combinator, has established the Safe Artificial Intelligence Fund (SAIF) focused on investing in startups working on AI safety, security, and responsible deployment. The fund will pro...
OpenAI has hired the co-founders of Context.ai, a startup that developed tools for evaluating and analyzing AI model performance. Following this acqui-hire, Context.ai plans to wind down its products, which included a da...
Safe Superintelligence (SSI), founded by former OpenAI chief scientist Ilya Sutskever, has reportedly raised an additional $2 billion in funding at a $32 billion valuation. The startup, which previously raised $1 billion...
Thinking Machines Lab, founded by former OpenAI CTO Mira Murati, is reportedly targeting a $2 billion seed funding round at a $10 billion valuation despite having no product or revenue. The company has been attracting hi...
AI reasoning models like OpenAI's o1 are substantially more expensive to benchmark than their non-reasoning counterparts, costing up to $2,767 to evaluate across seven popular AI benchmarks compared to just $108 for non-...
Google has announced it will support Anthropic's Model Context Protocol (MCP) in its Gemini models and SDK, following OpenAI's similar adoption. MCP enables two-way connections between AI models and external data sources...
OpenAI has introduced the Pioneers Program aimed at developing domain-specific AI benchmarks that better reflect real-world use cases across industries like legal, finance, healthcare, and accounting. The program will pa...
