Before 2027, will a frontier AI model achieve an AA-Omniscience hallucination rate below 5%?
3
1kṀ450Dec 31
32%
chance
1H
6H
1D
1W
1M
ALL
Resolves according to this leaderboard: https://artificialanalysis.ai/?omniscience=omniscience-hallucination-rate. The metric we are looking it as percentage of non-correct answers that are hallucinations.
To count, the model must be somewhere close to frontier, defined by being a release by a major lab that is larger than 7b parameters and competitive for its size class. No tool use allowed.
Esta pergunta é gerenciada e resolvida pela Predita.
Get 
1,000 to start trading!
1,000Pessoas também estão operando
Perguntas relacionadas
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
66% chance
Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA?
52% chance
AI honesty #1: by 2027 will we have AI that doesn't hallucinate random nonsense?
44% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
35% chance
Will an AI achieve >80% performance on the FrontierMath benchmark before 2027?
43% chance
[ACX 2026] Will an AI model reach a 3 hour time horizon with 80% reliability during 2026?
74% chance
Will there be a significant advancement in frontier AI model architecture by end of year 2026?
21% chance
Before 2027, will OpenAI release a Frontier Model trained according to their "Why LLMs hallucinate" paper?
49% chance
Will a publicly known AI model achieve an 80% time horizon that is an 1 hour and 30 minutes by September 2026?
85% chance
Will I believe any AI system is conscious before 2027?
35% chance