Before 2027, will a frontier AI model achieve an AA-Omniscience hallucination rate below 5%?
3
1kṀ450Dec 31
32%
chance
1H
6H
1D
1W
1M
ALL
Resolves according to this leaderboard: https://artificialanalysis.ai/?omniscience=omniscience-hallucination-rate. The metric we are looking it as percentage of non-correct answers that are hallucinations.
To count, the model must be somewhere close to frontier, defined by being a release by a major lab that is larger than 7b parameters and competitive for its size class. No tool use allowed.
Esta pergunta é gerenciada e resolvida pela Predita.
Get
1,000 to start trading!
Pessoas também estão operando
Perguntas relacionadas
Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA?
61% chance
AI honesty #1: by 2027 will we have AI that doesn't hallucinate random nonsense?
44% chance
Will there be a significant advancement in frontier AI model architecture by end of year 2026?
27% chance
Will there be a publicly available AI with Anthropic Mythos-level capabilities before 2027?
96% chance
Before 2027, will OpenAI release a Frontier Model trained according to their "Why LLMs hallucinate" paper?
49% chance
Will a publicly known AI model achieve an 80% time horizon of 3 weeks by April 2027?
24% chance
Will an AI simulate human consciousness by 2100?
75% chance
Will a new lab create a top-performing AI frontier model before 2028?
87% chance
Will an AI system capable of doing 50% of knowledge job arrive by 2027?
37% chance
Will there be at least a "close call" with a powerful misaligned AI before 2100?
83% chance
