Em altaUrgenteNovo
PolíticaEsportesCriptoFinançasGeopolíticaResultadosTecnologiaCulturaMundoEconomiaEleições
On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark
43
1kṀ6110
Dec 31
89%
chance

Tracking external bet: https://www.isattentionallyouneed.com/

This will resolve according to that site, whatever the conditions and caveats they have agreed on.

AI
Get
Ṁ1,000
to start trading!

Pessoas também estão operando

Will OpenAI announce a new full-size, frontier model >5.2 before April 1, 2026?
92% chance
Will OpenAI announce a new full-size, frontier model >5.2 before March 1, 2026?
25% chance
Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?
63% chance
Will transformer architectures lose their dominant position in deep learning before 2028?
16% chance
Will superposition in transformers be mostly solved by 2026?
46% chance
Will there be a significant advancement in frontier AI model architecture by end of year 2026?
21% chance
When will a non-Transformer model become the top open source LLM?
Will models be able to do the work of an AI researcher/engineer before 2027?
16% chance
[Will Brown] Will Transformative AI look like an abundance of specialized models, in August 2026?
44% chance
In Jan 2027, it will be standard practise for non-AI-building tech companies to finetune and train their own models
35% chance
Ordenar por:

Is mamba-trwnsformer hybrid transformer like? Falcon H1 is an example of such architecture.

@ProjectVictory does it use some kind of attention mechanism?

What constitutes Transformer-like?

Is it all, or some, of these?

  • Token inputs, token outputs

  • Positional encoding

  • (MH QKV SDPA -> MLP) layers

  • Residual connections

comprou Ṁ50 NO

https://arxiv.org/abs/2501.00663

Titans: Learning to Memorize at Test Time
Abstract page for arXiv paper 2501.00663: Titans: Learning to Memorize at Test Time

@JaundicedBaboon Let's see if it can leave the academia limbo where the Mamba's got stuck...

https://x.com/_philschmid/status/1846452029582959012

@MalachiteEagle Transformers, yes. Attention, not really:

followed by two shared attention blocks.

https://blog.rwkv.com/p/eagle-7b-soaring-past-transformers

It even links the wager page in its bragging points:

All while being an “Attention-Free Transformer”

I thought this wager was made today haha

Does this strictly resolve to the outcome of the bet?

@FranekZak Yep. Whatever details they come up with are in.

Pessoas também estão operando

Will OpenAI announce a new full-size, frontier model >5.2 before April 1, 2026?
92% chance
Will OpenAI announce a new full-size, frontier model >5.2 before March 1, 2026?
25% chance
Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?
63% chance
Will transformer architectures lose their dominant position in deep learning before 2028?
16% chance
Will superposition in transformers be mostly solved by 2026?
46% chance
Will there be a significant advancement in frontier AI model architecture by end of year 2026?
21% chance
When will a non-Transformer model become the top open source LLM?
Will models be able to do the work of an AI researcher/engineer before 2027?
16% chance
[Will Brown] Will Transformative AI look like an abundance of specialized models, in August 2026?
44% chance
In Jan 2027, it will be standard practise for non-AI-building tech companies to finetune and train their own models
35% chance
© Predita Markets, Inc.•Termos de Uso•Privacidade