Skip to content

Commit ab92088

Browse files
Golovnevaolggol
andauthored
new papers (#31)
Co-authored-by: olggol <olggol@meta.com>
1 parent 630b2d2 commit ab92088

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

projects/README.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -73,6 +73,9 @@ Here we list projects undertaken in the RAM framework that are shared publicly,
7373

7474
#### _synthetic data for complex reasoning & tools_
7575

76+
- **NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questions** [[paper]](https://arxiv.org/abs/2502.13124).
77+
_Scaling reasoning capabilities with diverse and high-quality questions._
78+
7679
- **Source2Synth** [[paper]](https://arxiv.org/abs/2409.08239).
7780
_Generating synthetic data from real sources to improve LLMs on complex reasoning tasks._
7881

@@ -139,8 +142,11 @@ Here we list projects undertaken in the RAM framework that are shared publicly,
139142

140143
#### _architectures_
141144

145+
- **Multi-token attention** [[paper]](https://arxiv.org/abs/2504.00927)
146+
_Attention mechanism that can focus on multiple tokens simultaneously_.
147+
142148
- **Byte Latent Transformer** [[paper]](https://arxiv.org/abs/2412.09871)
143-
_New Byte-level LLM architecture that matches tokenization-based LLM performance at scale.
149+
_New Byte-level LLM architecture that matches tokenization-based LLM performance at scale._
144150

145151
- **Adaptive Decoding via Latent Preference Optimization** [[paper]](https://arxiv.org/abs/2411.09661)
146152
_New layer that selects decoding params automatically *per token*_.

0 commit comments

Comments
 (0)