LongHeads: Multi-Head Attention is Secretly a Long Context Processor
Paper
•
2402.10685
•
Published
•
1
Luyi
lulululuyi
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 2 months ago
Thinking with Video: Video Generation as a Promising Multimodal
Reasoning Paradigm
Organizations
None yet
authored
6
papers
3 months ago
LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaboration
Paper
•
2402.11550
•
Published
•
18
A Controlled Study on Long Context Extension and Generalization in LLMs
Paper
•
2409.12181
•
Published
•
45
Self-Demos: Eliciting Out-of-Demonstration Generalizability in Large Language Models
Paper
•
2404.00884
•
Published
Effective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation
Paper
•
2504.18857
•
Published
R-Horizon: How Far Can Your Large Reasoning Model Really Go in Breadth and Depth?
Paper
•
2510.08189
•
Published
•
26