Glossary

Sparse attention

• A way for AI models to look at only the most useful parts of text instead of everything at once.• It skips less relevant tokens to save time and memory. Why it matters Also called: Short excerpt: