Welcome to NATTEN docs!
- What is NATTEN and why does it exist?
- How is Neigborhood Attention implemented?
- How do I install NATTEN?
- Front-end
- Describes how to check NATTEN's compatibility with your system, and its available features.
- Describes how to use torch modules
NeighborhoodAttention1D,NeighborhoodAttention2D, andNeighborhoodAttention3D. - Describes when and how to use ops directly instead of modules.
- Fused Neighborhood Attention (new)
- Quick start guide
- Fused vs unfused: differences in supported features, layouts, etc.
- KV parallelism (training only)
- Auto-tuner (experimental)
- API
- Describes the current C++ API structure.
- Backend
- Overview of different implementations, and available framework extensions.
- Implementation details and limitations.
- Dispatch mechanism and auto-generated instantiations.
- Build system
- Tests
- Changelog