FlashAttention:Fast and Memory-Efficient Exact Attention with IO-Awareness

2205.14135v2

摘要

PreviousGQA:Training Generalized Multi-Query Transformer Models from Multi-Head CheckpointsNextEfficient Memory Management for Large Language Model Serving with PagedAttention

Last updated