FlashAttention: Why Attention Is a Memory Problem in Disguise
Attention gets described as an O(N²) algorithm, and that description is simultaneously correct and misleading. Yes, the score matrix between
Continue readingFlashAttention: Why Attention Is a Memory Problem in Disguise