TutorialsΒΆ
Below is a gallery of tutorials for writing various basic operations with Triton. It is recommended that you read through the tutorials in order, starting with the simplest one.
To install the dependencies for the tutorials:
cd triton
pip install -e './python[tutorials]'
Vector Addition
Fused Softmax
Matrix Multiplication
Low-Memory Dropout
Layer Normalization
Fused Attention
Libdevice (tl.extra.libdevice) function
Libdevice (`tl.extra.libdevice`) function
Group GEMM
Persistent Matmul