FLOPS Calculator

Estimate compute (FLOPS) for a forward + backward pass.

Params (B)

Seq Length

Batch Size

Forward Pass28.67 TFLOPS

Backward Pass57.34 TFLOPS

Total (Fwd+Bwd)86.02 TFLOPS

Approximation: Forward ≈ 2×P×S×B, Backward ≈ 2× Forward