It may not be enough to just use LLMs to write your code when you can also use them to adjust it while your program runs.
NVIDIA outlined three cuTile kernels for Mamba-2 and said optimized forward-pass code ran 1.14x to 1.82x faster than a Triton ...