Yuduo WuLearning Notes

Learning Notes

Notes on inference, compilers, kernels, and accelerators.

On-Device NPU Terminology Cheat Sheet

Hardware components and low-level programming concepts across five NPU families, with shared definitions, sources, and a downloadable poster.

Read more

CUDA Graphs, Fusion, and Megakernels

If CUDA Graphs already reduce kernel launch overhead, why build a megakernel? One measured H100 workload connects graph replay, local fusion, and retained tiles.

Read more

AI Accelerator Terminology Cheat Sheet

Hardware and low-level programming terms across NVIDIA GPUs, AMD Instinct GPUs, Google TPU and AWS Trainium, with scoped comparisons, primary sources and a downloadable poster.

Read more