成為 AI Compiler Engineer

• 一個 AI compiler Engineer 需要的技能
  
• Triton Tutorial 1
• Triton Tutorial 2 & Software Tiling
• LLVM – model parser

https://www.youtube.com/watch?v=s1ILGG0TyYM&pp=ygUPdHJpdG9uIGNvbXBpbGVy

• CUDA computing

  • https://juejin.cn/post/7225941839290826810

• LLVM、MLIR 架構

  • LLVM 介紹https://medium.com/@zetavg/%E7%B7%A8%E8%AD%AF%E5%99%A8-llvm-%E6%B7%BA%E6%B7%BA%E7%8E%A9-42a58c7a7309
  • MLIR 介紹
    https://lovelessless99.github.io/coding-hub/blogs/MLIR/MLIR.html

• LLVM 與 Triton 的關聯

• AI 運算平行化的做法

  • https://colossalai.org/docs/concepts/paradigms_of_parallelism/

• Kata 式練習

  • GPU puzzle https://github.com/srush/GPU-Puzzles

• cuda programming

  • https://www.reddit.com/r/MachineLearning/comments/w52iev/d_what_are_some_good_resources_to_learn_cuda/

• pytorch 學習筆記

• Triton & triton 解決的問題

  • Megablock – SSR matrix 乘法
  • triton reimplement megablock – SSR

• 還有哪些問題或是 triton 還有哪些優化需要處理？