@liger_kernel

Efficient Triton Kernels for LLM Training

github.com/linkedin/Liger-Kernel
Joined August 2024
  • Tweets24
  • Following8
  • Followers358
11Media
Lots to announce today! Axolotl 0.6.0 is out with: - new axolotl cli command - updated dependencies to latest on Transformers, TRL, Accelerate, PEFT, bitsandbytes, deepspeed, @liger_kernel - Support for Cut Cross Entropy - ReLoRA optimizer reset fixes - ADOPT optimizer 🧵
8
31
5
168
11,475
Liger Kernel retweeted
Jiwoo Hong@jiwoohong989 Nov 2024
Replying to @jiwoohong98 @emnlpmeeting @nlee288
Thankfully, we now have more than 1,300 open checkpoints in the Hugging Face community🙌 And thanks to groundbreaking work by @liger_kernel team, you can use ORPO with up to 10 times more efficient memory usage🤯 github.com/linkedin/Liger-Ke…
3
5
587
Load more