Happy Chinese Lunar New Year! The Liger team is excited to announce our milestone of 1,000,000 downloads! Since our initial release in August 2024, we have observed tremendous growth in both usage and community engagement. We appreciate all the recognition and will continue to deliver high-quality LLM kernels. We are also happy to announce our open source community's partnership with @glowsai ! @glowsai will sponsor our recognized contributors by providing access to their GPU platform. They offer one of the most cost-efficient GPU clouds in the market - powered by their advanced orchestration engine Tripods and delivering 80% cost savings compared to major cloud providers. Our community members have been battle-testing it for development, and the experience has been delightful.

Liger Kernel v0.5 github.com/linkedin/Liger-Ke… Post Training Loss: Introducing the first open-source optimized post-training losses in Liger Kernel with ~80% memory reduction, featuring DPO, CPO, ORPO, SimPO, JSD, and more. No more OOM nightmares for post-training ML researchers! AMD CI: With AMD’s generous sponsorship of MI300s, we’ve integrated them into our CI. Special thanks to Embedded LLM for building the AMD CI infrastructure. XPU Support: In collaboration with Intel, we now support XPU, demonstrating comparable performance gains with other vendors.

What just happened 👀👀

With Liger-Kernel, you can now fine-tune Qwen2-VL @Alibaba_Qwen on @modal_labs by one command with 10%+ throughput and 50% less memory, thanks to the contribution from @tyleraromero! github.com/linkedin/Liger-Ke…

🚀 Liger Kernel has surpassed **100,000+ downloads** after a month! We're humbled by the many success stories shared by both the research community and enterprises. Our commitment remains strong: we'll continue to support more kernels and models while improving performance. Based on community feedback, we've crafted our Q4 roadmap (github.com/linkedin/Liger-Ke…). It includes exciting features like multimodal and JSD kernels, among others. We're actively seeking contributors to help shape the future of Liger Kernel. Join us to the next milestone! Liger-Kernel: github.com/linkedin/Liger-Ke…

🎉 We are excited to have surpassed 50,000 downloads (stable+nightly) in less than 3 weeks! We've added many new features and models. Expect something cool in the next release! github.com/linkedin/Liger-Ke…

🚀 We just dropped our 0.2.1 release! Here're some highlights: 1. 2500+ Stars, 10+ New Contributors, 50+ PRs, 50k Downloads in two weeks. 2. New Integrations: SFTtrainer (@huggingface), Axolotl (@winglian), LLaMa-Factory (@llamafactory_ai) 3. New Models Support: Phi3 (@MSFTDeepSpeed) & Qwen2 (@Alibaba_Qwen) 4. AutoModel API: Meet AutoLigerKernelForCausalLM (inspired by @casper_hansen_ @robertshaw21) 5. Enhanced FusedLinearCrossEntropy: support bias term See our full release note at github.com/linkedin/Liger-Ke… Release Manager: @Yuniverse6666