Early version bump for SiLLM to 0.1.1 with some bugfixes and support for Llama-3 models.
pypi.org/project/sillm-mlx/
github.com/armbues/SiLLM
Running Llama-3-8B-Instruct on Mac with the SiLLM framework powered by MLX... just took some fiddling with the tokenizer & template to get it to run 😁
I'm excited to share a new open-source project: the Silicon LLM Training & Inference Toolkit, short SiLLM.
Check out the project on Github here:
github.com/armbues/SiLLM
The repository includes several code examples:
- LoRA training with the Nvidia HelpSteer dataset
- DPO Fine-tuning with the DPO Mix 7K dataset
- Implementation of the MMLU Benchmark
- Calculating perplexity scores of a model for a sample dataset
A huge thank you to @awnihannun @angeloskath and the rest of the team for developing the MLX framework that SiLLM relies on! Also big kudos to all the contributors of the MLX Examples project 👏
Armin Buescher retweeted
One of the reasons to attend the #CARO2023 is the food for thought that is delivered in talks, conversations, and of course keynotes. Armin Büscher @armbues will share his technical perspective about innovation and disruption in cybersecurity.
caro2023.org/#c228106
Armin Buescher retweeted
Y’all have a home on Infosec.exchange if you need it ❤️
Armin Buescher retweeted
This file leaked an Security Enterprise Virustotal API Key before!But now it's expired because someone leaked the key😅
ITW:07c4a75b1422a22ec29c5102e0b67055
API Key:d10468bead05da1685629a0abcfed5f963d6adbc7e6bb2b2fc343dbb36be0349
unbelievable!
Armin Buescher retweeted
We just released 1000+ yara rules and 200+ endpoint behavior rules github.com/elastic/protectio…
I'll be traveling to Vegas for #blackhat2022 and #DEFCON next week. Looking forward to hang out with many infosec folks I haven't seen in a long time 🥳
Armin Buescher retweeted
The last seven years of my life have been wild, full of weirdos, spies, outlandish discoveries, sleuthing, hangovers, bungling criminals, madcap schemes, Libyan militias and Russian nerve gas. And it’s all in this book, out June 2022. Order your copy here: penguin.co.uk/books/1444756/…
Armin Buescher retweeted
NEW: This is Daxin, the most advanced Chinese espionage tool we've ever found. Used to spy on governments worldwide. symantec-enterprise-blogs.se…









