Jaigouk Kim (@jaigouk) header
Jaigouk Kim (@jaigouk) profile picture

a geek

Joined January 2008
Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)Photo by Jaigouk Kim (@jaigouk)
Hermes 3 performs strongly against Llama-3.1 Instruct Models, but with a focus on aligning the model to you, instead of a company or external policy - meaning less censorship and more steerability - with additional capabilities like agentic XML, scratchpads, roleplaying prowess, and more. Step level reasoning and planning, internal monologues, improved RAG, and even LLM as a judge capabilities were also targeted. Below are benchmark comparisons between Hermes 3 and Llama-3.1 Instruct and a sample of utilizing the agentic XML tags:
9
21
10
260
21,516
Introducing `llama-405b-to-8b` ✍️ Get the quality of Llama 3.1 405B, at a fraction of the cost and latency. Give one example of your task, and 405B will teach 8B (~30x cheaper!!) how to do the task perfectly. And it's open-source: github.com/mshumer/gpt-promp…
29
272
37
2,134
278,599
well, for customer GPU, I think Mistral-Nemo would be my choice so far.
45
You don't need a H100 to run Llama-3-405b. 2 MacBooks and 1 Mac Studio will do the job, with @exolabs_ to aggregate the memory/compute. I'm ready for you, Llama-3-405b.
38
106
34
956
104,364
I like to use STORM but the default example forntend was too bright. So I modified it little bit. github.com/jaigouk/storm_wik… - Dracula soft dark color - Duckduckgo - gpt-4o-mini - save result files as '*.md'
1
102
Jaigouk Kim retweeted
Released Hermes 2 Pro on Llama-3 8B today! Get it here: huggingface.co/NousResearch/… or the GGUF here: huggingface.co/NousResearch/…
Announcing Hermes 2 Pro on Llama-3 8B! Nous Research's first Llama-3 based model is now available on HuggingFace. Hermes Pro comes with Function Calling and Structured Output capabilities, and the Llama-3 version now uses dedicated tokens for tool call parsing tags, to make handling streaming function calls easier. This model surpasses Llama-3 8B Instruct on AGIEval, GPT4All Suite, TruthfulQA, and BigBench. Check it out here: huggingface.co/NousResearch/… GGUF quantized versions available here: huggingface.co/NousResearch/… The Hermes Pro models were built from the efforts and collaboration of @teknium, @intrstllrninja, @theemozilla, @karan4d, and @huemin_art; thanks as well to @ByteNano and @winglian for customizing axolotl to support our unique prompt formatting.
41
80
8
634
85,226
Jaigouk Kim retweeted
🚨 Breaking news: Google just introduced ScreenAI, and it's wild. This is going to transform the future of UX forever Here's everything you need to stay ahead of the curve: 🧵 👇
105
647
72
3,884
1,498,765
Jaigouk Kim retweeted
A crew writing crewAI docs, preparing the next version release 😎👉👉 and it does get more meta than this in some of out other crews
7
5
2
114
6,380
The way we do normal lora won't work bitnet, bcs we have to maintain property when lora weight are merged they can still be quantized into good ternary, we need littel reformulation in forward pass, so BitLora
4
16
1
113
10,336
We are releasing our first step in validating and independently confirming the claims of the Bitnet paper, a 1B model trained on the first 60B tokens of the Dolma dataset. Comparisons made on the @wandb charts below are between the Bitnet implementation and a full FP16 run (all hyperparameters equivalent). Model: huggingface.co/NousResearch/… Weights & Biases: api.wandb.ai/links/emozilla/…
24
151
31
894
227,518
For sometime, i have been using markdown files to organise ideas and thoughts. now that I have installed affine, it is way better to do that because it is combination of markdown with figma jam + notion.
1
1
53
Now, I just want to add agents to it
9
276
24,494
778
222,402
5,676,499
Jaigouk Kim retweeted
Open-sourcing "MindGraph", a proof of concept starter kit for building and querying against an ever-expanding knowledge graph with natural language! - multiple input types - simple interface - basic search/RAG against knowledge graph - easily extendable with integrations - basic database swapping GitHub in 🧵
44
270
26
1,813
243,407
you can now run function calling and json mode with @ollama thanks to @AdrienBrault 🔥
I have created and pushed @ollama models for Hermes 2 Pro 7B! ollama.com/adrienbrault/nous…
1
6
67
7,382
Introducing the latest version of our Hermes series of models, Hermes 2 Pro 7B. This latest version improves several capabilities, using an updated and cleaned version of the Hermes 2 dataset, and is now trained on a diverse and rich set of function calling and JSON mode samples, thus opening the door to much more reliable and robust agents. Download the model here: huggingface.co/NousResearch/… GGUF versions available here: huggingface.co/NousResearch/… This work was months in the making, and was built by the efforts and collaboration of @teknium, @intrstllrninja , @theemozilla, @karan4d, @huemin_art, and @FireworksAI_HQ; thanks as well to @ByteNano and @winglian for customizing axolotl to support our unique prompt formatting A special thanks to @Latitudesh for sponsoring the compute to make this model.
24
104
20
589
138,121
Jaigouk Kim retweeted
(Q)LoRA in MLX LM is also faster and more memory efficient thanks to: - compilation - better data packing - gradient checkpointing pip install -U mlx-lm Fine-tuning 4-bit Mistral 7B on an 8GB (!) M1 is actually quite doable:
3
37
4
259
20,317