David Kohler (@dkohlkat) header
David Kohler (@dkohlkat) profile picture
Pittsburgh, PA
Joined November 2013
David Kohler retweeted
There's a critical Linux kernel vulnerability on kernels 4.4+, affecting any unpatched Linux server in the world with an open IPv4 TCP port. 🧵 For XRP Ledger node and validator operators: If you run RHEL 8/9/10, Debian 12/13, Amazon Linux and Oracle UEK then there's a fix already shipped, just update and reboot. You can end the thread 🧵 here. If you run Ubuntu, AlmaLinux, Rocky, CentOS Stream then please continue and follow these steps:
17
66
6
345
23,962
David Kohler retweeted
DeepSeek V4.1 Flash (748B) at 40 tok/s prefill + 10 tok/s decode, Kimi K3 (2.8T) at 5 tok/s. The first thousand-dollar-level device that can actually locally deploy the frontier models — thanks to WiCi’s SSD innovations! Your data and sparkling thoughts never leave your box. youtu.be/3_dvktFloOQ
1
11
286
David Kohler retweeted
Today, Google announced Gemini. Yes you read that right.
Today at Google Cloud’s Gemini at Work event, we announced Gemini, a new single universal agent for work that has all of your business context and can be used for everything from knowledge work to answering questions, and content creation to coding, all from a single prompt box. It’s built around core architectural principles: ☑️ Unified Agent: Gemini can answer questions, do knowledge work and generate code from a single prompt box. ☑️Access: Gemini is web-based and can be accessed from any device and integrated into third-party applications. It can also operate without a dedicated user interface. ☑️Persistent Execution: It runs in the cloud, which means it maintains a single set of memories, context and one personalization graph no matter where you access it. ☑️Multi-Agent Orchestration: Gemini can create sub-agents to tackle multi-step tasks and can also act as a coworker agent with a defined role and its own dedicated identity ☑️Context: Gemini knows your tools, data, and work history and learns how you work the more you use it. ☑️Model Choice Flexibility: It orchestrates across multiple models to deliver optimal quality and lower your costs.
277
132
34
8,114
595,200
David Kohler retweeted
The Kimi K3 architecture figure for yesterday's big open-weight model release, along with some observations and thoughts. 1. Yes, it looks relatively complicated, but it's essentially a scaled-up production version of their Kimi Linear model they released last year (scaled up from 48B -> 2.8T; K3 is by far the biggest open-weight model right now) 2. The one new component compared to Kimi Linear is the LatentMoE. I omitted it in the figure below since it's already very crowded, but that's essentially the same LatentMoE as in Nemotron 3 Ultra (you can find it in my LLM Architecture Gallery if you are curious). The idea here is to compress (down-project) large linear layers similar to multi-head latent attention. 3. Kimi K3's overall trend (similar to Nemotron 3, DeepSeek V4, and others) is also towards better inference efficiency. That is, there are many components that replace existing components with efficiency-tweaked versions. I.e., MoE -> LatentMoE, regular attention -> multi-head latent attention and Kimi Delta Attention. (I also have short tutorials and write-ups in my gallery if you are curious about additional details). 4. The one component change that is not an efficiency tweak is attention residuals. Like DeepSeek V4 improved the residual path with mHC (manifold-constrained Hyper-Connections), attention residuals are a way to improve the residual path, but it works a bit differently. I.e., mHC made the residual path wider. Attention residuals (also already part of Kimi Linear) connect the residuals across layers; the connection itself uses an attention score for an important/contribution weight. According to the report, it improves the validation loss and downstream performance (a bit) consistently and adds about 4% in training cost and 2% in inference cost. 5. Interestingly, Kimi K3 got rid of all RoPE layers and uses NoPE (No Positional Embeddings) everywhere instead. (Again, this is inherited from Kimi Linear). In other architectures, the recent trend was towards RoPE in local attention layers (like sliding window attention) and NoPE in the global layers. There were a few architectures that only used NoPE everywhere, but this is the first frontier-level one as far as I know. 6. Kimi K3 now also has native multimodal support, which is great! There are several other interesting training tidbits in the technical report, but that's it from the architecture front so far. A really great release overall.
105
615
30
4,065
239,853
David Kohler retweeted
hello there the jacobian conjecture is false thanx to my close friend akhil for asking about it and my other close friend fable for working during the world cup final ((1+xy)^3 z + y^2 (1+xy) (4+3xy), y + 3 x (1+xy)^2 z + 3 x y^2 (4+3xy), 2 x - 3 x^2 y - x^3 z): \C^3\to \C^3, has jacobian determinant -2, and sends (0, 0, -1/4), (1, -3/2, 13/2), and (-1, 3/2, 13/2) to (-1/4, 0, 0)
1,698
5,363
3,157
43,859
40,135,495
David Kohler retweeted
I have made a repository with landing page where the three approaches by @__alpoge__, @davikrehalt and @aaron_lou to the Jacobian Conjecture counterexample are uniformly explained. There is a video tutorial and a Jupyter Book. Feel free to share and expand or modify. Comments welcome. The video was done with the new Manim Voiceover feature based on the actual review paper. Landing page: nasqret.github.io/jacobian-c… GitHub repo: github.com/nasqret/jacobian-… Knowledge book: nasqret.github.io/jacobian-c…
6
35
3
223
44,229
(flirting with you) *bites your arm* *bites your arm* *bites your arm* *bites your arm* *bites your arm* *bites your arm* *bites your arm* *bites your arm* *bites your arm* *bites your arm* *bites your arm*
Aquarium visitors were startled to see a leopard shark trying to bite off another shark’s fin Staff explained it wasn’t aggression but normal… flirting — this is how sharks show interest in each other.
249
11,420
653
91,272
3,526,004
David Kohler retweeted
Today is my last day at Anthropic. I resigned. Here is the letter I shared with my colleagues, explaining my decision.
2,443
5,257
1,983
37,085
15,385,482
David Kohler retweeted
this guy has 29 models on huggingface at page 2 ranking. no lab behind him. no sponsorship. $2,000 from his own pocket on GPU rentals. he compressed GLM-4.7 to run on a MacBook and quantized Nemotron Super the week it dropped. all public. all free. nvidia is a trillion dollar company with hundreds of teams but they are not the ones quantizing models middle of the night and pushing them out before sunrise. if nvidia stopped tomorrow their employees stop working. people like @0xSero would not. that is the difference between a paycheck and a mission. @NVIDIAAI you talk about making AI accessible. the people actually doing it are right here. 29 models deep burning their own compute with no ask except more hardware to keep going. you do not need to build another program. just look at who is already building for you. one GPU to this man would produce more public value than a hundred internal sprints. i am not asking for charity. i am asking you to invest in someone who already proved it.
Putting out a wish to the universe. I need more compute, if I can get more I will make sure every machine from a small phone to a bootstrapped RTX 3090 node can run frontier intelligence fast with minimal intelligence loss. I have hit page 2 of huggingface, released 3 model family compressions and got GLM-4.7 on a MacBook huggingface.co/0xsero My beast just isn’t enough and I already spent 2k usd on renting GPUs on top of credits provided by Prime intellect and Hotaisle. ——— If you believe in what I do help me get this to Nvidia, maybe they will bless me with the pewter to keep making local AI more accessible 🙏
170
1,065
66
12,074
766,672
David Kohler retweeted
5' 2'' Nazi commander Greg Bovino thought he and his Gestapo posse of pussies were going to be able to take a piss in peace at Target — but the fascist shitstain was mistaken. 😂🤣😂🤣😂🤣👇
2,722
8,737
696
54,520
3,245,367
I think Elon Musk should be expelled from the British Royal Society. Not because he peddles conspiracy theories and makes Nazi salutes, but because of the huge damage he is doing to scientific institutions in the US. Now let's see if he really believes in free speech.
2,041
3,178
390
23,228
2,022,373
David Kohler retweeted
Figure Ends Collaboration with OpenAI, Shifts to Open-Source Models!
2
5
39
1,944
When my dad got cancer they tried to kick him off his insurance so as he was dying his life was paperwork and phone calls 👍
He took the life of a dad who did nothing to him and has *ZERO* remorse. This is your hero?
2,589
56,704
642
900,332
45,841,667
arXiv -> alphaXiv Students at Stanford have built alphaXiv, an open discussion forum for arXiv papers. @askalphaxiv You can post questions and comments directly on top of any arXiv paper by changing arXiv to alphaXiv in any URL!
122
1,801
364
6,862
914,437
David Kohler retweeted
Amazon is a broken mess. I have done over $50,000,000 on amazon. They dont care about me as a seller, partner, or person. I uploaded this design patent Was told “stop contacting me” What went wrong inside amazon? why do they hate small businesses and the law? A thread:
1,003
1,911
510
27,674
6,439,521
A mostly complete graph of Neural Networks.
27
533
32
4,175
503,275
2/ Microcosm @websim_ai-style simulator of a virtual world with live news feeds, stock markets, a simulated Wikipedia, and Twitter agents Create entire virtual world simulations with a single prompt (and in the style of Windows 95) @onetwoval
1
18
5
388
63,698
David Kohler retweeted
It seems to me that before "urgently figuring out how to control AI systems much smarter than us" we need to have the beginning of a hint of a design for a system smarter than a house cat. Such a sense of urgency reveals an extremely distorted view of reality. No wonder the more based members of the organization seeked to marginalize the superalignment group. It's as if someone had said in 1925 "we urgently need to figure out how to control aircrafts that can transport hundreds of passengers at near the speed of the sound over the oceans." It would have been difficult to make long-haul passenger jets safe before the turbojet was invented and before any aircraft had crossed the atlantic non-stop. Yet, we can now fly halfway around the world on twin-engine jets in complete safety. It didn't require some sort of magical recipe for safety. It took decades of careful engineering and iterative refinements. The process will be similar for intelligent systems. It will take years for them to get as smart as cats, and more years to get as smart as humans, let alone smarter (don't confuse the superhuman knowledge accumulation and retrieval abilities of current LLMs with actual intelligence). It will take years for them to be deployed and fine-tuned for efficiency and safety as they are made smarter and smarter.
Replying to @janleike
Stepping away from this job has been one of the hardest things I have ever done, because we urgently need to figure out how to steer and control AI systems much smarter than us.
496
1,069
405
6,888
2,120,869
David Kohler retweeted
The mysterious AI called “gpt2-chatbot” is back as "im-a-good-gpt2-chatbot" Capabilities seem to exceed GPT-4, Gemini 1.5, Claude, and anything else currently available. Here's EVERYTHING you need to know (and how to try it for free):
60
285
30
2,581
1,244,305