Fiddling bits since 2342 @virtualvoid@hachyderm.io
Joined January 2009
- Tweets487
- Following296
- Followers1.5K
- Likes528
Pinned Tweet
My job as a Rust Engineering Lead at a startup became victim of restructuring and I'm looking for a new role.
I enjoy working on infra software, Open Source, with Rust, Scala, or whatever is needed. I'm also available contractually to support previous libs like Pekko Http.
Almost 50 years ago mastermind Loriot created this visualization of what happens during a rolling upgrade if you implemented sharding naively (w/o consistent hashing) dailymotion.com/video/x2x2dh…
In other news, I won another prize at the Vesuvius Challenge for vesuvius-gui, an interactive browser for 3D volumes (like the vesuvius scrolls) written in Rust with egui. Thanks a lot to challenge team! scrollprize.substack.com/p/m…
Congratulations to the May Progress Prize winners for contributions towards reading the Herculaneum scrolls!! scrollprize.substack.com/p/m…
Thank you, @scrollprize, for awarding me a prize in the Vesuvius Challenge for my Open Source contributions cataloguing released segments and running OS ink detection models on them. It has been a fun journey and great collaboration! blog.virtual-void.net/2023/1…
Johannes Rudolph retweeted
Amazing contributions to the @scrollprize @spacegaier, @virtualvoid and others and congrats for the prizes won! scrollprize.substack.com/p/m…
A short report on trying out different algorithms for selecting top-p elements from a distribution (aka Nucleus Sampling): blog.virtual-void.net/2023/0…
Mmh, @hetzner cloud volume hangs while unmounting since one hour. No more actions on the server are possible, after shutting the node down other mounted volumes are also blocked, server cannot be restarted. Big share of cluster storage is unavailable => extended downtime.
The whole point of cloud volumes is to be able to view storage detached from compute. Optimally, storage can be easily migrated to new compute in cases of problems. Quite a bummer if storage cannot be relocated in cases like this... @Hetzner_Online
llama2.scala now has quantization support, AVX2 kernels, multithreading and can load some GGML models directly. github.com/jrudolph/llama2.s…
Also, the day, when you first run a code generation model on your engine asking for suggestions about how to improve algorithms of the underlying engine 🤯 (the suggestions are mostly weird and broken, admittedly, but had some ideas to follow up) gist.github.com/jrudolph/fb7…
Johannes Rudolph retweeted
Apache Pekko Http 1.0.0 has been released, see pekko.apache.org/download.ht… and pekko.apache.org/docs/pekko-… for more details.
Apache Pekko Http also includes Scala 3.3 support, the result of an ongoing community effort that spanned years!
A Scala port of @karpathy's llama2.c: github.com/jrudolph/llama2.s… Even without optimizations performance is surprisingly acceptable (-6%, single-threaded on GraalVM). Example: asciinema.org/a/599946
Johannes Rudolph retweeted
Apache Pekko 1.0.0 has been released, see pekko.apache.org/download.ht… and pekko.apache.org/docs/pekko/… for more details.
Its been a long road, many thanks to everyone who participated in this!
TIL: "boots often had boot straps on the top, physical straps to help pull the boots on. [...] the saying "No man can lift himself by his own boot straps" was used as a metaphor for the impossibility of improvement solely through one's own effort." - footnote 8 of a great article
The 8086 microprocessor is almost 45 years old, but the x86 architecture still rules computing. I'm reverse engineering the 8086 by studying its silicon die under a microscope. This thread looks at one of its unusual circuits: the bootstrap driver.🧵
ALT Die photo of the 8086 microprocessor. The metal layer on top of the silicon is visible. Around the edge of the chip, bond wires provide connections to the chip's external pins.
ALT Closeup die photo of the 8086 showing bootstrap driver circuits. The metal layer has been removed to show the silicon and poly silicon underneath.
I wrote up some notes about my experiments of getting started with io_uring: blog.virtual-void.net/2022/1… (it contains a bit of example code of getting started with it in Scala without requiring C code).
Recently, our album POP! was awarded the "Best Non-Scholastic Debut Album" in the 2022 CARAs. Also, Twäng just won the AAVF competition (alas, without me). High time for my post about how I built the blinky sign for Twäng last year: blog.virtual-void.net/creati…
A quick write up of a deep-dive debugging session from this week at work, tracing back latency spikes in a Yugabyte cluster during a load test: gist.github.com/jrudolph/be4…
Published a fun exploration about the maximum compression rate in gzip: blog.virtual-void.net/maximu… (actually written and forgotten a long while ago...)
Inspired by @NieDzejkob's miniforth project, I started building my own little machine based on a RPi Pico. I passed a milestone today being able to do some actual programming directly on it. github.com/jrudolph/picofort…