data and research at @lichess

Leipzig, Germany
Joined July 2009
Interesting release by @jure Leskovec's group: RT-J (86M "relational transformer" ) and THE JOIN, a web-crawled corpus of 639 relational databases with 6K forecasting tasks. (data and models on @huggingface)
3
1
1
18
1,056
Can't get Schmidhubered if I Schmidhuber myself.
Everyone wants those AI scientists! But how possible is it for an LLM to generate novel research ideas rather than just optimizing hyperparameters (broadly construed)? Building directly on the once novel work of @SchmidhuberAI!
1
4
240
Christopher Akiki retweeted
🚨 [Token][ization] Paper Alert 🚨 Tokenization is a wildly understudied area of language modeling despite it having effects across all of NLP. Over the past ~8 months, 32 (!) tokenizer researchers put together the most comprehensive survey of the field. Check it out!
6
82
24
346
40,394
Christopher Akiki retweeted
ChessLFM went full circle and is now on the home page of @lichess Super cool to see, Lichess is where I collected all the seed data. Based on my limited chess skills, I never thought I'd have an article there.
4
1
56
3,618
Love this new slop option on linkedin. They seem to at least be self-aware.
5
571
Very interesting looking viz fail.
2
12
799
t-SNE on SigLIP embeddings of 1,360 @OReillyMedia cover animals. The penguin cluster is my favorite.
O'Reilly animals sorted by orientation using PCA.
3
16
127
7,215
O'Reilly animals sorted by orientation using PCA.
Image quilt of all @OReillyMedia book covers sorted by color.
15
189
13
2,441
196,964
Image quilt of all @OReillyMedia book covers sorted by color.
An image quilt of all @OReillyMedia animals.
1
10
1
180
206,010
An image quilt of all @OReillyMedia animals.
1
4
1
33
8,482
Christopher Akiki retweeted
single 5090 running parametric umap on 8 million points. getting ready to push to 16 million then 150 million 🌌
2
4
19
1,140
The McManifold (2216 burger recipes as 146-dimensional ingredient vectors)
Using burgers as a model system, a generative AI system rediscovers the classic Big Mac without explicit supervision and generates novel burgers optimized for deliciousness, sustainability, or nutrition, according to a paper in npj Science of Food. go.nature.com/3SU7JDQ
4
18
1,470
Some fun looking UMAP tomfoolery.
1
9
552
4 years ago today, BLOOM finished training.
▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓ 100%
2
1
25
3,328
10M Bohemian eigenvalues of all 19x19 {-1, 1} companion matrices.
6
286
work in progress: 1 million synthetic personas from @NVIDIAAI's Nemotron-Personas-USA dataset.
1
9
552
Been trying to reproduce datashader functionality using only Apache Arrow and Acero as a learning exercise. This is a 1-billion point Clifford attractor rendered in ~8s from a 9GB parquet file. (No JIT)
9
817
What's everyone using for their CPU-intensive data workflows? Modal? Lambda? Hetzner? Something else?
1
1
405