
data and research at @lichess
Leipzig, Germany
Joined July 2009
- Tweets1.7K
- Following213
- Followers5.2K
- Likes36.4K
Interesting release by @jure Leskovec's group: RT-J (86M "relational transformer" ) and THE JOIN, a web-crawled corpus of 639 relational databases with 6K forecasting tasks. (data and models on @huggingface)
Can't get Schmidhubered if I Schmidhuber myself.
Everyone wants those AI scientists! But how possible is it for an LLM to generate novel research ideas rather than just optimizing hyperparameters (broadly construed)?
Building directly on the once novel work of @SchmidhuberAI!
Christopher Akiki retweeted
🚨 [Token][ization] Paper Alert 🚨
Tokenization is a wildly understudied area of language modeling despite it having effects across all of NLP. Over the past ~8 months, 32 (!) tokenizer researchers put together the most comprehensive survey of the field. Check it out!
Christopher Akiki retweeted
ChessLFM went full circle and is now on the home page of @lichess
Super cool to see, Lichess is where I collected all the seed data. Based on my limited chess skills, I never thought I'd have an article there.
t-SNE on SigLIP embeddings of 1,360 @OReillyMedia cover animals. The penguin cluster is my favorite.
O'Reilly animals sorted by orientation using PCA.
Image quilt of all @OReillyMedia book covers sorted by color.
Image quilt of all @OReillyMedia book covers sorted by color.
An image quilt of all @OReillyMedia animals.
An image quilt of all @OReillyMedia animals.
Christopher Akiki retweeted
single 5090 running parametric umap on 8 million points. getting ready to push to 16 million then 150 million 🌌
The McManifold
(2216 burger recipes as 146-dimensional ingredient vectors)
Using burgers as a model system, a generative AI system rediscovers the classic Big Mac without explicit supervision and generates novel burgers optimized for deliciousness, sustainability, or nutrition, according to a paper in npj Science of Food. go.nature.com/3SU7JDQ
work in progress: 1 million synthetic personas from @NVIDIAAI's Nemotron-Personas-USA dataset.
Been trying to reproduce datashader functionality using only Apache Arrow and Acero as a learning exercise.
This is a 1-billion point Clifford attractor rendered in ~8s from a 9GB parquet file. (No JIT)
























