Interested in the emergence of living, evolutionary, and cognitive systems.

Joined December 2007
What conditions should a system meet for life to emerge in it? This is the question that we tackled in this Artificial Life journal paper, available at direct.mit.edu/artl/article/…. I am very proud of this work!👇Below, a walkthrough 🧵over its main aspects: 1/n
NEW EARLY ONLINE, "Emergence of Self-Reproducing Metabolisms as Recursive Algorithms in an Artificial Chemistry" by @germank & Tomáš Mikolov ...an article tackling a classic/fundamental #alife and #evolutionary problem. @alifeofficial @mitpress direct.mit.edu/artl/online-e…
2
6
16
Germán Kruszewski retweeted
Preference models (PMs), used in RLHF and best-of-n, are vulnerable to reward hacking. We show how to combine LM capabilities with human insight to make PMs more interpretable and reliable. A thread about our paper at arxiv.org/abs/2310.13011.
1
10
3
66
10,626
Germán Kruszewski retweeted
I have the feeling that the toolkit created by my talented colleagues hasn't yet received the attention it deserves, so I'm reintroducing their blog post on disco, designed for controling LLMs and other generative models! europe.naverlabs.com/blog/di…
3
10
1,316
OMFG. Turns out The Day After Tomorrow could possibly be the Year After Next? We're hanging by a thread from full-scale #climate collapse that will be far, far worse than even our direst imaginings. theguardian.com/environment/…
323
1,498
209
4,217
681,162
Eternal sunshine of the spotless to-do list
129
Germán Kruszewski retweeted
Take that in. Then try wrapping your head around the fact that we’re only seeing the beginning of a destabilising planet, while remembering that GHG emissions are still rising and the companies largely causing this are making record profits. A bit concerning, don’t you think?
Our favorite planet has now seen 20 days in a row breaking the modern-day record high-temperature of 16.924°C (62.46°F) set on July 24, 2022. This global heatwave is likely the hottest 20-day stretch in the last 100,000+ years.
8,122
11,387
587
41,651
4,689,331
Germán Kruszewski retweeted
1/ Here's a🧵on why the record shattering extremes in Europe are so unsettling for climate scientists. It's increasingly looking that we've underestimated the impacts of #ClimateBreakdown... xitter.cf/WxNB_/status/168132472…
BREAKING: Rome, Italy just experienced its highest temperature in recorded history with 42.9°C (109.2°F). This beats the previous record from 2022 by 2 full degrees Celsius. That is a huge margin.
149
1,061
136
2,319
1,509,593
Life is not an accident
2
1
1
361
Germán Kruszewski retweeted
I wasn't aware of this, I just updated my settings! Truly a bummer right to have these changes happen right during ACL.
If you keep your DMs open to everyone (as message requests), please note that twitter has changed the default option to requests from verified users only+people you follow. Make sure to shift it to the last option (if you did not keep it at the first option previously).
1
11
4,621
Germán Kruszewski retweeted
Here's a short dynamics-based explanation of the equation e^(πi)=-1
57
955
129
5,806
538,247
In BPE any given string can be tokenized in (exponentially) many ways, but when you want to score the string's probability your language model tokenizer uses just one. Are you losing much by discarding all the rest? If you are at #ACL, go chat with @nadiinchi to find out!
I will present our #ACL paper “Should you marginalize over possible tokenizations?” on Wednesday, Jul 12, 11:00-12:30, at Poster session 7! Come to chat about tokenization in LMs. w/ @germank @josrzn @MarcDymetman. arxiv.org/abs/2306.17757
2
188
Germán Kruszewski retweeted
Outstanding!
If you happen to be in Toronto for ACL, you might want to disco on July 10 at 11am virtual2023.aclweb.org/paper…
1
3
10
738
Today at 11am @josrzn will be demoing our #disco library at #ACL! #disco is a one-stop solution for the control of language models that generalizes RLHF in an elegant way, providing much more fine-grained control. Don't miss it if you are there!
If you happen to be in Toronto for ACL, you might want to disco on July 10 at 11am virtual2023.aclweb.org/paper…
1
1
4
1,387
Today's global 2m temperature blasted through yesterday's all time record global high, reaching a new record high of 17.18°C. This is a full 1.64°C above the 1850-1900 IPCC baseline temperature for the day. Hang on folks.
62
443
69
1,222
148,227
Germán Kruszewski retweeted
🔥🌊The whole 40,000,000 km² of the North Atlantic Ocean is 0.7°C warmer than ever on this date!🌊🔥 And 1.3°C warmer than average!😳📈
119
894
211
2,076
486,229
Check the news where you are. Is anyone covering this? Nothing in the UK #ClimateCrisis
85
250
54
730
86,034
Germán Kruszewski retweeted
I've been hearing from people that it's a very challenging year for AI/CS grad school application. A few words: First, I'm sorry many of you have to live through this; it's never fun receiving rejections. Second, I don't expect the situation to improve in foreseeable future.
4
18
5
220
131,634
Over 100 governments in low- and middle-income countries have introduced anti-poverty cash transfer programs over the last 3 decades In new research, we examined the effects of these initiatives on the ultimate health outcome — mortality Published today in @Nature /1
34
532
119
1,619
504,973