Pinned Tweet
What conditions should a system meet for life to emerge in it? This is the question that we tackled in this Artificial Life journal paper, available at
direct.mit.edu/artl/article/…. I am very proud of this work!👇Below, a walkthrough 🧵over its main aspects: 1/n
NEW EARLY ONLINE, "Emergence of Self-Reproducing Metabolisms as Recursive Algorithms in an Artificial Chemistry" by @germank & Tomáš Mikolov ...an article tackling a classic/fundamental #alife and #evolutionary problem. @alifeofficial @mitpress direct.mit.edu/artl/online-e…
Germán Kruszewski retweeted
Preference models (PMs), used in RLHF and best-of-n, are vulnerable to reward hacking. We show how to combine LM capabilities with human insight to make PMs more interpretable and reliable. A thread about our paper at arxiv.org/abs/2310.13011.
Germán Kruszewski retweeted
I have the feeling that the toolkit created by my talented colleagues hasn't yet received the attention it deserves, so I'm reintroducing their blog post on disco, designed for controling LLMs and other generative models!
europe.naverlabs.com/blog/di…
Germán Kruszewski retweeted
OMFG.
Turns out The Day After Tomorrow could possibly be the Year After Next?
We're hanging by a thread from full-scale #climate collapse that will be far, far worse than even our direst imaginings.
theguardian.com/environment/…
Germán Kruszewski retweeted
Take that in. Then try wrapping your head around the fact that we’re only seeing the beginning of a destabilising planet, while remembering that GHG emissions are still rising and the companies largely causing this are making record profits.
A bit concerning, don’t you think?
Germán Kruszewski retweeted
1/ Here's a🧵on why the record shattering extremes in Europe are so unsettling for climate scientists.
It's increasingly looking that we've underestimated the impacts of #ClimateBreakdown...
xitter.cf/WxNB_/status/168132472…
Germán Kruszewski retweeted
I wasn't aware of this, I just updated my settings! Truly a bummer right to have these changes happen right during ACL.
Germán Kruszewski retweeted
Presented this week at ACL (from NLP@NLE) (Outstanding demo paper) : disco: a toolkit for Distributional Control of Generative Models - ACL Anthology aclanthology.org/2023.acl-de…
In BPE any given string can be tokenized in (exponentially) many ways, but when you want to score the string's probability your language model tokenizer uses just one. Are you losing much by discarding all the rest? If you are at #ACL, go chat with @nadiinchi to find out!
I will present our #ACL paper “Should you marginalize over possible tokenizations?” on Wednesday, Jul 12, 11:00-12:30, at Poster session 7! Come to chat about tokenization in LMs. w/ @germank @josrzn @MarcDymetman. arxiv.org/abs/2306.17757
Very happy that 🪩#disco received an outstanding demo paper award at #ACL! You can check it out at github.com/naver/disco
By "it" I meant the library, but also the paper is available at aclanthology.org/2023.acl-de…
Germán Kruszewski retweeted
Outstanding!
If you happen to be in Toronto for ACL, you might want to disco on July 10 at 11am virtual2023.aclweb.org/paper…
Today at 11am @josrzn will be demoing our #disco library at #ACL! #disco is a one-stop solution for the control of language models that generalizes RLHF in an elegant way, providing much more fine-grained control. Don't miss it if you are there!
If you happen to be in Toronto for ACL, you might want to disco on July 10 at 11am virtual2023.aclweb.org/paper…
Germán Kruszewski retweeted
Today's global 2m temperature blasted through yesterday's all time record global high, reaching a new record high of 17.18°C. This is a full 1.64°C above the 1850-1900 IPCC baseline temperature for the day.
Hang on folks.
Germán Kruszewski retweeted
🔥🌊The whole 40,000,000 km² of the North Atlantic Ocean is 0.7°C warmer than ever on this date!🌊🔥
And 1.3°C warmer than average!😳📈
Germán Kruszewski retweeted
Check the news where you are.
Is anyone covering this?
Nothing in the UK
#ClimateCrisis
Germán Kruszewski retweeted
I've been hearing from people that it's a very challenging year for AI/CS grad school application. A few words:
First, I'm sorry many of you have to live through this; it's never fun receiving rejections.
Second, I don't expect the situation to improve in foreseeable future.
Germán Kruszewski retweeted
Over 100 governments in low- and middle-income countries have introduced anti-poverty cash transfer programs over the last 3 decades
In new research, we examined the effects of these initiatives on the ultimate health outcome — mortality
Published today in @Nature /1
































