Ariel Ekgren (@ArYoMo) header
Ariel Ekgren (@ArYoMo) profile picture

Building @hybridity_ai ex LLM researcher

Stockholm, Sweden
Joined April 2013
Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)Photo by Ariel Ekgren (@ArYoMo)
Ariel Ekgren retweeted
I’ve worked that heatshield my entire adult life. Peak career moment today To go from little 7 tile patches to a full reusable ship. Absolute marathon I’m so grateful I got to do something useful, that I was given the chance I don’t really have many good memories from this experience. It was so difficult. It almost looks easy now, but none of it came easily Please do something amazing with this rocket. This tech is such a gift, a love letter to the species
1,111
2,573
172
31,536
562,797
Ariel Ekgren retweeted
The constant decel messaging in Europe is insufferable as an adult, but its effect on kids is worse. As a parent, it's your obligation to counterprogram this nonsense. Show them robots, rockets, and wonders of AI. Show them cathedrals and moon landings. Instill hope in progress.
203
704
74
8,920
285,997
Ariel Ekgren retweeted
Replying to @francoisfleuret
It's all computation. Math is just a game we play to reason about some simpler parts of computation.
7
4
4
66
63,459
Ariel Ekgren retweeted
New Anthropic research: A global workspace in language models. Of everything happening in your brain right now, only a tiny fraction is consciously accessible—thoughts you can describe, hold in mind, and reason with. We found a strikingly similar divide inside Claude.
1,385
3,915
2,071
28,346
10,763,134
Ariel Ekgren retweeted
Announcing a new division of Midjourney called "Midjourney Medical"
2,468
4,973
4,090
39,392
18,965,346
Ariel Ekgren retweeted
not enough people are emotionally prepared for if it’s not a bubble
485
842
371
11,980
2,370,446
Ariel Ekgren retweeted
LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote server + self-replicate. link below
294
2,190
605
9,182
5,925,542
"developed" is such a lie. You are either growing, or dying.
Every country on Earth *should* be growing like China. Nobody else is.
123
227
50
1,841
7,304,999
Ariel Ekgren retweeted
The EU initiative Going Dark has now been launched by the EU Commission. They call it ProtectEU. It’s a rebranding of Chat Control. New name. Same old propaganda. The EU Commission’s goal is to “access encrypted data in a lawful manner, safeguarding cybersecurity and fundamental rights.” Read the full release from the Commission here: eur-lex.europa.eu/legal-cont…
85
656
99
2,513
259,507
Ariel Ekgren retweeted
Today, I see the world as a jungle, a constant struggle between all sorts of people and groups. The divine force field of justice is a childish hallucination, and instead we have a never ending negotiation between decency, incentives, existing power, decay, ideas and innovation.
9
23
1
296
5,967
Put your work on arXiv and release 100% of your code/data/Mathematica notebooks/etc., packaged up in such a way that *anyone* can reproduce all of your results in a single click. Call out people who don’t. That’s what peer review should look like in the 21st century.
Academic journals are nothing but a nuisance for theoretical work and should be a thing of the past
62
338
48
2,627
222,964
Ariel Ekgren retweeted
Mathematics can be understood as a way to formalize and codify the way in which minds (not just human ones) represent. Gödel and Turing demonstrated the failure of the nonconstructive branch. What’s left is constructive mathematics (computation).
52
31
8
355
26,625
Mario Draghi's new report on EU competitiveness doesn't mince words. "Across different metrics, a wide gap in GDP has opened up between the EU and the US, driven mainly by a more pronounced slowdown in productivity growth in Europe. Europe’s households have paid the price in foregone living standards. On a per capita basis, real disposable income has grown almost twice as much in the US as in the EU since 2000." "First – and most importantly – Europe must profoundly refocus its collective efforts on closing the innovation gap with the US and China, especially in advanced technologies. Europe is stuck in a static industrial structure with few new companies rising up to disrupt existing industries or develop new growth engines. In fact, there is no EU company with a market capitalisation over EUR 100 billion that has been set up from scratch in the last fifty years, while all six US companies with a valuation above EUR 1 trillion have been created in this period. This lack of dynamism is self-fulfilling." "There are not enough academic institutions achieving top levels of excellence and the pipeline from innovation into commercialisation is weak. [...] However, while the EU boasts a strong university system on average, not enough universities and research institutions are at the top. Using volume of publications in top academic science journals as an indicative metric, the EU has only three research institutions ranked among the top 50 globally, whereas the US has 21 and China 15." "Regulatory barriers to scaling up are particularly onerous in the tech sector, especially for young companies. Regulatory barriers constrain growth in several ways. First, complex and costly procedures across fragmented national systems discourage inventors from filing Intellectual Property Rights (IPRs), hindering young companies from leveraging the Single Market. Second, the EU’s regulatory stance towards tech companies hampers innovation: the EU now has around 100 tech-focused laws and over 270 regulators active in digital networks across all Member States. Many EU laws take a precautionary approach, dictating specific business practices ex ante to avert potential risks ex post. For example, the AI Act imposes additional regulatory requirements on general purpose AI models that exceed a pre-defined threshold of computational power – a threshold which some state-of-the-art models already exceed. Third, digital companies are deterred from doing business across the EU via subsidiaries, as they face heterogeneous requirements, a proliferation of regulatory agencies and “gold plating” of EU legislation by national authorities. Fourth, limitations on data storing and processing create high compliance costs and hinder the creation of large, integrated data sets for training AI models. This fragmentation puts EU companies at a disadvantage relative to the US, which relies on the private sector to build vast data sets, and China, which can leverage its central institutions for data aggregation. This problem is compounded by EU competition enforcement possibly inhibiting intra-industry cooperation. Finally, multiple different national rules in public procurement generate high ongoing costs for cloud providers. The net effect of this burden of regulation is that only larger companies – which are often non-EU based – have the financial capacity and incentive to bear the costs of complying. Young innovative tech companies may choose not to operate in the EU at all." More: commission.europa.eu/documen….
Dear Mario Draghi, a year ago, I asked you to prepare a report on the future of Europe’s competitiveness. No one was better placed than you to take up this challenge. Now, we are eager to listen to your views ↓ xitter.cf/i/broadcasts/1mnxeAPOD…
681
2,507
771
11,620
13,038,307
Ariel Ekgren retweeted
Actually this was really good - a tour from one transistor to a small CPU (Scott CPU, to be precise). The YouTube playlist: youtube.com/watch?v=HaBMAD-D… I also haven't yet come across the "But How Do It Know" by Scott, which this is based on, and which looks great: amazon.com/But-How-Know-Prin… Turns out this is a whole deeper rabbit hole of people who've also built + simulated it in code, e.g.: djharper.dev/post/2019/05/21… Now I must resist the temptation to simulate Scott CPU in C, add tensor cores to it, move it to an FPGA and get it to inference a Llama.
if you want to understand how computers work at the hardware level. I've seen the first video banger so far.
106
628
27
4,859
464,295
Ariel Ekgren retweeted
Brexit may yet turn out to have been a good idea, if it means the UK can be the Switzerland of AI.
130
106
47
1,568
238,005
Ariel Ekgren retweeted
Bias is in the eye of the beholder. Yann LeCun says it is impossible to produce an unbiased AI system, so the solution is a free and diverse range of models
54
114
64
603
425,463
Ariel Ekgren retweeted
I think assuming you’ll get gpt-4 or even gpt-3.5 level quality in a sub 7B LLM is a mistake. Problem is it might do well on benchmarks but then you start using it and realize there’s all these edge cases it doesn’t handle well - does not generalize as well as the larger models
43
24
4
539
88,440
Tfw you realize they said this about everything for centuries
5
14
2
148
173,968
I just found out that @AISweden has continued to do amazing things and trained a 20B and 40B model! Very excited to brag about all y'all's excellent work in the future :) Also, you should add your eval benchmarks to the LM Eval Harness!
1
2
1
11
2,496