CS - PhD at SIANI-ULPGC. Researching LTM at @GoodAIdev. LLM whisperer. #DeepLearning #AI #ALife #Memetics También pongo boberías en español

Las Palmas de Gran Canaria
Joined December 2012
Acabo de aprender por las malas que si compras un eléctrico de @VW_es y tiene un fallo de fábrica en el motor/reductora estás VENDIDO. Ni 4 años y 50.000 kms que tenía el coche...
1
44
#apagon en península, por fin llega la jornada de 6 horas!
2
1,397
David Castillo retweeted
Se ha filtrado el borrador de ley de universidades que está preparando la CAM. Si se aprueba, será la muerte de la universidad pública madrileña. Es escandaloso. No exagero. Se vienen tiempos oscuros como no espabilemos. Explico algunos puntos críticos. Va hilo. 👇
408
3,534
375
5,857
895,466
Somehow most people still have the flawed perception that changing the clock changes the sun dynamics🥲 the concept of having a single time zone and adjusting schedules locally simply escapes reason😓
Very hard to understand why anyone would want this. Who cares about an hour of extra sun in the morning. But eliminating days where the sun sets before 5 sounds amazing. Don’t you want your kids to play outside after school? Sports, bike rides, family walks.
1
1
256
David Castillo retweeted
An Efficient Alternative to Self-Attention This paper presents FFTNet, a framework that replaces costly self-attention with an adaptive spectral filtering technique based on the Fast Fourier Transform (FFT). Key components: • Global token mixing via FFT – Instead of pairwise token attention, FFTNet uses frequency-domain transforms, cutting complexity from O(n²) to O(n log n) while preserving global context. • Adaptive spectral filtering – A learnable filter dynamically reweights Fourier coefficients, letting the model emphasize important frequency bands similarly to attention weights. • Complex-domain nonlinearity – A modReLU activation on the real and imaginary parts enriches representation, capturing higher-order interactions beyond linear transforms. Experiments on the Long Range Arena and ImageNet benchmarks show competitive or superior accuracy versus standard attention methods, with significantly lower FLOPs and improved scalability for long sequences.
9
86
11
515
55,420
I'm genuinely surprised by grok's performance. It doesn't show any of Elon's biases (which is a great relief). Actually, it does show little bias in many aspects! My only surprise so far has been seeing it sprinkle some English words in the Spanish responses 😅
1
1
52
but it's really good. It passed the anti-woke and capitalist tests 👌
1
20
David Castillo retweeted
"Quiero confiar en la justicia, pero vivo en un país donde tienes presos a chavales como los 6 de Zaragoza por protestar contra el fascismo" @menoscanas en @LaHoraTVE sobre el lawfare contra partidos políticos y movimientos sociales 👇🏽
96
1,183
28
2,268
59,273
David Castillo retweeted
Desde su casa de Agua Amarga, @JIDominguezFMD, abogado, también había visto el movimiento de máquinas en la playa de El Algarrobico. Tenía los planos oficiales, sabía que era suelo protegido. Y tampoco dudó en pedir explicaciones.
1
6
1
19
2,030
My today's realization: we think of ourselves as our body (what we control and feel), and that explains why we cherish so much our cars or good tools.
1
44
David Castillo retweeted
Remember Moravec's paradox? "Corner cases". "Long tails". You can play whack-a-mole with them. Or, you can confront their root causes directly. Our new paper "Evolution and The Knightian Blindspot of Machine Learning" argues we should do the latter.
2
28
1
123
21,275
Liberar un campo de concentración. Ya saben, cosas "woke" de esas.
22
68
1,710
I think the tech is ready for us to start training on chars instead of tokens. With a good binary encoding an LLM can learn more from the same data. Example: - Punctuation or not - Letter or number - Upper case flag - Tilde modifier - Hat modifier - ...
44
David Castillo retweeted
Replying to @rohanpaul_ai
Deepseek will answer questions that western models will censor. I care more about that than chinese censor topics. I care less about how 'china isn't free' for models I use, to how the west isn't free.
98
62
5
2,590
348,691
I just broke deepseek😅That arrow tail goes to infinity
1
74
The amazing thing is that LLMs learn anything at all with this mess that we call tokenization.
1
30
I was well aware that @elonmusk always struggled with mental health, but man... he has really spiraled down in the last few years. #ElonMuskNazi
1
3
108