
CS - PhD at SIANI-ULPGC. Researching LTM at @GoodAIdev. LLM whisperer. #DeepLearning #AI #ALife #Memetics También pongo boberías en español
Las Palmas de Gran Canaria
Joined December 2012
- Tweets5.2K
- Following214
- Followers392
- Likes42.3K
David Castillo retweeted
Ya disponible en @rtveplay el primer programa de UN NUEVO SENDERO HASTA EL MANANTIAL rtve.es/play/videos/un-nuevo…
Acabo de aprender por las malas que si compras un eléctrico de @VW_es y tiene un fallo de fábrica en el motor/reductora estás VENDIDO. Ni 4 años y 50.000 kms que tenía el coche...
David Castillo retweeted
Se ha filtrado el borrador de ley de universidades que está preparando la CAM. Si se aprueba, será la muerte de la universidad pública madrileña. Es escandaloso. No exagero. Se vienen tiempos oscuros como no espabilemos. Explico algunos puntos críticos. Va hilo. 👇
Somehow most people still have the flawed perception that changing the clock changes the sun dynamics🥲 the concept of having a single time zone and adjusting schedules locally simply escapes reason😓
David Castillo retweeted
An Efficient Alternative to Self-Attention
This paper presents FFTNet, a framework that replaces costly self-attention with an adaptive spectral filtering technique based on the Fast Fourier Transform (FFT).
Key components:
• Global token mixing via FFT – Instead of pairwise token attention, FFTNet uses frequency-domain transforms, cutting complexity from O(n²) to O(n log n) while preserving global context.
• Adaptive spectral filtering – A learnable filter dynamically reweights Fourier coefficients, letting the model emphasize important frequency bands similarly to attention weights.
• Complex-domain nonlinearity – A modReLU activation on the real and imaginary parts enriches representation, capturing higher-order interactions beyond linear transforms.
Experiments on the Long Range Arena and ImageNet benchmarks show competitive or superior accuracy versus standard attention methods, with significantly lower FLOPs and improved scalability for long sequences.
I'm genuinely surprised by grok's performance. It doesn't show any of Elon's biases (which is a great relief). Actually, it does show little bias in many aspects! My only surprise so far has been seeing it sprinkle some English words in the Spanish responses 😅
David Castillo retweeted
"Quiero confiar en la justicia, pero vivo en un país donde tienes presos a chavales como los 6 de Zaragoza por protestar contra el fascismo"
@menoscanas en @LaHoraTVE sobre el lawfare contra partidos políticos y movimientos sociales 👇🏽
David Castillo retweeted
Desde su casa de Agua Amarga, @JIDominguezFMD, abogado, también había visto el movimiento de máquinas en la playa de El Algarrobico. Tenía los planos oficiales, sabía que era suelo protegido. Y tampoco dudó en pedir explicaciones.
My today's realization: we think of ourselves as our body (what we control and feel), and that explains why we cherish so much our cars or good tools.
David Castillo retweeted
Remember Moravec's paradox?
"Corner cases".
"Long tails".
You can play whack-a-mole with them.
Or, you can confront their root causes directly.
Our new paper "Evolution and The Knightian Blindspot of Machine Learning" argues we should do the latter.
I think the tech is ready for us to start training on chars instead of tokens. With a good binary encoding an LLM can learn more from the same data. Example:
- Punctuation or not
- Letter or number
- Upper case flag
- Tilde modifier
- Hat modifier
- ...
David Castillo retweeted
Replying to @rohanpaul_ai
Deepseek will answer questions that western models will censor. I care more about that than chinese censor topics. I care less about how 'china isn't free' for models I use, to how the west isn't free.
I was well aware that @elonmusk always struggled with mental health, but man... he has really spiraled down in the last few years. #ElonMuskNazi













