Thinking about how my brain thinks

Joined May 2013
ChinniKrishna retweeted
Did you see @velaura_ai during your Bay Area commute down US-101? If not, now’s your chance. Most billboards on 101 promote bigger AI promises, but ours is doing something different. While other billboards scream for more, we’re advocating for less: less power, that is. Velaura AI is advancing ultra low power technology to improve performance per watt across AI data centers and power constrained physical AI applications. If you're driving through the Bay Area on US-101, look up (safely) and find the @velaura_ai billboard for a limited time! #NYSE #VelauraAI #Funding
5
9
659
LLMs are proficient in deciphering patterns while detached from the physical realm. Delve into the intricacies of this concept in my essay "The Ungrounded Flavor". Read here: highentropythoughts.substack… Feedback welcome! #AI #LLMs #CognitiveScience #PhilosophyOfAI
1
1
2
142
@Plinz @GaryMarcus @rao2z I'd love your thoughts on this—your work has inspired it.
1
2
118
So Physics is figuring out "Ultimate transformation" which takes current state of universe at t and outputs state at t+1? #Physics #ComplexSystems #Time #ScienceHumor #PhilosophyOfScience #Emergence #Computation
1
1
134
Ever wonder why we use transposes in backprop? It’s a reflection of dual spaces. The transpose maps output gradients back to input measurements. Read all about it here highentropythoughts.substack… #DeepLearning #LinearAlgebra #Backpropagation #MathTwitter #AI #ML
1
1
162
Self-attention is nothing more than a kernelised, normalised, content read-out operator. #LLMs
1
1
144
Feeling comfortable is the most uncomfortable feeling ever
216
ChinniKrishna retweeted
Working in AI means I frequently see people I have never heard of presented as "leaders in the field" or having made "fundamental contributions". Probably because the field is so vast, and no-one knows what really qualifies as AI. But also because of: narcissists+sycophants+$$$
7
6
2
133
While exploring what my TV antenna receives I took a quick detour to make a simple AM radio using python and numpy. Quick shoutout to @DigilentInc for not only making affordable USB scopes but also giving access to their API with very detailed documentation. #sdr
1
2
Link to the blog post detailing how I did it chinnikrishna.github.io/blog…
Thinking about a problem from first principles is both a gift and curse. Gift because you have a new insight, curse as very few might get it or appreciate it. #MachineLearning #ArtificialIntelligence #causalmodel
1
3
Microsoft researchers & collaborators created an open-source library to explore “what-if” scenarios for machine learning models. Learn how their method generates multiple diverse counterfactuals at once and gives insight into ML algorithm decision making: aka.ms/AA75k8p

1
110
17
349
Change is my constant companion.
2
ChinniKrishna retweeted
Announced today–The Intel Nervana NNP-T, the Intel NNP-I, and the future @IntelMovidius VPU enable larger, more complex AI algorithms and elevate the reasoning & context missing from today’s AI in the cloud, on the edge, or an IoT device. intel.ly/34Udtzd #IntelAI
ChinniKrishna retweeted
The code is open-sourced as part of our NLP Architect library: github.com/NervanaSystems/nl…. Work by @MosheWasserblat, @peter_izsak and others. #IntelAI
BERT coming to small compute devices? “We show how quantization-aware training during the fine-tuning phase of BERT can compress it down by 4×. The quantized model can accelerate inference speed if it is optimized for 8bit Integer supporting hardware.” arxiv.org/abs/1910.06188
2
7
Perspective matters.
44
2,302
115
8,548
ChinniKrishna retweeted
Using gradient descent for everything xitter.cf/danhett/status/1176116…
41
418
50
2,337