Pinned Tweet
我也是尊贵的codex贡献者了。
开发londobell途中发现了个codex的bug,让londobell帮我用npm测试—〉check out repo本地编译测试—〉提修正—》提issue—〉提PR,我出门搭个电车的功夫它全办好了。刚才一看已经都被merge了🤣
就是不知道对面审这个PR的是不是也是AI。
github.com/openai/codex/pull…
趁着codex app公开的时机,vibe了一个适合我这种喜欢躺着在手机上coding的人的remote codex/cc工具。
除了慢,什么都好😌自用足够了(记得以前 @dxhuang 好像做过类似的东西)。
这世界越来越像混球比较容易成功的世界了。
田某这种无道德又违法还不知道是不是真有技术的居然也能to VC成功。
牢田这个事情 ,真实是字节法务太菜了,那么多实锤证据,但凡有华为/腾讯法务一半的实力, 牢田都不会在这里装模作样,还能发誓做英雄了。
keyu-tian-sabotage.github.io…
关于ai回答难懂,karpathy说的后面的“更好的办法”要么是太面向人类,要么是已经被模型做进去了(比如6.1sol最近开始主动生成html了),反而是第一个方法已经够用且对于ai和人类都适用。
另外别看ASD-STE100标准很难懂,其实的名称叫做:Simplified Technical English
We'll be spending a lot more time trying to understand the outputs of language models. A few thoughts, tips & tricks:
Writing. Something I've had success with: Ask your LLM to explain something in ASD-STE100, it's a controlled language specification originally developed for aerospace maintenance documentation. LLMs well-versed in this language and it comes with heavy constraints on clean writing style that I often find a lot more readable. Sometimes I've tried to soften it a bit e.g. ask for "80% of the way to ASD-STE100" because the spec is quite stringent. But even better:
Diagrams / images. Instead of writing, ask your LLM to create a diagram. These can be a lot easier to process, parse, and understand. But even better:
Web pages. Ask for output "in HTML" to get a beautiful, interactive webpage. LLMs are getting really good at frontend and can create beautiful experiences, animations, etc. But even better:
Explainer videos. The output format I am most bullish on is fully custom / bespoke explainer videos generated on any arbitrary topic. Experiment with things like "Create a 3b1b style video explainer on X. Use my ElevenLabs API key for audio narration". (you'd need an API key for the latter or you can ask your LLM to find you decent free alternatives that use your local compute). This is actually starting to work!
In summary:
- As LLMs get better, they will do more and more of the legwork autonomously, and a lot more of our work will rise up the abstractions into oversight and understanding.
- Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.
NerdC retweeted
LLM 的速度,有两种体验:等多久开始回答,回答时是否流畅。 两种体验,与 Prefill 和 Decode 密切相关。
从发出请求到收到第一个 token,这段等待叫 TTFT,首 token 反应时间。
模型在其中进行 prefill,处理输入内容
开始回答后,模型通过 decode 逐步生成后续 token,相邻两个 token 到达的间隔叫 ITL,token间延迟。
TTFT 越短,反应越快;ITL 越短且越稳定,回答就越流畅。
啊?Jeff dean要离开google了?
Google的ai不会落得和meta一个下场吧
Announcing Discovery Loop!
I am very excited to announce that, along with my longtime friends and collaborators @Sanjay_Ghemawat, @OriolVinyalsML and @quocleix, we are founding Discovery Loop (@DiscoLoopAI), a Public Benefit Corporation whose mission is to automate machine learning, science, and engineering to accelerate discoveries and progress. The four of us have worked together for 14 to 30 years, and have helped build some of the world’s most used products, infrastructure and AI models, and we’re excited to turn our attention to this ambitious endeavor.
♾
Learn more at: discoveryloop.com
老黄也来推特了😄
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter.
AI will transform every industry, power every company, and be built by every country.
Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.
The world needs both frontier closed models and frontier open models.
images.nvidia.com/pdf/Open-W…
codex并入了chatgpt但:
codex模型更新了不代表chatgpt模型更新了,我这codex时5.6了但chat依然是5.5。
两者数据依然没完全打通,虽然可以通过“附加到任务”来获取,但我其实想要单独的chat记录导出把它当成一个文件来处理。
NerdC retweeted
In neuroscience, global workspace theory holds that thoughts become consciously accessible when they enter a privileged workspace that’s broadcast across the brain.
Using a new interpretability technique, we found something similar in Claude: the J-space. anthropic.com/research/globa…
延伸一下说一个很多人不知道判断:skills最大作用是剪枝和压制llm的自主性,因此妄图蒸馏人物为skill是非常傻逼的想法。
过多的知识对LLM在各种意义上都是弊大于利的,不仅仅是关于上下文和注意力。
























