
ProdMgr @snowflakedb - DSML; previously PM @Google (ML Engine, DatSci), @Microsoft (Azure, LINQ, C#, SQL). PhD @NotreDame, BTech @iitbombay Opinions my own
Seattle area, WA, USA
Joined May 2010
- Tweets2.9K
- Following669
- Followers726
- Likes2.1K
Soccer jersey cookie & soccer cupcake at @Snowflake biweekly "Cheesy" (Happy hour)
+1 to this. Often they are spam and/ or sent w/o email address verification.
Among culprits - Indian Income Tax Dept sending me notices for someone else w/ no way to correct them.
Finished @datta_cs 's course over the weekend @Snowflake. The new thing for me was the GPA. Really great quantification of quality & a framework to reason about errors, hallucinations etc.
Don't stop at building agents; learn how to eval.
What is your Agent's GPA or Goal-Plan-Action alignment?
Observing that agent failures arise when their goals, plans, and actions are not aligned, we introduce a framework for evaluating and improving an agent’s GPA or Goal-Plan-Action alignment.
Excited to have developed this course to share our learnings. Try it out hands-on and use the TruLens OSS project as you build and evaluate agents!
Wonderful to collaborate with @_jreini and @AndrewYNg's @DeepLearningAI team on the course and with Allison Jia, Daniel Huang, Nikhil Vytla, Shayak Sen at @Snowflake, and John Mitchell at @Stanford on the research behind it.
#agents #evals #trustworthyai
This feels like a game changer.
Need to understand details of how formulas, labeled diagrams etc are treated but just converging text & image of text is a great advance.
BOOOOOOOM!
CHINA DEEPSEEK DOES IT AGAIN!
An entire encyclopedia compressed into a single, high-resolution image!
—
A mind-blowing breakthrough. DeepSeek-OCR, unleashed an electrifying 3-billion-parameter vision-language model that obliterates the boundaries between text and vision with jaw-dropping optical compression!
This isn’t just an OCR upgrade—it’s a seismic paradigm shift, on how machines perceive and conquer data.
DeepSeek-OCR crushes long documents into vision tokens with a staggering 97% decoding precision at a 10x compression ratio!
That’s thousands of textual tokens distilled into a mere 100 vision tokens per page, outmuscling GOT-OCR2.0 (256 tokens) and MinerU2.0 (6,000 tokens) by up to 60x fewer tokens on the OmniDocBench.
It’s like compressing an entire encyclopedia into a single, high-definition snapshot—mind-boggling efficiency at its peak!
At the core of this insanity is the DeepEncoder, a turbocharged fusion of the SAM (Segment Anything Model) and CLIP (Contrastive Language–Image Pretraining) backbones, supercharged by a 16x convolutional compressor.
This maintains high-resolution perception while slashing activation memory, transforming thousands of image patches into a lean 100-200 vision tokens.
Get ready for the multi-resolution "Gundam" mode—scaling from 512x512 to a monstrous 1280x1280 pixels!
It blends local tiles with a global view, tackling invoices, blueprints, and newspapers with zero retraining. It’s a shape-shifting computational marvel, mirroring the human eye’s dynamic focus with pixel-perfect precision!
The training data?
Supplied by the Chinese government for free and not available to any US company.
You understand now why I have said the US needs a Manhattan Project for AI training data? Do you hear me now? Oh still no? I’ll continue.
Over 30 million PDF pages across 100 languages, spiked with 10 million natural scene OCR samples, 10 million charts, 5 million chemical formulas, and 1 million geometry problems!.
This model doesn’t just read—it devours scientific diagrams and equations, turning raw data into a multidimensional knowledge.
Throughput? Prepare to be floored—over 200,000 pages per day on a single NVIDIA A100 GPU! This scalability is a game-changer, turning LLM data generation into a firehose of innovation, democratizing access to terabytes of insight for every AI pioneer out there.
This optical compression is the holy grail for LLM long-context woes. Imagine a million-token document shrunk into a 100,000-token visual map—DeepSeek-OCR reimagines context as a perceptual playground, paving the way for a GPT-5 that processes documents like a supercharged visual cortex!
The two-stage architecture is pure engineering poetry: DeepEncoder generates tokens, while a Mixture-of-Experts decoder spits out structured Markdown with multilingual flair. It’s a universal translator for the visual-textual multiverse, optimized for global domination!
Benchmarks? DeepSeek-OCR obliterates GOT-OCR2.0 and MinerU2.0, holding 60% accuracy at 20x compression! This opens a portal to applications once thought impossible—pushing the boundaries of computational physics into uncharted territory!
Live document analysis, streaming OCR for accessibility, and real-time translation with visual context are now economically viable, thanks to this compression breakthrough. It’s a real-time revolution, ready to transform our digital ecosystem!
This paper is a blueprint for the future—proving text can be visually compressed 10x for long-term memory and reasoning. It’s a clarion call for a new AI era where perception trumps text, and models like GPT-5 see documents in a single, glorious glance.
I am experimenting with this now on 1870-1970 offline data that I have digitalized.
But be ready for a revolution!
More soon.
[1] github.com/deepseek-ai/DeepS…
Really important point. Too much self-doubt, hatred, denial (SDHD) fed to models. Some of it may even be well-intentioned by counterproductive.
There is still time to worry more about training data sets rather than just the model outputs.
Postgres already in production use - now on @SnowflakeDB ; with Postgres committers doing the hosting, scaling & support.
linkedin.com/posts/unmesh-ja…
It is great to have @neo4j Snowflake Native App GA. Congrats to @shasbe & team.
You get great graph queries/ knowledge graph on your Snowflake data w/o moving it anywhere. GQ engine comes to your data where it securely lives. Another boost for RAG/AI apps
linkedin.com/posts/prashmedi…
Launched as OSS. Looking fwd to contributions & use.
snowflake.com/blog/polaris-c…
github.com/polaris-catalog/p…
Congrats to the @snowflakedb team & partners!
#Supercloud7 kicks off with #theCUBE’s special discussion with @SnowflakeDB’s co-founder Benoit Dageville, as he digs into the company’s new product updates; Horizon and Polaris.
📺 More insights:
events.cube365.net/superclou…
@furrier #theCUBE
This is a key point. UBI is not introducible; much less sustainable w/o this. Unemployment insurance is a temporary thing & recipients are required to look for work & take up jobs.
Replying to @DellAnnaLuca
Every time UBI is mentioned, I wish we discussed, along with income inequality, free time inequality, and how to reduce both.
Indeed. Must not forget the sacrifices of soldiers or the treachery of our neighbor!
Commemorating 25 years of #Kargil
#LestWeForgetIndia🇮🇳 Lieutenant Kanad Bhattacharya, Sena Medal (P), 8 SIKH, fell in action on 21 May 1999, fighting Pakistani troops near #TigerHill
The mortal remains of the gallant #IndianBrave were recovered #OnThisDay 15 July 1999 upon capture of Tiger Hill #kargil1999
#25YearsofKargilVijay
Good reminder on July 4th when US freed itself from the empire.
August 15th isn't too far either!
This quoted post is unavailable.
DevDays in San Francisco on June 6.
Do hands-on hacking & app bldg w/ Snowflake eng to help & bounce ideas off of. LLMs, vector search & Native Apps using those features to operate on high value data in Snowflake DBs that you can sell!
Gr8 to brew startup!
linkedin.com/events/snowflak…
Lambdas in Snowflake:
medium.com/@qinyi.ding/snowf…
@headinthebox - reminded me of LINQ (C#) days...
A huge milestone that opens up more capabilities for @SnowflakeDB customers. Many adjacent workloads can now unite transactional and analytical data in a consistent and governed platform.
snowflake.com/blog/simplify-…
Snowflake Native Apps are Generally Available (GA) on AWS & Azure. I know a lot of you app builders have been waiting for it as it gives a boost to your adoption!
More coming soon 😀
And then greater things at @SnowflakeDB Summit!
snowflake.com/blog/native-ap…
Wow! It is game over for Zulily!!
Still remember visiting their office & meeting w/
@shasbe
when I was in Google (GCP). Sad but retailing is a tough business.
seattletimes.com/business/se…
Cost management is often a hot topic in DW community with more competitive FUD. Here is some useful advice from @samartha_ch for @SnowflakeDB instead.
medium.com/snowflake/best-pr…
Thank you @SnowflakeDB customers for your trust & enthusiasm about our joint work. Forecasting, Anomaly Detection & Contrib Explorer are available to all in public preview. snowflake.com/blog/ml-powere…









