Sumble co-founder and CTO. Learning high-quality, structured data about the world. Formerly @kaggle

SF
Joined March 2009
Kaggle launched an LLM eval product kaggle.com/benchmarks This has the potential solve the biggest challenge in the LLM ecosystem: strong and diverse evals
2
49
2
265
24,832
Looking at job posts over the last year, it looks like Amazon is making the broadest AI investment. 228 teams across the company posted jobs with GenAI projects over the past year, considerably more than any other company. blog.sumble.com/companies-wi… Most interest is the breadth of teams and use cases. They made posts from the core research teams, Alexa, customer service, seller experience, fulfillment, and catalog selection teams (full list: sumble.com/l/JrsA4zNSp4). Some examples: - Creative X Team: generating high-quality text, images and video for advertisers (sumble.com/l/EHF2RZQRYD) - Geospatial Science Team: for global address parsing and validation (sumble.com/l/h7GWV4t9JU) - Selection and Catalog Systems Team: improve the completeness and correctness of product data for Amazon shoppers (sumble.com/l/uaddsqaD4v)
1
16
3
47
16,677
The overlooked GenAI use case: cleaning, processing, and analyzing data. blog.sumble.com/the-overlook… Job post data tell us what companies plan to do with GenAI. The most common use case is data analytics projects. Examples: - AstraZeneca: using LLMs on freeform documents to structure results from their Extractables & Leachables testing (sumble.com/l/FgehjrgnvN) - Trafigura: The Document AI team is using LLMs to extract data from a corpus of commodity trading documents to generate credit reports (sumble.com/l/6bY7mhyAHd) The startup ecosystem is overlooking this use case, instead focusing on other areas such as customer support, sales & marketing and code gen.
22
110
31
639
165,164
.@benhamner and I have started a newco. We're building a large repository of external datasets to help data scientists to find, join and evaluate external data. We're looking for a full-stack web dev and a hybrid data engineer/machine learner. DM me if interested.
18
20
4
156
52,970
Playing around with topic modeling at the moment. Looking for something that's close to SOTA but still easy to use. Been looking at BERTopic github.com/MaartenGr/BERTopi…. Any other recommendations?
5
10
57
Ben Hamner retweeted
"Giving a user a choice" sounds like you're doing a nice thing. You're not. You're "forcing a busy user make yet another decision."
1
3
1
19
Replying to @benhamner
@benhamner #progviz first app is live! the #kagglemafia is now official.
1
2
4
A human sees ~100million of voluntary, continuous, high-def, RGBD views of the world per year. We're unfair to our algorithms