ML Engineer @Apple; Formerly Visa

Joined May 2018
Ben Heil retweeted
Our mentor Casey Brown, apart from being an extraordinary scientist, was a brilliant teacher who loved everything genetics. In his honor, some of the world's leading experts came together to create the 'Casey Brown Lecture Series' on human genetics 1/ shorturl.at/eCm7S
1
26
2
71
8,282
So here's a story of, by far, the weirdest bug I've encountered in my CS career. Along with @maciejwolczyk we've been training a neural network that learns how to play NetHack, an old roguelike game, that looks like in the screenshot. Recenlty, something unexpected happened.
133
1,357
457
8,258
2,222,522
Edgy stuff in this record, especially the track about UMAP/tSNE in scRNA-seq
2
14
107
11,361
Have you ever done a dense grid search over neural network hyperparameters? Like a *really dense* grid search? It looks like this (!!). Blueish colors correspond to hyperparameters for which training converges, redish colors to hyperparameters for which training diverges.
295
2,150
502
11,171
1,771,034
As someone raised by salespeople, I have a firm belief that Sales is a subdiscipline of every career
"As I academic, I never have to sell anything to anyone." Right or wrong? If you know me at all, you know my answer is a strong "wrong" here. Like, okay, you're not going from door to door asking folks to buy your wares. But, actually, yes you are. Your wares just happen to be ideas. You sell your ideas all the time, to - students (classes and office hours), - reviewers and editors (queries, manuscripts) - colleagues (presentations, articles, and books), - co-workers (committees, meetings) - funding gatekeepers (grant applications), - employers (application, tenure, and promotion packages, portfolios, and dossiers), and - others as needed / wanted / required to attain your goals for your ideas. Nobody is handing you dirty cash money... but nobody has ever handed me dirty cash money either, and I'm a business owner. Academic culture can make it seem like "selling" is beneath you, something you get to avoid by keeping yourself separate from the rest of us working stiffs. What's true about success in academia is that successfully selling your ideas is a huge part of the work you do every day. Making a case for why other people should back you -- with funds, recommendations, labour, and support of other kinds -- is critical to you getting hired, published, and gainfully employed. The world beyond academia is much the same for many of us. (Hey, that means you've got plenty of transferable skills and experiences to draw on if you want to pivot your career.) ❓ What are examples of "selling" you did or do in your work now, PhDs? --- 👋🏻 I'm Jen! I help professors, postdocs, and other disappointed, underappreciated PhDs figure out their best next career, and then launch it. 👉🏻 Do you want to land a great-fit job that lets you live where you want, get paid well, and do meaningful work with supportive colleagues? Except you don't even know what that job is, or if it even exists? ✋🏻 I'd love to help! Learn more about the PhD Career Clarity Program: courses.fromphdtolife.com/bu…
1
4
2,087
In this spreadsheet I document a wide variety of h params on a per-model basis as well as provide my current recommendations for how to go about setting up a LLM architecture. Make sure to check out the notes tab for important caveats and warnings! docs.google.com/spreadsheets…
13
77
10
524
51,489
That coordinated quote retweet by OpenAI staff was the most impressive employee flex I’ve seen in tech. – at San Francisco, CA
52
396
31
7,339
1,533,656
Found a kindred spirit at #icml2023 #feelthelearn
21
340
56
2,767
295,483
Our architectures get stolen by lesser AI teams, So we better sign these rhymes with PGP; But we'll keep on generatin' cash and tokens like a CFG 'Cause there's so much drama in the GPTs. What's wrong, SaaS teams, am I making you nervous? Even green VC teams are giving you denial of service. You better not go broke before you IP; Learn to prompt engineer, get friendly with the GPTs. Framework control flow better than TCP, The west coast's answer to Alan T, Your model best not front if it can't pass the GRE, 'Cause there's so much drama in the GPTs. – at Stanford, CA
2
4
1
29
10,016
It's time to celebrate Dr. Benjamin Heil! Ben was a member of the Casey Greene (@GreeneScientist) and John Holmes (@Johnhh429H) Labs, and now works as a machine learning scientist at Visa Research. 1/4
1
2
21
1,967
Every day I see a thread about leaving academia to be happy and a subtweet saying that academia is great. For computational students, this video by @rishiyer is great because it talks about different types of industry jobs and then compares in 12 axes youtu.be/H6wSxSXkr1w
8
1
24
5,032
TIL the last digit of a credit card number is actually a checksum that can detect whether the rest of the number was mistyped en.m.wikipedia.org/wiki/Luhn…
1
283
In this world I decided to stay. I wrote this pair of posts a year ago to help me make my decision (and to help @GreeneScientist understand where I was coming from). In the spirit of New Year's reflection, I'm publishing them now: autobencoder.com/2021-11-08-… 2/3
1
2
14
2,139
Did I make the right decision? I may never know. I hope that laying out my reasoning from both sides might help others who are trying to decide for themselves though. 3/3
1
8
1,222
It is done! I successfully defended my PhD today!
21
5
2
244
20,669
Science ran a big experiment on itself for the last ~60 years. It didn't work out. experimentalhistory.substack…
101
979
345
3,959
Ben Heil of the Casey Greene (@GreeneScientist) and John Holmes (@Johnhh429H) Labs defends tomorrow! #AlmostPhDone
1
1
22