
Ben Heil retweeted
Our mentor Casey Brown, apart from being an extraordinary scientist, was a brilliant teacher who loved everything genetics. In his honor, some of the world's leading experts came together to create the 'Casey Brown Lecture Series' on human genetics 1/ shorturl.at/eCm7S
Ben Heil retweeted
So here's a story of, by far, the weirdest bug I've encountered in my CS career.
Along with @maciejwolczyk we've been training a neural network that learns how to play NetHack, an old roguelike game, that looks like in the screenshot. Recenlty, something unexpected happened.
Ben Heil retweeted
Have you ever done a dense grid search over neural network hyperparameters? Like a *really dense* grid search? It looks like this (!!). Blueish colors correspond to hyperparameters for which training converges, redish colors to hyperparameters for which training diverges.
As someone raised by salespeople, I have a firm belief that Sales is a subdiscipline of every career
"As I academic, I never have to sell anything to anyone."
Right or wrong?
If you know me at all, you know my answer is a strong "wrong" here.
Like, okay, you're not going from door to door asking folks to buy your wares.
But, actually, yes you are.
Your wares just happen to be ideas.
You sell your ideas all the time, to
- students (classes and office hours),
- reviewers and editors (queries, manuscripts)
- colleagues (presentations, articles, and books),
- co-workers (committees, meetings)
- funding gatekeepers (grant applications),
- employers (application, tenure, and promotion packages, portfolios, and dossiers), and
- others as needed / wanted / required to attain your goals for your ideas.
Nobody is handing you dirty cash money... but nobody has ever handed me dirty cash money either, and I'm a business owner.
Academic culture can make it seem like "selling" is beneath you, something you get to avoid by keeping yourself separate from the rest of us working stiffs.
What's true about success in academia is that successfully selling your ideas is a huge part of the work you do every day.
Making a case for why other people should back you -- with funds, recommendations, labour, and support of other kinds -- is critical to you getting hired, published, and gainfully employed.
The world beyond academia is much the same for many of us.
(Hey, that means you've got plenty of transferable skills and experiences to draw on if you want to pivot your career.)
❓ What are examples of "selling" you did or do in your work now, PhDs?
---
👋🏻 I'm Jen! I help professors, postdocs, and other disappointed, underappreciated PhDs figure out their best next career, and then launch it.
👉🏻 Do you want to land a great-fit job that lets you live where you want, get paid well, and do meaningful work with supportive colleagues? Except you don't even know what that job is, or if it even exists?
✋🏻 I'd love to help! Learn more about the PhD Career Clarity Program: courses.fromphdtolife.com/bu…
Ben Heil retweeted
In this spreadsheet I document a wide variety of h params on a per-model basis as well as provide my current recommendations for how to go about setting up a LLM architecture. Make sure to check out the notes tab for important caveats and warnings!
docs.google.com/spreadsheets…
Ben Heil retweeted
That coordinated quote retweet by OpenAI staff was the most impressive employee flex I’ve seen in tech. – at San Francisco, CA
Ben Heil retweeted
Very glad that our work with @GreeneScientist and others in integrating genetic studies with gene co-expression patterns is published in @NatureComms! Take a look at nature.com/articles/s41467-0…
Ben Heil retweeted
Found a kindred spirit at #icml2023 #feelthelearn
Ben Heil retweeted
Our architectures get stolen by lesser AI teams,
So we better sign these rhymes with PGP;
But we'll keep on generatin' cash and tokens like a CFG
'Cause there's so much drama in the GPTs.
What's wrong, SaaS teams, am I making you nervous?
Even green VC teams are giving you denial of service.
You better not go broke before you IP;
Learn to prompt engineer, get friendly with the GPTs.
Framework control flow better than TCP,
The west coast's answer to Alan T,
Your model best not front if it can't pass the GRE,
'Cause there's so much drama in the GPTs. – at Stanford, CA
Ben Heil retweeted
It's time to celebrate Dr. Benjamin Heil! Ben was a member of the Casey Greene (@GreeneScientist) and John Holmes (@Johnhh429H) Labs, and now works as a machine learning scientist at Visa Research. 1/4
Ben Heil retweeted
Every day I see a thread about leaving academia to be happy and a subtweet saying that academia is great.
For computational students, this video by @rishiyer is great because it talks about different types of industry jobs and then compares in 12 axes youtu.be/H6wSxSXkr1w
TIL the last digit of a credit card number is actually a checksum that can detect whether the rest of the number was mistyped
en.m.wikipedia.org/wiki/Luhn…
A little bit late, but here's my 2022 year in review!
autobencoder.com/2022-12-30-…
In another world I dropped out of my PhD program a year ago.
autobencoder.com/2021-11-08-…
1/3
In this world I decided to stay.
I wrote this pair of posts a year ago to help me make my decision (and to help @GreeneScientist understand where I was coming from). In the spirit of New Year's reflection, I'm publishing them now:
autobencoder.com/2021-11-08-…
2/3
Ben Heil retweeted
Science ran a big experiment on itself for the last ~60 years. It didn't work out.
experimentalhistory.substack…
Ben Heil retweeted
Ben Heil of the Casey Greene (@GreeneScientist) and John Holmes (@Johnhh429H) Labs defends tomorrow! #AlmostPhDone


















