DOinterview retweeted

OpenAI@OpenAI10 Mar 2020
United States
United StatesConnected via WebAccount-level information, not a live location or per-post device.
We show how to read a human-interpretable algorithm from a neural network's weights, by studying the circuits formed by the connections between individual neurons: distill.pub/2020/circuits/zo…
DOinterview retweeted
T-NLG
"Better natural language generation can be transformational for a variety of applications, such as assisting authors with composing their content, saving one time by summarizing a long piece of text with digital assistants" @MSFTResearch #AI #NLP
microsoft.com/en-us/research…
DOinterview retweeted
The longer it takes to become successful, the more prepared you will be to handle it.
DOinterview retweeted
Totally crazy that you can squeeze BERT down to 7 MB without much drop in performance - "Extreme Language Model Compression with Optimal Subwords and Shared Projections," Zhao et al.: arxiv.org/abs/1909.11687
DOinterview retweeted
NLP leaderboards are turning into who can pretrain the biggest architecture for the longest. But hey, maybe that's a good thing - people will realize they can't compete and get back to doing good science, caring about ablations instead of absolute leaderboard positions.
DOinterview retweeted
Early on the neural network landscape was fragmented. In 2015, Keras started attracting attention. Today it’s Keras/TensorFlow and PyTorch.
(As of TF 2.0, Keras is the high level API for TensorFlow.)
3/3
DOinterview retweeted
For example:
- don't try to solve all problems with automation. humans need help from humans. use tools. but add support staff, don't cut it.
- divine the solution. customers don't know how to solve their problems. you do. tell them how -- and implement it.
DOinterview retweeted
Three weeks ago, we released a report with @PolisLSE highlighting how artificial intelligence can transform journalism.
We're building on that work with new guidelines to help newsrooms approach using #JournalismAI for the first time. goo.gle/2YENKZO
DOinterview retweeted
Replying to @GoogleNewsInit @PolisLSE
Read our original post about how artificial intelligence is changing the news industry: goo.gle/2KvTCPi
DOinterview retweeted
Excited we’re hosting Computation + Journalism on March 20!
Keynotes: @amandacox @dfreelon @DavMicRot
Talks: @databyler @micahcohen @AllisonSchrager @AlbertoCairo @kanarinka @ChristiansenJen @spetulla
Still accepting research, practice or tech papers! cj2020.northeastern.edu
DOinterview retweeted

AI at Meta@AIatMeta13 Jan 2020
United States
United StatesConnected via WebAccount-level information, not a live location or per-post device.
We have open-sourced wav2letter@anywhere, an inference framework for online speech recognition that delivers state-of-the-art performance. ai.facebook.com/blog/online-…
DOinterview retweeted
Hang it there long enough
Truly listen to your customers
Build awesome software
You will catch a break – at San Mateo, CA
DOinterview retweeted
┏━━┓┏━━┓┏━━┓┏━━┓
┗━┓┃┃┏┓┃┗━┓┃┃┏┓┃
┏━┛┃┃┃┃┃┏━┛┃┃┃┃┃
Solving Natural Language Processing!
┃┏━┛┃┃┃┃┃┏━┛┃┃┃┃
┃┗━┓┃┗┛┃┃┗━┓┃┗┛┃
┗━━┛┗━━┛┗━━┛┗━━┛
DOinterview retweeted
My 2020 research wishlist: more of ↗️ a bit less of ↘️
↗️NLU/NLG convergence – ↘️fitting a classifier to every NLP task
↗️Datasets w. small/no training set – ↘️equating solving a task w. fitting a train/eval set
↗️Non-parametric models – ↘️embedding all knowledge in model weights
DOinterview retweeted
Has anyone made a list of the companies that “got big slow”? Thinking of Shopify, 1Password, Craigslist, Minecraft, Squarespace.
These are multibillion dollar operations — not lifestyle businesses in the standard sense. But they didn’t take much/any outside capital for a while.
DOinterview retweeted

AI at Meta@AIatMeta11 Dec 2019
United States
United StatesConnected via WebAccount-level information, not a live location or per-post device.
We’ve launched the Deepfake Detection Challenge, an open, collaborative initiative to accelerate development of new technologies to detect deepfakes and manipulated media. The challenge features a new, unique data set of 100K-plus videos for researchers. ai.facebook.com/blog/deepfak…
DOinterview retweeted
Apple is hiring engineers for the cross-functional ML team at Special Projects Group!
If you’re attending @NeurIPSConf, find me at the @Apple booth from 2.30-4pm on Tuesday (12/10). Or reach out and schedule some time, and I’d be happy to chat about our work!
DOinterview retweeted
Will buying this book make you an NLP superstar like @kchonyc? Look, causal inference from observational data is a hard problem. All we can say for sure is that there is only one Kyunghyun Cho, and he has the book. Do you really want to risk *not* getting it?
DOinterview retweeted
Meet the @Qualcomm #Snapdragon865.
This phenomenal chip has full on-chip speech to text!
It is perhaps one of the most incredible #VoiceFirst chip of this era.
I will be building around this masterpiece as soon as I can get a sample.
I can’t wait!






















