Professor of Networked Systems at UCL and Networks at OpenAI

Joined May 2012
There is a lot of news about compute being the bottleneck for AI. There is less visibility into the engineering it takes to make large-scale compute actually work reliably. In my view, this is one of the most interesting computer science problems in the industry right now. It is not just about getting more GPUs. It is about making every layer of the system work: networking, scheduling, hardware health, storage, orchestration, reliability, observability, security, and the developer experience for researchers. This blog gives a rare preview into the depth of engineering happening across the stack at OpenAI, starting with MRC and supercomputer networking. We're excited to start sharing more about designing, building, and operating compute at planet scale. openai.com/index/mrc-superco… Join us: openai.com/careers/software-…
OpenAI
@OpenAIMay 6
AI supercomputers need a new kind of network to stay in sync at massive scale. OpenAI’s @markjhandley and @poyntingatgreg join @AndrewMayne to discuss what it takes to move data across record numbers of chips reliably and efficiently, the new Multipath Reliable Connection (MRC) networking protocol, and why it's available for the whole industry to use.
13
26
4
464
882,116
Mark Handley retweeted
OpenAI
@OpenAIMay 6
AI supercomputers need a new kind of network to stay in sync at massive scale. OpenAI’s @markjhandley and @poyntingatgreg join @AndrewMayne to discuss what it takes to move data across record numbers of chips reliably and efficiently, the new Multipath Reliable Connection (MRC) networking protocol, and why it's available for the whole industry to use.
OpenAI
@OpenAIMay 6
We’ve partnered with @AMD, @Broadcom, @Intel, @Microsoft, and @NVIDIA, to release Multipath Reliable Connection (MRC), a new open networking protocol that helps large AI training clusters run faster and more reliably, with less wasted GPU time. openai.com/index/mrc-superco…
138
142
27
1,618
1,111,088
Mark Handley retweeted
OpenAI
@OpenAIMay 6
We’ve partnered with @AMD, @Broadcom, @Intel, @Microsoft, and @NVIDIA, to release Multipath Reliable Connection (MRC), a new open networking protocol that helps large AI training clusters run faster and more reliably, with less wasted GPU time. openai.com/index/mrc-superco…
207
680
151
5,955
1,112,963
When I became a wheelchair user, I thought coastline trails had become inaccessible to me. Fortunately, I was wrong! On a three day adventure in North Wales, I explored some of the accessible sections of @WalesCoastPath for @countrylivinguk: countryliving.com/uk/wildlif…
1
10
2
40
2,465
Mark Handley retweeted
this is the alcohol / politics / statistics crossover we’ve all been waiting for
11
18
5
90
19,718
Replying to @rossjanderson
@rossjanderson Professor Ross Anderson, FRS, FREng Dear friend and treasured long term campaigner for privacy and security, Professor of Security Engineering at Cambridge University and Edinburgh University, Lovelace Medal winner, has died suddenly at home in Cambridge.
73
292
123
796
488,129
My uncle @MarkJHandley turned up this weekend with an all-terrain wheelchair he's designed & made! Can't express what it means to be back on my favourite trails. Getting my freedom back one muddy path at a time 💛
5
6
1
77
3,764
Mark Handley retweeted
In the past 10 years, Japan has moved at a tremendous pace to install elevators & escalators in subway and train stations for the disabled and the elderly. These wheelchair accessible escalators are unique to Japan [read more: buff.ly/3G1WQXW]
73
841
87
5,073
533,219
Read about our latest engineering triumph, Tomahawk 5, driving the future of AI/ML networking! #Ethernet #Hyperscale #DataCenter #AI #ML #MerchantSilicon broadcom.com/blog/tomahawk-5…
4
5
Professor Yvonne Rogers FRS is elected a Fellow of the Royal Society for her pioneering contributions to the field of Ubiquitous Computing – interactive technologies and objects which can enhance our daily work and activities. #RSFellows royalsociety.org/people/yvon…
4
24
Mark Handley retweeted
Part 10 of the Downing Street lockdown parties: Boris Johnson and Rishi Sunak have been fined after the police concluded they had broken the law. Produced Michael Cox and Adelle Kalakouti. bbc.co.uk/news
361
3,382
652
8,697
Mark Handley retweeted
Robert Peston
@Peston9 Feb 2022
No one in or around SAGE and Nervtag is aware of any scientific advice given to the PM that the requirement to isolate for those infected with Covid19 should be terminated from end of the month. “It’s politics, isn’t it” is a typical reaction
1,632
4,502
980
13,385
So much of what we observe in the COVID data is driven by age dynamics - cases rising and falling in different age groups at different times. Here's the full tapestry of the pandemic in England (for cases at least). So many different stories written into this plot.
17
131
40
396
Mark Handley retweeted
Even though the #Tonga volcano is around 10,000 miles away from the UK, our observation sites picked up the shockwave this evening Here are the pressure traces from Brize Norton and Benson 👇
40
557
98
1,573
NEW: first thread of 2022 is an Omicron situation update, starting with a detailed look at UK hospitals, before going international. Let’s start with severity, and the most important chart: Despite steep rises in cases and patients, the number on ventilators has barely risen.
270
4,132
1,372
12,398
* COVID THREAD ON BEST WE CAN DO LONG TERM * Yes we’re in an acute crisis with Omicron and that needs dealing with, but it has actually made me want to think a lot about how this horrible pandemic ends, maybe you too? Let’s go through it… 1/35 (sorry, but this is troubling me)
148
839
459
2,897
IMPORTANT: RAPID TESTS DO WORK WITH OMICRON "But why are some people staying negative in the first days they have symptoms??" This is expected. Symptoms don't = contagious virus This is literally a reflection of the fact that vaccines are doing their job! PLEASE READ
578
6,446
1,682
15,833
Mark Handley retweeted
A hard-hitting, and very much needed, lecture from @katebingham2 on the state of our state: youtube.com/watch?v=tG_a0P2q…
Mark Handley retweeted
Reality shatter. The physics, biology, and mathematics of human vision as it relates to geometrical patterns. The lines on this checkerboard pattern are straight. (Optical illusion by Akiyoshi Kitaoka), Source: bit.ly/3wNxuGQ
27
449
53
1,862