DevOps | HPC | OpenStack | Monitoring | Linux, MacOS | sailing | #CLIP project
Vienna
Joined September 2008
- Tweets2.2K
- Following1.1K
- Followers192
- Likes614
Erich B retweeted
Okay, I've been dancing around it for years--it's time to call it:
There's no economic story around using the cloud for steady-state HPC workloads. It's not even close to cost competitive.
Erich B retweeted
Kīlauea is erupting at Hawaiʻi Volcanoes National Park! 🌋 The eruption is confined to Halema‘uma‘u crater and isnʻt a threat to public safety. There is no reason for travelers to change their plans to Hawaiʻi. For updates, visit nps.gov/havo/planyourvisit/e….
📸: USGS Volcanoes
Erich B retweeted
DGX GH200: Nvidia ties 256 Grace-Hopper Superchips by 36 NVLink Switches to provide >1 EF FP8 (or ~9PF of FP64)
o 144TB unified memory
o 900 GB/s GPU-to-GPU bandwidth
o 128 TB/s bisection bandwidth
o End-of-year availability
hpcwire.com/2023/05/28/nvidi…
#HPC #AI via @HPCwire
Erich B retweeted
#OnThisDay thirty years ago, in 1993, CERN released the World Wide Web software to the public.
Proposed by Sir Tim Berners-Lee, the web was originally created to allow scientists and institutes from all over the globe who were working on CERN data to share information accurately and quickly.
Find out more: home.cern/news/news/computin…
#CERNImpact #CERNandSociety
Erich B retweeted
To repeat in English, although amazing strides have been made in transformer-based language models from BERT to GPT4, it is anticipated that the rate of improvements will now slow down, as the supercomputers used for training has caught up with the top supercomputers of the world.
Erich B retweeted
the only people I’ve seen dismissing this insightful article are ones who don’t seem to understand compression very well
the only surprise(?) is that it took a skilled writer and thinker, instead of one of us researchers, to make the case crystal clear
newyorker.com/tech/annals-of…
Erich B retweeted
floating point representation
ALT subtitle: the 64-bit number line Floating point numbers aren't evenly distributed. Instead, between each power of 2 (from 2^-1023 to 2^1023), there are 2^52 numbers, evenly spaced. There 2^52 numbers between 2 and 4, between 4 and 8, -1/2 and -1/4, 1/16/ and 1/8, etc. floating point numbers are represented with 3 integers: 1. sign (+ or -, 0 is + and 1 is -) 2. exponent (the power of 2 3. significand (how far it is between that power of 2 and the next one) here's how to calculate the exponent and significand for 8.5: 1. find the powers of 2 that sound 8.5 (8 and 16) 2. calculate the exponent: 8 = 2^3, so the exponent is 3 3. calculate the significand: - 8.5 is 1/16 of the way between 8 and 16 - rewrite 1/16 as a fraction of 2^52, so 2^48 / 2^52 - So the significand is 2^48
Erich B retweeted
Today’s #PhotoOfTheWeek portrays the installation of the @CMSExperiment's silicon strip tracking detectors, successfully completed in 2007. They are part of the system that tracks the particles’ path, as they move through the experiment’s magnetic field.
🔗cms.cern/detector/identifyin…
Erich B retweeted
This the future, from FLOPS to BYTES. Various research incl ours have shown that ROI for ALUs has diminished for HPC, as majority of high performance apps are bandwidth bound. In fact, even if we had infinite flops, entire workload speed up is mere 7-30% arxiv.org/abs/2010.14373
Too bad for u @Microsoft :-), @graphcoreai IPU turns out to be much more than an #AI chip. It can also be used for #HPC apps in computational #astronomy and #seismic imaging. And it does actually pretty good: scoring 2Tflops/s & 1Tflops/s, resp. These are Level-2 #BLAS op! #SRAM
Erich B retweeted
Holy crap. Malware hidden in a strand of DNA hijacks the computer that analyzes that particular gene sequence. wired.com/story/malware-dna-…
Erich B retweeted
Baidu researchers have developed HelixFold, an efficient protein structure prediction system implementing AlphaFold2 with PaddlePaddle, providing a complete pipeline of training and inference.
arxiv.org/pdf/2207.05477.pdf
Erich B retweeted
Visual Studio Code as a plague.
Myriad has 2184 home directories.
Visual Studio Code creates a remote plug-ins directory approx 1.3GB in size.
That means if every user used VS Code we'd need an additional 2.8TB of storage.
Erich B retweeted
More fun publisher surveillance:
Elsevier embeds a hash in the PDF metadata that is *unique for each time a PDF is downloaded*, this is a diff between metadata from two of the same paper. Combined with access timestamps, they can uniquely identify the source of any shared PDFs.
ALT [A list of metadata for a PDF, the important field being two "Unknown:<long random character string>" fields that are color coded to indicate that they have been changed between versions.
Erich B retweeted
Very pleased to share our latest preprint: Julia for Biologists
#julialang opens up new possibilities for biologists (computational and beyond) and we discuss how and why.
arxiv.org/abs/2109.09973
Erich B retweeted
Do you want to attract computational biologists to your project?
Do you want to attract computational biologists to your department?
With a dozen colleagues around the globe, we present "A field guide to cultivating computational biology"!
Read on! arxiv.org/submit/3712561/pre…
Erich B retweeted
@RonZimmermann on the science cloud project, CLIP, that we built - on the national radio (german only) oe1.orf.at/player/20210129/6… /cc @timeu_s @ebirn et al.
Quite the ride indeed, we learned a lot along the way.
The HPC system that @ebirn, @PetarForai, Petar Jager and myself built and been managing for the last 3 years. Quite a bit of blood, sweat and tears went into it but I think in the end it payed off.
derstandard.at/story/2000122…