PerthMLGroup retweeted
In our paper arxiv.org/abs/2302.10360 on the arXiv today, we present results from a study investigating the energy-efficiency advantage that could be achieved in executing state-of-the-art Transformer models on optical hardware.
PerthMLGroup retweeted
🎉 We are thrilled to announce the release of the latest version of mlforecast a #Python library for Scalable #machinelearning 🤖 for #timeseries #forecasting
🚀 This version comes with exciting new features that are sure to make forecasting even more efficient and accurate
🧵
PerthMLGroup retweeted
Cyborgism Research Agenda
-Does not try to make GPT an agent
-Leverages GPT as a general simulator
-LLMs reason from scratch about any situation
-Advanced prompting interfaces
-Branches GPT chains of thought
-Injects variance into human thoughts
Post alignmentforum.org/posts/bxt…
PerthMLGroup retweeted
This quietly slipped out yesterday. Briefly, the UK is traditinally a strong source of clinical trials but patient recruitment has fallen by 44% (!) due to slow & unpredictable set-up of research sites.
Independent review into UK clinical trials buff.ly/3lVWGtx
PerthMLGroup retweeted
One exciting feature of our partnership with AWS is that we now have 1000+ GPUs to start training really large models at @huggingface 🔥🔥🔥!
We’ll be working hard to make closed models open, starting with LLMs and friends 🤓
Which closed models would you like to be open?
PerthMLGroup retweeted
Recitation-Augmented LLMs
-Usually: Retrieve relevant docs & give to LLM to answer
-Instead: Recite relevant passages from LLMs' own memory via sampling,
then produce final answer
-State-of-the-art on closed-book Q&A
Paper arxiv.org/abs/2210.01296
Code github.com/Edward-Sun/RECITE
PerthMLGroup retweeted
German AI startup @Aleph__Alpha claims it will have a 300-billion parameter Large Language Model "Luminous-World" trained this year for “highly complex and critical applications”
(GPT-3 has 175 billion parameters)
PerthMLGroup retweeted
We're excited to welcome FuseMedML to the PyTorch ecosystem!
FuseMedML is part of the BiomedSciAI organization which provides tools for AI-based accelerated discovery of biomarkers and molecules in the biomedical domain.
See the latest here: hubs.la/Q01D6TZ70
PerthMLGroup retweeted
Robust Hybrid Learning With Expert Augmentation
Antoine Wehenkel, Jens Behrmann, Hsiang Hsu, Guillermo Sapiro, Gilles Louppe, Joern-Henrik Jacobsen.
Action editor: Jasper Snoek.
openreview.net/forum?id=oe4d…
#expert #models #modelling
PerthMLGroup retweeted
"MarioGPT: Open-Ended Text2Level Generation through Large Language Models"
This looks like a pretty fun and creative project!
The best part, it's based on a distilled GPT-3 model and can be trained on a single GPU.
PerthMLGroup retweeted
In the last week, three people on reddit/r/statistics have asked about testing whether a sample came from a Gaussian distribution.
The answer is that you should never test for normality. The result is a non-answer to the wrong question.
allendowney.com/blog/2023/01…
PerthMLGroup retweeted
.@TalarianHQ's `GPT for Sheets™` is the gift that keeps on giving! 🔥
Look at how easy it is to create personalized content with it, thanks to #GPT3's seamless integration! 🤯👇
Get the add-on here:
🔗workspace.google.com/marketp…
Now it's even easier to use #GPT3 in @googlesheets with @TalarianHQ's `GPT for Sheets™` extension! 🔥
Check out their new `GPT_FILL()` function! 👇
🔗 workspace.google.com/marketp…
PerthMLGroup retweeted
I think this link will be useful: google-research.github.io/se…
the paper: arxiv.org/abs/2301.11325
also they released a dataset:
kaggle.com/datasets/googleai…
it's a shame the actual library is not available but the research article is pretty good
PerthMLGroup retweeted
Batch normalisation appears to be falling out of favour (probably for the best IMO, so many bugs end up being batchnorm bugs😬).
One area where it persists is GAN discriminators (e.g. in StyleGAN-T and VQGAN). Are there any other settings where batchnorm is still hard to avoid?
PerthMLGroup retweeted
The first text line detection model for historical documents available on @huggingface : paper+code+models, all open-source huggingface.co/Teklia/doc-uf… teklia.com/research/publicat… #digitalhumanities @LitisLab
PerthMLGroup retweeted
[CV] Learning Good Features to Transfer Across Tasks and Domains
P Z Ramirez, A Cardace, L D Luigi, A Tonioni, S Salti, L D Stefano [University of Bologna & Google] (2023)
arxiv.org/abs/2301.11310
#MachineLearning #ML #AI #CV
[1/2]
PerthMLGroup retweeted
Just published a literature review on scaling laws @EpochAIResearch! I collected a database of scaling laws for different tasks and architectures and reviewed dozens of papers in the scaling law literature.
Check out the database!
docs.google.com/spreadsheets…
🧵
