Passionate in AI and BigData. PhD in Artificial Intelligence.

Joined April 2020
Happy to share that my NeurIPS paper entitled "Towads Understanding Self-Pretraining for Sequence classification got accepted. Special thanks to @orvieto_antonio for the supervision. #NeurIPS #AI #Research #transformer #Deeplearning
9
492
I have long been fascinated by the "Never Train from Scratch" (arxiv.org/abs/2310.02980, ICLR24 outstanding paper) results by @AmosaurusRex and collaborators. Finally, with @CoserOmar we got time to look into the mechanisms of self-pretraining (SPT). Here's what we learned 🧵
3
19
2
185
22,214
Omar Coser retweeted
Really cool to seeing follow up work on SPT! I've always been curious why optimizing seemingly local objectives (like MLM) lead to gains on long context tasks. @orvieto_antonio & @CoserOmar provide valuable insights on that and more. Enojyed reading the paper, awesome work!
I have long been fascinated by the "Never Train from Scratch" (arxiv.org/abs/2310.02980, ICLR24 outstanding paper) results by @AmosaurusRex and collaborators. Finally, with @CoserOmar we got time to look into the mechanisms of self-pretraining (SPT). Here's what we learned 🧵
1
2
10
2,271
New Research: AI-based methodologies for exoskeleton-assisted rehabilitation of the lower limb: a review: Over the past few years, there has been a noticeable surge in efforts to design novel tools and approaches that incorporate Artificial… frontiersin.org/articles/10.… #Robotics #AI
1
1
281