@linkaixi

RL researcher. Opinions are my own.

 Sunnyvale CA
kaixianglin.github.io
Joined March 2017
  • Tweets60
  • Following360
  • Followers92
12Media
Attending #ICLR2025 from 4/23 to 4/28 & will present PrefEval (prefeval.github.io/) discussing the performance of SoTA LLMs on personalization. Catch our presentations on April 26th: 🔥Oral: 10:42-10:54am @ Hall 1 Apex 📊 Poster #558: 3:00-5:30pm @ Hall 3 + Hall 2B Beyond personalization, If you’d like to chat about RL, reasoning, & multimodal agents. DM for a coffee chat, let's connect! #ICLR2025 #RL #LLM #AmazonScience
3
18
1,233
Excited to release PrefEval (ICLR '25 Oral), a benchmark for evaluating LLMs’ ability to infer, memorize, and adhere to user preferences in long-context conversations! ⚠️We find that cutting-edge LLMs struggle to follow user preferences—even in short contexts. This isn't just about long-context ability—but also a lack of proactiveness in following preferences. 💭 LLMs struggle with implicit preferences revealed through conversation, requiring more reasoning. 🚀 SFT on our benchmark greatly improves performance w/ enhanced attention to preference regions! 🧩 What's in PrefEval? - 3,000 user preference & query pairs - 3 Implicit & explicit preference forms - 20 conversational topics - Evaluated up to 100K context w/ various baselines - Flexible task forms: MCQ & generation - Extensive Error Type Analysis 🔗 Learn more: Website: prefeval.github.io/ Code & Data: github.com/amazon-science/Pr… Paper: arxiv.org/abs/2502.09597 Huge thanks to my mentors during my internship at Amazon @linkaixi @Mingyi552237, Yang Liu, @hdevamanyu!
3
27
2
132
13,277
🚨🚨🚨 What to do when pre-training ends? Excited to share our latest work Proposer-Agent-Evaluator (PAE), where we trained an open-source SOTA generalist VLM web agent entirely with self-generated data and autonomous RL. Infrastructure and model fully open-sourced. (1/9)
6
41
8
185
31,771
I am presenting a paper from my last year's Amazon internship at IROS 2022, in which we handle long-horizon planning for home-assistant virtual robots with better semantic representation and exploration strategy. zjia.eng.ucsd.edu/amslam #IROS2022
1
2
4
I'm on the academic job market this year! I develop machine learning methods that are robust and adaptable to distribution shifts and open/non-stationary environments, w/ interdisciplinary applications in healthcare+drug discovery, transportation, and education. RT appreciated.
4
51
1
207
Amazon and @UCLA announced the establishment of the Science Hub for Humanity and Artificial Intelligence. The collaboration will support research, education & outreach efforts in areas of mutual interest around #AI and its applications to benefit humanity. amazon.science/academic-enga…

Amazon and UCLA establish Science Hub for Humanity and AI

The collaboration, Amazon’s first of this type with a public university, will support academic research, education, and outreach efforts in areas of mutual interest around artificial intelligence and...

amazon.science
6
1
21
A late personal update: I'm now a tenure-track assistant professor at the New Jersey Institute of Technology (NJIT). Fresh new start! And I'm looking for prospective students interested in RL/DM/Transportation for Spring/Fall 2022. web.njit.edu/~hw32
8
4
2
84
🚨Postdoc opportunity🚨 in my group @nds_vu on topics in social network analysis! Please get in touch with me via email asap! We especially encourage applicants who are members of underrepresented groups (including those who identify as neurodivergent). 📢 Please RT!
18
1
34
Please see the link below if seeking a PhD position starting Fall 2021 or Spring 2022 in “...data mining and machine learning research, especially in graph neural networks and social network analysis.” You can follow Yao @ma_yao_ cse.msu.edu/~mayao4/openning…
DSE Lab @ MSU@dse_msu7 Apr 2021
We are pleased to announce that our very own Yao Ma will be joining the Department of Computer Science at New Jersey Institute of Technology (NJIT) as an Assistant Professor (tenure-track) in Fall 2021. Congratulations to Yao on his new position, it's truly a well deserved! 🥳
1
3
1
9
“Despite the challenges of the pandemic, the Alexa team has shown incredible adaptability and grit, delivering scientific results that are already making a difference for our customers and will have long-lasting effects.” Rohit Prasad, VP & Head Scientist. amazon.science/blog/alexa-th…

Alexa: The science must go on

Throughout the pandemic, the Alexa team has continued to invent on behalf of our customers.

amazon.science
1
2
1
6
Excited to share that our paper "Linear Convergent Decentralized Optimization with Compression" has been accepted in ICLR 2021 openreview.net/forum?id=84gj… Thank the reviewers/ACs and our collaborators @tangjiliang, @MingYan08, Yao Li, Rongrong Wang
Xiaorui Liu@liu_xiaorui2 Jul 2020
Our paper "Linear Convergent Decentralized Optimization with Compression" is online at arxiv.org/pdf/2007.00232.pdf This is the first algorithm achieving linear convergence with communication compression in decentralized optimization. Welcome to check it!
8
12
Very happy to have my previous collaborator @iftenney at @GoogleAI to give a talk at the Stanford NLP seminar this Thursday! Gonna be exciting!
Stanford NLP Group
@stanfordnlp12 Jan 2021
We’re very excited to kick off our 2021 Stanford NLP Seminar series with Ian Tenney (@iftenney) of Google Research presenting on “BERTology and Beyond”! Thursday 10am PT. Open to the public non-Stanford people register at nlp.stanford.edu/seminar
1
9
23
Reinforcement Learning Day 2021 will feature a lively debate between Prof Yoshua Bengio from @Mila_Quebec and Dr. @JohnCLangford. Reserve your seat now to watch their discussion on “The State of RL and The Theory-Practice Divide” on January 14 at 11 AM: aka.ms/AAae0zv

3
40
3
297
📣[DeepRobust-0.1.1 Comes Out!] Our PyTorch library for adversarial robustness on graph and image data, DeepRobust, can now be installed from pip! Just try `pip install deeprobust`. For more details, please visit github.com/DSE-MSU/DeepRobus…! #MachineLearning #python #DeepLearning

GitHub - DSE-MSU/DeepRobust: A pytorch adversarial library for attack and defense methods on images...

A pytorch adversarial library for attack and defense methods on images and graphs - DSE-MSU/DeepRobust

github.com
20
2
24
What a comprehensive collection of simulation platforms for embodied AI and RL! Add two more: aihabitat.org/ and svl.stanford.edu/igibson/

AI Habitat

A platform for embodied AI research.

aihabitat.org
Ankur Handa
@ankurhandos20 Dec 2020
Some simulation platforms that caught my eye this year 🧵
Embodied & Teachable AI team at Amazon Alexa AI is looking for multiple research interns starting summer 2021. Please feel free to contact me if you are interested in Human-robot interaction, VQA, VLN, etc. #internship #machinelearning #AI #Amazon
8
8
#SIAMSDM18 Markov Chain Monitoring by Harshal Chaudhari et al. Design efficient algorithm to reduce the variance of prediction of positions of items with limited monitoring resources
3
#SIAMSDM18 Co-Regularized Monotone Retargeting for Semi-Supervised Letor by Shalmali Joshi et al. Utilizing convex structures of isotonic vectors for a semi-supervised learning to rank problem under multi-view setting.
#SIAMSDM18 Learning Graph Representation Via Frequent Subgraphs by Dang Nguyen. Unsupervised learning for graph embedding.
3
#SIAMSDM18 Latitude: A Model for Mixed Linear–Tropical Matrix Factorization by Sanjar Karaev，et al. combing NFM and subtropical matrix facorization
Load more