Asst Prof @RiceSocSci. Proud alum @PsychIllinois. Into #iopsych #psychometrics #personality. Here for academic fun and games. Aspiring (b)icon. Views my own.
Houston, I'm the problem
Joined November 2020
- Tweets195
- Following727
- Followers233
- Likes2.1K
Our 100-page (!) report (from the 💯 team yooo) also highlighted key limitations with #LLM responses, including social desirability bias and poor item-level fit. These fine details reveal how AI cannot fully replicate the complexity of human responses in psychometrics... yet. 🥸
Can AI replace human respondents in psych research? 🤖
We compared #LLM-generated and human responses using BFI-2 & HEXACO scales. AI mimics broad patterns but misses subtle human nuances at the item level. 📊
Validation is key!
osf.io/preprints/osf/rwy9b
#AI #Psychometrics
🚨PhD Opportunities!🚨
I'm recruiting 1-2 #PhD students for Fall 2025 in #IOPsych @RiceSocSci @RiceUniversity! 🏅
Interested in #personnelselection, #personalityscience, #AI, & #psychometrics? Join our SMART Lab! 💻👥
Deadline: Dec 1, 2024.
More info: tinyurl.com/SMART-phd-ads
Tianjun Sun retweeted
I'm excited to share that Rice is hiring TWO new faculty members in Cognitive Neuroscience (1 Assistant level, 1 Associate/Full)!
Asst ad: apply.interfolio.com/153086
Assoc/full ad: apply.interfolio.com/153384
Please share, and reach out if you have questions!
Tianjun Sun retweeted
On putting the horse (raters and criteria) before the cart (variance components in ratings) | Industrial and Organizational Psychology | Cambridge Core - bit.ly/4cHSOkg
Congratulations to @PanDwww and Hwayeon Meyong!
where do I find a first-year like this 🙏
Tianjun Sun retweeted
The IRT Song, another Psychometric Jazz hit dropping in your timeline.
"In the land of stars and stripes, they turned away,
From Rasch's simple truths, they chose a complex way,
Item Response Theory, oh what a tangled dance,
They missed the Rasch measurement advantage,
didn't give it a chance.
To the tune of assumptions, they built a lofty throne,
With parameters three or more, complexity overblown.
Meanwhile, Rasch with its elegance stood quietly alone,
One parameter to rule them all, yet largely unknown.
Oh, in the halls of academia, they debate with such glee,
"Is it IRT or Rasch that truly holds the key?"
But those who've seen the light, they all agree,
The beauty of Rasch is in its simplicity.
So let's raise a glass to Georg Rasch, a visionary so bright,
His model cuts through the noise, brings the data to light.
And to those still lost in the IRT night,
May you find your way by Rasch's clear sight."
Tianjun Sun retweeted
Because the Psych Job Wiki is ending, I’ve worked with Amedee Martella to create a new Psych Job Wiki for the 2024-25 academic job cycle! This site has TT jobs, non-TT jobs, and postdoc positions. Feel free to spread the word, use the site, and contribute: sites.google.com/view/psychj…
Tianjun Sun retweeted
A feature on @KState’s Center for Artificial Intelligence and Date Science (#CAIDS), a consortium of labs led by our colleague @pascalhitzler, PI of @DaSeLab. This article also covers the work of @handekucuk & @tspsyched.
Faculty and student researchers at K-State are helping to make AI magic happen. Learn more about how they are making artificial intelligence smarter and safer at: bit.ly/4a7DNqR
#KStateResearch | #KState
Wonderful thread! But wanna particularly highlight this one. *bow in crowd fave* 🤓
#5. Both conferences had loads on AI. Crowd favorites were Heron, Sylvara, & @tspsyched exploring the ouroboros of job applicants using ChatGPT to fake a chatbot personality inventory and Foster using AI to create narrative feedback reports based on personality scores. (9)
Tianjun Sun retweeted
Many people have no idea how these things work.
For example, right now, as a Brazilian, I can't accept invitations to speak at conferences in Europe because my visa to work in the U.S. has expired.
I am not illegal; I have a work contract with the University of California until 2027. Still, I must travel outside the U.S. and get a visa stamp on my passport to allow me to move freely to talk about science.
I have to do this every single year I stay in the U.S. The costs of the visa, traveling, time lost, etc, are all on me. Not every international scientist can handle this.
See what our “always online” group just put out! 🤓This was our international March madness for the win! 🏆Catch me at #siop24 or @guenolen at #imps24 or anyone on the team anywhere to chat more about LLM psychometrics! 🚀
Tianjun Sun retweeted
A fascinating paradox: People rate AI responses to their emotional problems as more empathic than human responses, but not if they *know* the response comes from AI.
They feel most "heard" by an AI they think is human, least by a human they think is AI.
pnas.org/doi/10.1073/pnas.23…
Tianjun Sun retweeted
Super fun project on investigating the prediction behavior of LLMs from a psychological perspective🧠
🚨GPT-4 can fall into a cognitive trap and make mistakes even when it has the correct knowledge, like us humans🤯
✅A simple hint helps
Check out our paper for more details👇
Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs
arxiv.org/abs/2404.01461
@PanDwww
@ZilinXiao2
@hanjie_chen
Now that it's official I can share!
I'm moving to @HoustonTX this June and joining @RiceSocSci @RiceUniversity as an Assistant Professor of #IOPsych and #QuantMethods in Fall 24! Very excited to join this fantastic community and very thankful for all who made it possible!! 👐🏼🦉💙
The decision to move has been and will always be bittersweet. I’ll forever cherish the time and memories from @KSUPsychSci and am grateful for @KState for the past ~three years of incredible professional growth. 💜
Tianjun Sun retweeted
Here are our prompts for educators and students, released under Creative Commons license.
They are built around the pedagogical approaches we discuss in our papers, and have worked well in class. I hope others experiment with them, improve them, & share. moreusefulthings.com/
