Frank Proctor (@FEProctor) header
Frank Proctor (@FEProctor) profile picture

Following research in AI and ML. Student of the sciences. 'Ignorance is fatal, Mr Garrett.'

Chapel Hill, NC
Joined January 2013
Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)Photo by Frank Proctor (@FEProctor)
Frank Proctor retweeted
Had a great time speaking at @indoml_sym & meeting students+faculty+researchers (overall, kudos to organizers+volunteers on an excellent program)! 🙂 Talked about our long journey on Multimodal Generative LLMs: (1) Unified/Universal Multimodal Learning for Generalizability, Shared Knowledge, Efficiency: LXMERT ➡️ VL-T5 ➡️ TVLT ➡️ UDOP ➡️ CoDi1+CoDi2 (2) LLM Planning/Programming for Interpretable+Controllable+Faithful Multimodal Generation: VPGen ➡️ DiagrammerGPT ➡️  VideoDirectorGPT (3) Evaluation of Multimodal Generation Models for Fine-grained Skills, Faithfulness, Social Biases: DALL-Eval ➡️ VPEval ➡️ Davidsonian Scene Graph
Day 1: Session 1 Foundational and Generative Models Talk 3: Mohit Bansal Professor University of North Carolina at Chapel Hill We’re really excited to play around with his state-of-the-art any-to-any multimodal models CoDi and CoDi-2 ! #indoml #ml #iitbombay #aiml
11
81
10,087
Frank Proctor retweeted
Honored and excited to give a keynote at @aaclmeeting! I'll be talking about various challenging aspects of Multimodal Generative LLMs: unification, faithfulness, interpretability+evaluation, efficiency. Looking forward to the conference + seeing everyone in Bali 🏖️🌊 #AACL2023
Exciting news! 🎉 Meet our four wonderful Keynote Speakers for #AACL2023! 🌟 Don't miss insights from - Hinrich Schütze @ University of Munich - Julia Hockenmaier @ UIUC - Mohit Bansal @ UNC - Katherine Zacarian @ Earth Species Project afnlp.org/conferences/ijcnlp… #NLProc
2
17
126
15,749
Today we’re joined by Mohit Bansal (@mohitban47), Professor at @unccs, to discuss his work on the unification of language and vision models, the advancement he’s seen in multimodal models, challenges of evaluation in generative AI, and much more! 🎧twimlai.com/podcast/twimlai/…
7
2
21
12,751
🚨🔥 Exciting blog coverage 👇 of Microsoft-UNC collaboration on "Composable Diffusion (CoDi)", a novel generative-AI model that can generate any-to-any combination of modalities (text, audio, image, video) ➡️ codi-gen.github.io @ZinengTang @mohitban47 @yzy_ai @MSFTResearch
Composable Diffusion (CoDi) is a novel generative AI model that can process and simultaneously generate high-quality multimodal content spanning text, images, video, and audio. It’s a big step towards more engaging and holistic human-computer interactions. msft.it/6019gsmRV
1
6
1
18
4,321
Vancouver area friends: Dorothy Tse & James Shea will be giving a talk on HK literature in translation on 15 June at 3:00 pm at UBC library hksi.ubc.ca/events/event/con…
2
1
1
7
1,338
Frank Proctor retweeted
🎉🎉 Welcome to the @unc @unccs @uncnlp family, Prof. @TianlongChen4!! Looking forward to having you here soon & to the many fun collaborations 😀 PS. Students applying for fall2024 PhD admissions, take note 👇
Multiple Openings for Ph.D. Students (Fall 2024)!!! - CS@UNC-Chapel Hill (Tianlong Chen) More details: lnkd.in/eycn_8jm - CS@Simon Fraser University [Vancouver, Canada] (Wuyang Chen) More details: lnkd.in/eYn-rb-5
8
1
38
6,075
I want to live in this world.
Chuck Jones nine rules for how the coyote and roadrunner functioned. So cool.
4
5
Frank Proctor retweeted
Isaac Asimov's three laws of robotics, 1965
8
112
8
349
Frank Proctor retweeted
Theme #ACL2022 paper w. #Cherokee+Linguistics friends on Revitalization-Roadmap ➡️ Don't jump in w/ NLP but first understand+respect+decolonize+build community; NLP for lang educ & collaborative-resource-collection; ocr/asr/mt/parse tools+results. Join us! arxiv.org/abs/2204.11909
ᏏᏲ/ᎣᏏᏲ, ​​happy to share our #ACL2022 theme paper “How can NLP Help Revitalize Endangered Languages? A Case Study and Roadmap for the #Cherokee ᏣᎳᎩ Language” 🚨CORRECTED LINK🚨arxiv.org/abs/2204.11909 w. BenFrey (@AMST_UNC @UNCLinguistics @VisitCherokee) + @mohitban47
1
4
8
Frank Proctor retweeted
Solar System colors thread! ☀️🪐🌕
The true colors of the solar system, a short thread. * First, let's start with the Sun. Can we all agree it's white to the eye? * inspired by James O’Donoghue & Marina Koren, with some color corrections by me.
1
27
3
129
Port side boom! Surely everyone else is also checking on the giant space telescope deployment like every two hours? jwst.nasa.gov/content/webbLa…
1
3
Frank Proctor retweeted
Ray Bradbury Wrote the First Draft of Fahrenheit 451 on Coin-Operated Typewriters, for a Total of $9.80 openculture.com/2020/11/ray-…
31
89
53 years ago today, on Christmas Eve, 01968, the astronauts of the Apollo 8 mission became the first humans to take a picture of the Whole Earth from space. It changed everything. medium.com/the-long-now-foun…
1
39
2
130
Frank Proctor retweeted
🎉🎉 Yay congrats Shiyue on being awarded the @Bloomberg PhD Fellowship, for her impactful work on low-resource NLG (eg. Cherokee revitalization) & summarization! #ProudAdvisor 🙂 PS. She'll be on job market in 1 year and is awesome, definitely get her -> cs.unc.edu/~shiyue/
I am very honored to receive a @Bloomberg Data Science Ph.D. Fellowship! Many thanks to my advisor @mohitban47 for all the support and guidance I received. I’d also like to thank all my labmates @uncnlp, collaborators, and mentors for their help all along!
1
5
52
Check out this @UNC article+video about the amazing work being done by our @uncnlp's Shiyue Zhang (@byryuer) on helping revitalize Cherokee language using NLP research, with Prof. Mohit Bansal (@mohitban47) and Prof. Ben Frey (@AMST_UNC @UNCLinguistics)! @UNCResearch @unccollege
There are fewer than 200 native Cherokee speakers in our state. @AMST_UNC's Benjamin Frey teamed up with @uncnlp’s Mohit Bansal and Shiyue Zhang in @unccs to create a new translation model and help revitalize the language: unc.live/2YNeDz8
Frank Proctor retweeted
🎉🥳 Congrats to @biunlp+@uncnlp 'SuperPAL' team for winning the @CoNLL_conf Best Paper Award runner-up! arxiv.org/abs/2009.00590 Authors: @oriern1 @obspp18 @ramakanth1729 lepioshkin goldberger @mohitban47 idodagan (congrats to all the other winners too) #conll2021 #emnlp2021
Congratulations to the winner and runner-ups of the CoNLL 2021 Best Paper Award! #CoNLL2021 The runner-ups are:
1
13
1
29
Frank Proctor retweeted
Our latest op-ed addresses how a National Research Cloud has the potential to challenge tech power concentrations and give academic researchers the same access to #AI research and development that Big Tech enjoys. @StanfordHAI thehill.com/opinion/technolo…
1
22
2
53
Frank Proctor retweeted
Here is the full program from @UNCNLP+collaborators at #EMNLP2021 this week ➡️ nlp.cs.unc.edu/emnlp2021/ We're also 𝗵𝗶𝗿𝗶𝗻𝗴 𝗣𝗼𝘀𝘁𝗱𝗼𝗰𝘀+𝗣𝗵𝗗 𝘀𝘁𝘂𝗱𝗲𝗻𝘁𝘀! Plz spread the word & ping faculty @mohitban47 @snigdhac25 @colinraffel @shsriva +students for any questions😀
1
19
1
52
Frank Proctor retweeted
The metaverse is already here – it's Minecraft clivethompson.medium.com/the… (news.ycombinator.com/item?id…)
2
3