A research center at Harvard working to strengthen society’s connection to knowledge by advancing our access to and understanding of the data that shapes AI.

Joined August 2024
Institutional Data Initiative retweeted
AI enables new forms of research, but only where information is computationally accessible. Today, IDI (@instdin) and the University of Michigan Library (@UMichLibrary) are releasing a structured dataset that makes 186 years of U-M’s Board of Regents Proceedings newly accessible. Links in the thread below. Organizational decision-making is fertile ground for AI-assisted research, but board minutes often bury key decisions in narrative prose. Using reasoning models, we worked with U-M Library to extract and structure these decisions so researchers can use computational tools to study the evolution of U-M. Across nearly two centuries, we identified leadership changes, fundraising progress, building campaigns, and other strategic plans. These include the creation of university race and gender policies following the passage of the Civil Rights Act as well as a 1921 $1M alumnae drive for a “women’s building,” launched after women were barred from entering the Michigan Union without a male escort. This project is the first of many that the Institutional Data Initiative at Harvard Law School Library is undertaking to help libraries and other knowledge institutions enable computational access to their collections. If you represent a library and would like to work together, we'd love to hear from you.
1
1
152
Institutional Data Initiative retweeted
Amazing work from an amazing team using @instdin’s Institutional Books data release. Their dedication to detail and accuracy is sorely missing from the vast majority of historical-data work from the AI community. Yet there’s so much work to be done and benefit to getting it right
Announcing Talkie: a new, open-weight historical LLM! We trained and finetuned a 13B model on a newly-curated dataset of only pre-1930 data. Try it below! with @AlecRad and @status_effects 🧵
1
5
1
3
3,376
Institutional Data Initiative retweeted
We're also sharing the pipeline we developed for Institutional Books that seamlessly dedupes, classifies, and enhances the data once GRIN Transfer brings it down. institutional.org/tools
1
1
2
130
Institutional Data Initiative retweeted
When libraries participate in Google Books, Google not only scans their books, it also makes a wealth of image, OCR, and metadata available to them via the Google Return Interface (GRIN). But working with GRIN can be challenging.
1
1
1
154
Institutional Data Initiative retweeted
What is the pathway towards greater diversity in data and AI? Hear from Professor Ruth Okediji, scholar of IP Law at Harvard Law School, who will be in conversation with Assistant Dean Amanda Watson of the Harvard Law School Library on Oct 22 at 2PM. harvard.zoom.us/meeting/regi…
1
1
135
Institutional Data Initiative retweeted
This Monday, @instdin will host @petrknoth to share his experience leading CORE ("The world’s largest collection of open access research papers") as the rise of AI brings new meaning, and challenges, to stewarding knowledge repositories. Join us virtually via the link below.
1
2
1
2
536
Institutional Data Initiative retweeted
Tomorrow, it's our pleasure to host @ayahbdeir to talk about the power of data in building an AI ecosystem that's open, transparent, and fair. 11am ET on June 17th. Register at the link below to attend virtually. Cohosted by the @instdin and @BKCHarvard.
1
2
5
958
Institutional Data Initiative retweeted
I've loved writing words, while loops and wandering wectors, so I'm thrilled to join the @instdin team at Harvard as the director of community and communications! institutionaldatainitiative.…
2
2
11
904
Institutional Data Initiative retweeted
As the Institutional Data Initiative (@instdin) expands its mission, we’re announcing a collaboration with the Boston Public Library (@BPLBoston) to develop AI-driven tools capable of accelerating new digitization at libraries across the world, starting at BPL. 🧵
1
7
1
6
1,587
Institutional Data Initiative retweeted
I'm pleased to announce we're expanding our mission at the Institutional Data Initiative (@instdin) with an open call for institutional collaborators, new digitization at Harvard Law School Library, and additional support to advance this work.
2
5
14
1,526
Institutional Data Initiative retweeted
Today we're launching the Institutional Data Initiative to work with libraries, gov agencies, and other knowledge institutions to help refine and publish their collections as data, with an eye toward AI. 🧵
2
16
22
3,869