Conference Agenda

Session

WS11: AI Workflows Using IIIF

Time:

Wednesday, 03/Dec/2025:

2:45pm - 4:45pm

Location: Brontë A

Knowledge Centre. Capacity: 18 (cabaret)

Presentations

Annotating IIIF Items with AI

Caitlin Perry¹, Michael Appleby², Martin Kalfatovic¹, Glen Robson¹

¹IIIF Consortium, United States of America; ²Yale University, United States of America

Abstract
Workshop participants will learn how to augment a IIIF manifest with AI outputs to increase access, increase research opportunities, and support reuse of digital collections.

This workshop will provide a brief overview of IIIF fundamentals, including the specifications, APIs, and ecosystem of tools and viewers. Participants will then get hands-on experience applying AI models to enhance their manifests with annotations containing the results of AI HTR/OCR and object recognition. They will then learn how to view and share their augmented manifests in Mirador, Universal Viewer, and other IIIF viewers.

Participants should have some familiarity with IIIF and be comfortable with Python. At the end of the workshop, participants will have a Jupyter notebook with reproducible workflows.

Level of experience for attendees with relevant technologies
Intermediate

Instructors

Mike Appleby, Director, Software Engineering, Yale Library
Glen Robson, IIIF Consortium Technical Coordinator

Prework

Basic Introduction to IIIF (Introductory video)
Access Jupyter notebook

Timetable (2 hours)

00:00 - 00:30: Introduction

IIIF Annotations
Commercial models / open model
Prompt engineering

00:30 -1:30:

Content:
- Photographs + Paintings + Herbarium samples
Tasks
- Regions of an image with description
- Identifying text in an image, OCR

1:30-2:00:

Use your own images
Generate a manifest with annotations with attendees' discoveries