[Customizable Captions] [2024] [ASSETS  Conference]

Current closed-captioning systems are one-size-sorta-fits-ok-for-some. Exciting research in new captioning technologies is currently siloed and difficult to replicate and compare. Rich Captions is a structured system that allows for a single closed-caption file to be tagged with additional information that can then be flexibly leveraged to render different customizable, creative, and poetic captions from the same file.

[Non-Speech Information in Captions] [2024] [CHI  Conference]

YouTube is the wonderful wild west of video streaming, and the captioning practices across YouTube are similarly wild. We take a systematic look at captioning practices over time on popular YouTube videos and are uncovering some interesting trends.
Spoiler: Most folks do not do a great job of captioning NSI...

[Critical Design] [2023] [ASSETS  Conference]

Non-speech information (NSI), things like music, footsteps, and gunshots, can be tricky to communicate with closed-captioning. We explored current problems with NSI captioning using a sound-visualizer prototype to better understand current challenges and opportunities.

[Customizable Captions] [On Going] 

"[Ecstatic music plays]" or
"[Vroom Vroom by Charli XCX plays]" or
"[Dark electronic pop music plays]"

Which do you prefer? Wouldn't it be great if captioning systems gave you these choices?
Let's Ride