Research
My research develops optical sensing technologies to recover physical information — sound, vibration, material properties — from camera-based observation of the world.
Overview
I work at the intersection of computer vision, acoustics, and human-computer interaction. My primary research direction is event-based visual sensing, where I use event cameras — neuromorphic sensors that capture per-pixel brightness changes at microsecond temporal resolution — to recover physical signals that conventional cameras cannot capture.
A central theme is the Visual Microphone: recovering sound from the imperceptible vibrations of objects in a scene, using only a camera. Event cameras are uniquely suited for this task due to their extreme temporal resolution and low latency, enabling recovery of audible frequencies from everyday objects without any contact.
Alongside sensing, I am interested in how new interaction paradigms can arise from these technologies, particularly in the context of HCI and design tools.
Research Interests
Event Vision
Developing algorithms and systems that exploit the unique properties of event cameras — asynchronous, per-pixel brightness change detection at microsecond resolution.
Visual Microphone
Recovering sound and vibration information from video and event streams, enabling non-contact acoustic sensing from optical observations.
Non-contact Vibration Measurement
High-fidelity reconstruction of structural vibrations using cameras, with applications in acoustic engineering and structural health monitoring.
Human-Computer Interaction
Designing interactive systems that bridge physical sensing and digital interfaces, including EMS-based feedback, conversational design tools, and accessibility.
Current Research
Safe Optical Microphones and Novel Interaction Paradigms
Supported by a JSPS Research Fellowship DC1 (2024–2027), my current project focuses on developing safe optical microphones — systems that can recover sound from physical environments using cameras, without any laser illumination or contact with the target object.
Academic Background
Apr 2024 – Present
PhD in Informatics
Doctoral Program in Informatics, University of Tsukuba
Mar 2024
Master of Informatics
University of Tsukuba
Apr 2022
Enrolled in Master's Program
Graduate School of Library, Information and Media Studies, University of Tsukuba
Mar 2022
Bachelor of Media Arts and Sciences
University of Tsukuba
Dec 2020 – Mar 2021
Technical Staff
AIST (National Institute of Advanced Industrial Science and Technology)
Apr 2020
Transferred to University of Tsukuba
College of Media Arts, Science and Technology
Apr 2017
Enrolled at Nagoya University
School of Informatics, Dept. of Natural Information Science