Research
My research develops optical sensing technologies to recover physical information — sound, vibration, material properties — from camera-based observation of the world.
Overview
I work at the intersection of computer vision, acoustics, and human-computer interaction. My primary research direction is event-based visual sensing, where I use event cameras — neuromorphic sensors that capture per-pixel brightness changes at microsecond temporal resolution — to recover physical signals that conventional cameras cannot capture.
A central theme is the Visual Microphone: recovering sound from the imperceptible vibrations of objects in a scene, using only a camera. Event cameras are uniquely suited for this task due to their extreme temporal resolution and low latency, enabling recovery of audible frequencies from everyday objects without any contact.
Alongside sensing, I am interested in how new interaction paradigms can arise from these technologies, particularly in the context of HCI and design tools.
Research Interests
Event Vision
Developing algorithms and systems that exploit the unique properties of event cameras — asynchronous, per-pixel brightness change detection at microsecond resolution.
Visual Microphone
Recovering sound and vibration information from video and event streams, enabling non-contact acoustic sensing from optical observations.
Non-contact Vibration Measurement
High-fidelity reconstruction of structural vibrations using cameras, with applications in acoustic engineering and structural health monitoring.
Human-Computer Interaction
Designing interactive systems that bridge physical sensing and digital interfaces, including EMS-based feedback, conversational design tools, and accessibility.
Current Research
Safe Optical Microphones and Novel Interaction Paradigms
Supported by a JSPS Research Fellowship DC1 (2024–2027), my current project focuses on developing safe optical microphones — systems that can recover sound from physical environments using cameras, without any laser illumination or contact with the target object.
Academic Background
Education
- Apr 2024 – Present
PhD in Informatics
University of Tsukuba · Doctoral Program in Informatics
- Apr 2022 – Mar 2024
Master of Informatics
University of Tsukuba · Graduate School of Library, Information and Media Studies
- Apr 2020 – Mar 2022
Bachelor of Engineering (Transfer)
University of Tsukuba · College of Media Arts, Science and Technology
- Apr 2017 – Mar 2020
Bachelor of Informatics (Transfer from)
Nagoya University · School of Informatics, Dept. of Natural Information Science
Positions
- Apr 2024 – Mar 2027
JSPS Research Fellow (DC1)
Japan Society for the Promotion of Science
- Dec 2024 – Present
Part-time Researcher
Digital Nature Group Research Center, University of Tsukuba
- Oct 2023 – Jun 2025
Research Intern
OMRON SINIC X
- Dec 2020 – Mar 2021
Technical Staff
AIST (National Institute of Advanced Industrial Science and Technology)