Ryogo Niwa

Ryogo Niwa

丹羽 遼吾

PhD Student · University of Tsukuba

Event VisionVisual MicrophoneVisual Vibration MeasurementNon-contact SensingHuman-Computer Interaction (HCI)
Event CameraVibration SensingComputer VisionAcoustics

Event Topology-based Visual Vibrometer

A novel non-contact vibration measurement system using event cameras. By leveraging the topology of event streams, we achieve high-fidelity reconstruction of vibration amplitude and frequency without physical contact. Published as a Featured Article in Applied Physics Letters.

View Project
Event CameraVisual MicrophoneSignal ProcessingComputer Vision

Event-based Visual Microphone

Recovery of sound from silent video using event cameras. Event cameras capture per-pixel brightness changes at microsecond resolution, enabling recovery of audible vibrations from objects — a significant improvement over classical visual microphone approaches using conventional cameras.

View Project
HCILLMDesign OptimizationNatural Language

Cooperative Design Optimization through Natural Language Interaction

A system enabling collaborative design optimization through natural language dialogue. Users iteratively refine design objectives and constraints via conversational AI, making multi-objective engineering optimization more accessible and intuitive.

View Project
DroneHCIInteractive ArtCG

Drone Badminton

An interactive experience combining drones and badminton, exploring new forms of human-drone interaction and physical play. Awarded the Accenture Interactive Prize at the Student CG Contest.

HapticsHCIAir VortexNotification

Air Talk-Starter (SHITARA)

SHITARA is a haptic notification device that delivers a tactile alarm via a ring-shaped air vortex. The system enables touch-like remote notification without physical contact, opening new possibilities for ambient and haptic communication.

Recent Publications

View all →

Awards & Honors

  • 2023

    Ezaki Award, University of Tsukuba Alumni Association

  • 2023

    Tsukuba Scholarship Research Encouragement

  • 2024

    JSPS Research Fellowship DC1 (¥2.3M)

    Development of safe optical microphones and novel interaction paradigms

  • 2023

    Student Excellence Award, Acoustical Society of Japan

  • 2022

    Leave a Nest Research Grant, incu·be Award

  • 2022

    CREST AIP Network Lab Director Award

  • 2022

    CREST AIP Challenge Research Grant (¥1M)

  • 2021

    Drone Badminton — Student CG Contest, Accenture Interactive Award

Projects

View all →

Event Topology-based Visual Vibrometer

Event-based Visual Microphone

Cooperative Design Optimization through Natural Language Interaction

Drone Badminton

Current Positions

  • Apr 2024 – Mar 2027JSPS Research Fellow (DC1) · Japan Society for the Promotion of Science
  • Dec 2024 – PresentPart-time Researcher · Digital Nature Group Research Center, University of Tsukuba