Research

Query-by-Dancing: A Dance Music Retrieval System Based on Body-Motion Similarity
MMM '19

We developed our Query-by-Dancing system, which uses a video of a dancer (user) as the input query to search a database of dance videos. The query video is recorded using an ordinary RGB camera that does not obtain depth information, like a smartphone camera. The poses and motions in the query are then analyzed and used to retrieve dance videos with similar poses and motions. The system then enables the user to browse the music attached to the videos it retrieves so that the user can find a piece that is appropriate for their dancing.
Automatic System for Editing Dance Videos Recorded by Multiple Cameras
ACE '17

We present a system that automatically edits dance-performance videos taken from multiple viewpoints into a more attractive and sophisticated dance video. Our system can crop the frame of each camera appropriately by using the performer’s behavior and skeleton information. The system determines the camera switches and cut lengths following a probabilistic model of general cinematography guidelines and of knowledge extracted from expert experience
Mimebot: Sphere-shaped Mobile Robot Imitating Rotational Movement
MoMM '16

We propose a mobile robot that can give the audience the optical illusion of the unique movements of a sphere by mounting a spherical light-emitting diode (LED) display on a high-agility wheeled robot. This paper examines a mobile robot in the shape of a ball that is used in theatrical performances and reveals that the movements that are difficult to implement with existing mechanisms can nonetheless be visualized through the use of light.
A Dance Performance Environment in which Performers Dance with Multiple Robotic Balls
AH '16

In this study, we construct a mechanism by which a performer can interactively create a performance while he/she considers the correspondence between his/her motion and the mobile robots' movement and light. Specifically, we developed a system that enables performers to freely create performances with multiple robotics balls that can move omunidirectionnally and have full color LEDs. Performers can design both the movements of the robotic balls and the colors of the LEDs. To evaluate the effectiveness of the system, we had four performers use the system to create and demonstrate performances.
A System for Practicing Formations in Dance Performance Supported by Self-propelled Screen
AH '13

We propose a practice-support system for performing the formation smoothly using a self-propelled screen even if there is no dance partner. We developed a prototype of the system and investigated whether a sense of presence provided by both methods of practicing formations was close to the sense we really obtain when we dance with humans. The result verified that the sense of dancing with a projected video was closest to the sense of dancing with a dancer, and the trajectory information from dancing with a self-propelled robot was close to the trajectory information from dancing with a dancer. Practicing in situations similar to real ones is able to be done by combining these two methods.