Research

Query-by-Dancing: 身体動作の類似性に基づくダンス楽曲検索システム
WISS '18

ダンス動画データベース中を検索するためのクエリとして,ユーザのダンス動作を用いるQuery-by-Dancingを開発した. このシステムは,クエリであるダンスに含まれるポーズ(姿勢)とモーション(動作)を抽出し,それらに類似したポーズとモーションが含まれるダンス動画を検索する. 得られたダンス動画に付随する楽曲を用いることで,自分のダンスに適した楽曲を検索できる.
Automatic System for Editing Dance Videos Recorded by Multiple Cameras
ACE '17

We present a system that automatically edits dance-performance videos taken from multiple viewpoints into a more attractive and sophisticated dance video. Our system can crop the frame of each camera appropriately by using the performer’s behavior and skeleton information. The system determines the camera switches and cut lengths following a probabilistic model of general cinematography guidelines and of knowledge extracted from expert experience
Mimebot: Sphere-shaped Mobile Robot Imitating Rotational Movement
MoMM '16

We propose a mobile robot that can give the audience the optical illusion of the unique movements of a sphere by mounting a spherical light-emitting diode (LED) display on a high-agility wheeled robot. This paper examines a mobile robot in the shape of a ball that is used in theatrical performances and reveals that the movements that are difficult to implement with existing mechanisms can nonetheless be visualized through the use of light.
A Dance Performance Environment in which Performers Dance with Multiple Robotic Balls
AH '16

In this study, we construct a mechanism by which a performer can interactively create a performance while he/she considers the correspondence between his/her motion and the mobile robots' movement and light. Specifically, we developed a system that enables performers to freely create performances with multiple robotics balls that can move omunidirectionnally and have full color LEDs. Performers can design both the movements of the robotic balls and the colors of the LEDs. To evaluate the effectiveness of the system, we had four performers use the system to create and demonstrate performances.
A System for Practicing Formations in Dance Performance Supported by Self-propelled Screen
AH '13

We propose a practice-support system for performing the formation smoothly using a self-propelled screen even if there is no dance partner. We developed a prototype of the system and investigated whether a sense of presence provided by both methods of practicing formations was close to the sense we really obtain when we dance with humans. The result verified that the sense of dancing with a projected video was closest to the sense of dancing with a dancer, and the trajectory information from dancing with a self-propelled robot was close to the trajectory information from dancing with a dancer. Practicing in situations similar to real ones is able to be done by combining these two methods.