by

INTERACTION 2024

INTERACTION 2024 (2024/3/6 – 3/8 開催）にて、以下の論文を発表します：

FastPerson: ユーザ中心の学習体験のための視覚・音声情報に基づく講義動画要約
河村 和紀，暦本 純一（東大／ソニーCSL）

 WhisperMask:騒音環境で音声入力可能なマスク型マイク
平城 裕隆（東大／産総研），金澤 周介，三浦 貴大，吉田 学，持丸 正明（産総研），暦本 純一（東大／ソニーCSL）

Serendipity Wall: 会話文字起こしのベクター検索と大規模言語モデルによる議論支援システム
今村 翔太（東大），平城 裕隆（東大／産総研），暦本 純一（東大／ソニーCSL）

INTERACTION 2024
by

CHI2023 Presentations

At ACM CHI2023, we present the following papers and interactivities:

Papers:

  1. Zixiong Su, Shitao Fang, and Jun Rekimoto LipLearner: Customizable Silent Speech Interactions on Mobile Devices, [Best Paper Award] [Link] [Project Page]
  2. Jun Rekimoto, WESPER: Zero-shot and Realtime Whisper to Normal Voice Conversion for Whisper-based Speech interactions, [Link] [Project Page]

Interactivity:

  1. Yuna Watanabe, Xi Laura Cang, Rúbia Reis Guerra, Devyani McLaren, Preeti Vyas, Jun Rekimoto, Karon E MacLean, Demonstrating Virtual Teamwork with Synchrobots: A Robot-Mediated Approach to Improving Connectedness, [Link]
  2. Hirotaka Hiraki, Shusuke Kanazawa, Takahiro Miura, Manabu Yoshida, Masaaki Mochimaru, Jun Rekimoto, External noise reduction using WhisperMask, a mask-type wearable microphone, [Link]
  3. Kei Asano, Naoki Kimura, Jun Rekimoto, HMDspeller: Fast and Hands-free Text Entry System for Head Mount Displays using Silent Spelling Recognition, [Link]
  4. Kunihiro Kato, Ami Motomura, Kaori Ikematsu, Hiromi Nakamura, Yuki Igarashi, Demonstrating FoodSkin: A Method for Creating Electronic Circuits on Food Surfaces by Using Edible Gold Leaf for Enhancement of Eating Experience, [Link]
by

Augmented Humans 2023


At Augmented Humans 2023 (March 12-14,2023, Glasgow, UK),
we present the following research:

  • Kazuki Kawamura and Jun Rekimoto AIx speed: Playback Speed Optimization using Listening Comprehension of Speech Recognition Models (paper)
  • Yuto Koike, Yuichi Hiroi, Yuta Itoh, and Jun Rekimoto Brain-Computer Interface using Directional Auditory Perception (poster) [Best Poster Honorable Mentions]img_0812
by

ACM ISS 2022 10-Year Impact Award

The following paper received “ACM ISS 2022 10 Year Impact Award”

Mujibiya, Adiyan and Cao, Xiang and Tan, Desney S. and Morris, Dan and Patel, Shwetak N. and Rekimoto, Jun, The Sound of Touch: On-body Touch and Gesture Sensing Based on Transdermal Ultrasound Propagation,  Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces, ACM ITS 2013.

Project Page https://lab.rekimoto.org/projects/the-sound-of-touch/
TSOT1
by

Rekimoto Lab Openhouse 2022

2022年11月25日（金）13:00 ~ 17:00 に東京大学大学院情報学環暦本研究室のオープンハウス（共催：東京大学ヒューマンオーグメンテーション社会連携講座）を開催いたします。
新型コロナウイルス感染症対策として、本年のオープンハウスは時間帯ごとの事前予約制とさせていただきます。
以下サイトより登録をよろしくお願いいたします。

https://rkmtlab.github.io/openhouse2022/

by

UIST 2022 presentations

At ACM UIST 2022, we present the following papers/posters:

papers:

  • Jun Rekimoto, DualVoice: Speech Interaction that Discriminates between Normal and Whispered Voice Input, ACM UIST 2022, paper, [UIST] [ACMDL] [arXiv] [project]
  • Jonathan Sutton, Tobias Langlotz, Alexander Plopski, Stefanie Zollmann, Yuta Itoh, Holger Regenbrecht, Look over there! Investigating Saliency Modulation for Visual Guidance with Augmented Reality Glasses, ACM UIST 2022, paper [UIST]

posters:

  • Kazuki Kawamura, Jun Rekimoto, AIx speed: Playback Speed Optimization using Listening Comprehension of Speech Recognition Models, ACM UIST 2022, poster [UIST]
  • Wanhui Li, Takuto Nakamura, Jun Rekimoto, RemoconHanger: Making Head Rotation in Remote Person using the Hanger Reflex, ACM UIST 2022, poster [UIST]
  • Hirotaka Hiraki, Jun Rekimoto, SilentWhisper: faint whisper speech using wearable microphone, ACM UIST 2022 poster [UIST]
  • Zixiong Su, Shitao Fang, Jun Rekimoto, LipLearner: Customizing Silent Speech Commands from Voice Input using One-shot Lipreading, ACM UIST 2022 poster [UIST]
  • Naoki Kimura, Self-Supervised Approach for Few-shot Hand Gesture Recognition, ACM UIST 2022 poster [UIST]