Jack-In Head (*1) is an immersive experience transmission architecture with a wearable omnidirectional camera for “Human to Human Telepresence” . In Jack-In Head, the first person wears a head gear with an omnidirectional camera and the omnidirectional video are stabilised to decouple ego-motion and transmitted to others. Other persons can virtually look around the immersive visual experience with his or her own head motion with HMD. This can put a person in someone else’s head and communicate each other without feeling dizzy, and even enable individual viewing interaction.
Immersive experience transmission by Jack-In Head has broad applications including entertainment and content distribution (i.e., the audience can share the view from professional sports player), communication such as virtually travel or shopping together, and educational teaching or professional training.

Jack-In Headは、”人へのテレプレゼンス”のための360度全周囲を撮影・伝送可能なウエアラブルカメラによる体験伝送システムです。音声通話に加え、装着者の全周囲映像をスタビライズして他者にリアルタイム伝送することで、他者がその全周囲映像をヘッドトラッキングHMDやスクリーンで自由に見回して観測し、装着者とのコミュニケーションすることができます。
このシステムにより、旅行の同時体験や料理のアシスタントから、特殊体験のリアルタイム配信や、スポーツ観戦のエンターテイメント、プロフェッショナルトレーニングや、専門知識を要する災害や医療協調作業などのアプリケーションが可能になると考えています。

*1) The Jack-In Head project was originally called “LiveSphere”

JackIn Head Original Sketches [Rekimoto 2013]

(note: this gymnast shot was originally created with DENTSU: THE AUGMENTED HUMAN – THE FUSION OF CREATIVE AND TECHNOLOGICAL INNOVATION IN SPORTS, Cannes Lions 2014 Seminar)

References

• Shohei Nagai, Shunichi Kasahara, Jun Rekimoto, LiveSphere: Sharing the Surrounding Visual Environment for Immersive Experience in Remote Collaboration, TEI 2015.PDF
• Shunichi Kasahara, Shohei Nagai and Jun Rekimoto, LiveSphere: immersive experience sharing with 360 degrees head-mounted cameras the 27th annual ACM symposium on User interface software and technology (UIST2014), 2014. [People’s choice best demo Honorable Mention] PDF
• 永井翔平, 笠原俊一，暦本純一, 全周囲映像を用いたヒューマンテレプレゼンスのための体験共有システム, インタラクション2015. PDF
• This Sony researcher wants to put you in someone else’s head, CNET, Sept. 27, 2014
• DENTSU: THE AUGMENTED HUMAN – THE FUSION OF CREATIVE AND TECHNOLOGICAL INNOVATION IN SPORTS, Cannes Lions, 2014
• カンヌ2014電通セミナー