Skip to main content
Leoson Cheong
Lead Software Engineer
View all authors

[Academic] FMETP STREAM 6 Powers ACM Research on 360° Stereo Cinema - December 15

· One min read
Leoson Cheong
Lead Software Engineer

As one of the authors, I contributed to the technical solution for this research project.
FMETP STREAM 6 was integrated into the 360° stereo cinema system, supporting real‑time streaming, tracker synchronization, and interactive features.

Docusaurus Plushie

[Integration] Expo 2025 Osaka - September 29

· One min read
Leoson Cheong
Lead Software Engineer

We are excited to see our technology being applied in innovative ways at Expo 2025 Osaka.
FMETP STREAM 6 helped enable real‑time passthrough streaming as part of a VR experience showcased there.

2025.09.29 大阪・関西万博で公開 「話すだけ」でキャラクターが反応、行動する 新しいXR体験 ワントゥーテン、日本弁理士会の出展に参加

[Release] FMETP STREAM 6

· One min read
Leoson Cheong
Lead Software Engineer
FMETP STREAM 6
Docusaurus Plushie

FMETP STREAM 6 is a major upgrade from V4: the core was re written in C++ and optimised for Unity URP, with native platform integrations to improve performance and latency. V6 expanded platform compatibility to include Vision OS and HoloLens 2 and introduced modern codecs and system optimisations.

[Reference] FMETP Unity asset implementation in The Scientific Computing Conference - May 12

· 2 min read
Leoson Cheong
Lead Software Engineer

FMETP Unity asset implementation in The Scientific Computing Conference - May 12

5 Implementation

Escape YOUR brain was developed with Unity and C#. The AR Foundation framework was used for the initial implementation of the AR application [Zwi22]. The Mixed Reality Toolkit (MRTK) was used for porting this application to the HoloLens 2. The overall concept utilizes four main methods of data transmission. First the Photon Unity Network (PUN) 2 asset is used for synchronizing movement (e.g. head movement between AR and VR), game events (e.g. level completion) and voice (by using the Photon Voice extension) over a cloud based solution. Between the AR, VR and admin application (gamemaster) as well as the web dashboard (gamemaster) the WebSocket protocol is used to stream the player’s view (FMETP Unity asset). Furthermore, the WebSocket protocol is also used between the dashboard and a backend server for transmitting the current time and other game information. This information is obtained through REST calls originating from the mobile application to the backend server. This backend server forwards this information via the fourth way of data transmission, MQTT, to the admin application. By leveraging this protocol, the overall architecture supports the integration of IoT devices to further enhance the players’ immersion.