WonderScope.

Practical Near-surface AR Device for Museum Exhibits

Funded by.
National Research Foundation of Korea


Awards.
 Best in Show Honorable Mentions, 2022
iF Design Award - UX, 2023

Presented at.
SIGGRAPH Emerging Technologies, 2022


DOI︎︎︎  PAPER︎︎︎  VIDEO︎︎︎


Team Project

HyeonBeom Yi, Yeeun Shin, Sehee Lee,
Eunhye Youn, Auejin Ham
Advisors: Prof. Geehyuk Lee, Prof. Woohun Lee

Deliverables

  • Augmented Reality (AR) Device
  • Mobile Application 
  • Interactive Exhibition at SIGGRAPH & Museums

Responsibilities

  • Lead AR Scenario Design
  • Unity Mobile App Development
  • Hardware Modeling and 3D Printing

Tools

Unity 3D(C#). Figma.
Research: Interview. Design workshop.
Modeling: Rhinoceros. Fusion 360,
Fabrication: Laser cutter. 3D printer.





What if we could see through exhibits like a magic lens
while stroking the surface of it?


Mobile augmented reality (AR) apps have become essential tools for delivering information to museum visitors.
However, interacting through a screen can potentially distract visitors from the exhibits. (digital contents keep a distance from exhibits)
We propose WonderScope, enhancing practical near-surface AR interaction on mobile devices.







My Role   


Led the design of captivating multimodal AR scenarios:
End-to-end process encompassing ideation, design workshop, concept design, interface and content design, hardware modeling and 3D printing, and mobile app development (Unity)
Devised two applications/demos:
  • Probe type (lunar surface exploration concept) 
  • Built-in type (gamified underground exploration concept)


These applications, which I was responsible for, were selected and presented at SIGGRAPH 2022.



ABSTRACT

Mobile augmented reality (AR) applications have become essential tools for delivering additional information to museum visitors. However, interacting through a mobile screen can potentially distract visitors from the exhibits. We propose WonderScope which is a peripheral system for mobile devices that enables practical near-surface AR interaction. Using a single small RFID tag on the exhibit as the origin, WonderScope can detect the position and orientation of the device on the surface of the exhibit. It performs on various surfaces of different materials based on the result of data fusion from two types of displacement sensors and an accelerometer of an inertial measurement unit (IMU). The mobile application utilizes the data for spatial registration of digital content on the exhibit’s surface, which make the users feel like seeing-through or magnifying the surface of exhibits.




Problem Definition










Interaction Overview










Embeded System



Near-Surface Augmented Reality


  • RFID TAG
    Identifying exhibits and setting an originof the device position relative to the exhibit

  • Sensors Combination Algorithm
    Tracking the user’s movement and orientation





Scenario Derivation & Implementation



EXPERT INTERVIEW

Interviewed 2 museum curators and 1 content designer
Observed museum visitors to compare exhibition methods and gather actionable insights

DESIGN WORKSHOP

1 hour design workshop with 4 designers
including prototype demo, bodystoming, and ideation session




Based on insights, developed captivating multimodal AR scenarios/demos







Impact 








Achievement


Showcased at.





Introduced in.

Click logo for news




Award.

Click logo for details




YEEUN7492@GMAIL.COM
ⓒ 2023 DESIGN/CODE BY YEEUN SHIN