AR Exhibit Reassembler

  • Area: Immersion & Presence (WP6), Creation Tools (WP3)
  • Contributors: Hochschule RheinMain
  • Key Contact: Ulrike Spierling (ulrike.spierling@hs-rm.de)
  • Date: March 2026

1. Overview

A puzzle-like interaction where visitors reassemble an exhibit in AR.

Name

  • AR Exhibit Reassembler

Intent

Enable visitors to virtually reconstruct missing artifact components through an interactive 3D puzzle, deepening comprehension of the whole form and its significance.

2. Target

Problem

When only partial physical artifacts are on display, visitors struggle to grasp the complete structure and relationships between parts.

Context

  • Exhibits with missing components (fossils, machinery, relics).
  • Digital reconstructions available for the absent pieces.
  • Desire to engage users in an active, hands-on learning process.

Use When

  • Visitors encounter artifacts with substantial missing elements.
  • The goal is to teach overall structure via participatory assembly.

Forces

  • Engagement vs. Complexity: Balancing puzzle difficulty to avoid frustration.
  • Accuracy vs. Playfulness: Ensuring reconstructions are correct while remaining fun.
  • Spatial Registration: Aligning virtual pieces precisely with the physical artifact.
  • Feedback Responsiveness: Providing timely confirmation to sustain motivation.

Consequences

Weaknesses:

  • Poor tracking or misplacements can cause confusion; overly simple puzzles may feel trivial.

Strengths:

  • Active learning, improved spatial understanding, memorable interaction.

3. Application

Game Mechanics

  • Type: Jigsaw puzzle
  • Piece Matching: Identify and align puzzle pieces based onshape, color, or patterns.
  • Spatial Arrangement: Determine correct spatial placement of pieces within the layout.
  • Pattern Recognition: Identify connections using visual cues.
  • Trial and Error: Experiment with combinations to find correct fits.
  • Progression Feedback: Provide a sense of progress and achievement.
  • Challenge Balancing: Adjust difficulty by varying the complexity of components.

Solution

1. Jigsaw-Puzzle Mechanic

  • Spawn interactive 3D fragments representing the missing parts.
  • Allow visitors to drag or gesture-match edges/textures to snap pieces into place on the physical artifact.

2. Progression Feedback 

  • On correct placement, play a glow animation on the piece and an encouraging audio cue.
  • Update a visible completion meter (e.g., “3 of 8 pieces assembled”).

3. Adaptive Challenge 

  • Start with boundary or high-contrast pieces for early confidence.
  • Introduce subtler shapes or mirrored fragments as users progress, adapting based on placement speed and errors.

4. Guidance & Tutorial (Optional) 

  • Highlight an initial docking region with a pulsing indicator.
  • Play a brief voice-over or display on-screen instructions explaining controls and objectives.

5. Narrative Enhancements (Optional)

  • As sections assemble, trigger contextual facts (e.g., “This vertebra supported the spinal cord”) via text and audio to weave learning into the flow.

Rationale

  • Transforming passive viewing into active assembly engages spatial reasoning and contextualizes individual components within the artifact’s holistic form, reinforcing educational outcomes.

Design Parameters

  • Piece Count: 4–8 fragments to balance challenge and completion time
  • Snap Tolerance: 0.2–0.5 m positional threshold, 10-30° rotational allowance
  • Feedback Delay: ≤ 1 s between placement and confirmation
  • Completion Meter: Updated immediately upon each placement

Example

At a fossil exhibit where only part of the original exhibit is physically preserved, visitors launch an AR puzzle that presents the missing bones as virtual fragments. They pick up and position these pieces one by one, aligning them with the physical remains until they snap into place. Each correct placement triggers a short visual and audio confirmation, while a completion indicator shows overall progress. Through this process, visitors gradually understand the full structure of the exhibit rather than only viewing isolated remains.

Notes

This pattern transforms incomplete physical remains into a hands-on, completion-driven experience that reinforces structural understanding and sustains visitor motivation.

Related Patterns:


Team


  • Yu Liu – Researcher and AR Designer/Developer
  • Dr. Ulrike Spierling – Principal Investigator

Partners


Hochschule RheinMain

Related Resources