Augmented and Virtual Reality Dioramas and Arboretums for Museum XR Exhibition Engagement and Learning Design | #MW20-2s
Maria Harrington, University of Central Florida, USA
AbstractThis lightning talk will show short video clips demonstrating enhanced engagement and learning using XR applications. Virtual dioramas, virtual arboretums, and virtual field trips with XR may be used to extend learning, both inside and outside of natural history museums to reach a broader audience. Introduced will be a modified participatory design process used in the creation of these applications. By focusing on quality in the production process, critical path, and factual scientific accuracy, authoritative curator narratives, user experience, technical constraints and opportunities, and informal learning impact, it may shed light on ways other museums collaboratively co-design and co-create immersive learning experiences with AR, VR, and XR.
Keywords: Augmented Reality, Virtual Reality, Responsive, Immersive, Multimodal, Interactive, Dioramas
This lightning talk will show short video clips demonstrating enhanced engagement and learning using immersive, multimedia, interactive augmented reality (AR) apps (Harrington, et. al., 2019) and virtual reality field trips (Harrington, 2011). Virtual dioramas, virtual arboretums, and virtual field trips with XR may be used to extend learning, both inside and outside of natural history museums to reach a broader audience. Data from a study conducted in July 2019 in a natural history museum will review the learning impacts of the AR app design. Demonstrated will be evidence of different types of learning behavior between traditional dioramas and those enhanced with context-sensitive AR apps. Actual learning gains of 40%, average dwell times of 9 minutes, increased engagement, social interactions, and evidence of embodiment and presence indicate the value of this unique design. Introduced will be a modified participatory design process, extending user-centered design (Norman, 1986), to incorporate iterative, high information rich content, user experience, and learning sciences reviews. The design, development, and production process of the AR app and a related project, a virtual arboretum, will be introduced as a new digital media project management technique to ensure success of the resulting XR products. By focusing on quality in the production process, critical path, and factual scientific accuracy, authoritative curator narratives, user experience, technical constraints and opportunities, and informal learning impact, it may shed light on ways other museums collaboratively co-design and co-create immersive learning experiences with AR, VR, and XR. Both projects were developed at The Harrington Lab at the University of Central Florida (UCF) and with interdisciplinary partnerships with the UCF Arboretum, and the Powdermill Nature Reserve at Carnegie Museum of Natural History, and the MultiMediaTechnology program of the Salzburg University of Applied Sciences, Austria.
Link to the prerecorded presentation: https://youtu.be/0hrURMivzoU
AR Perpetual Garden Apps tested at the Carnegie Museum of Natural History in a July 2019 study
The AR Perpetual Garden Apps are examples of immersive, multimodal, interactive, data visualization and bioacoustic virtual dioramas for use inside or outside museums, schools, homes, or other places for learning and education.
- AR Perpetual Garden Apps Video: https://youtu.be/maJ7iOu2BT4
- The Carnegie Museum of Natural History July 2019 study video: https://youtu.be/Bwcjp-u0MOc
- The Virtual Garden Timeline educational website: https://virtualgarden.powdermill.org/
- Published on Google Play Android Store (Version 6.6.6) Launched November 30, 2018. Available from https://play.google.com/store/apps/details?id=com.carnegie.garden
- Published on Apple iTunes App Store (Version 1.2) Launched October 25, 2018. Available from https://itunes.apple.com/us/app/ar-perpetual-garden/id1438086490?mt=8
The Virtual UCF Arboretum
The Virtual UCF Arboretum is an an example of virtual nature, and it may be used as a virtual field trip or educational simulation. It is an immersive, interactive, multimodal, data visualization and bioacoustic environment. It may be used on VR capable desktops, or with other VR devices such as HTC Vive, VR walls, or CAVES, for learning and education. Ideal for exploration and inquiry, it supports informal learning activities with responsive access to knowledge at the moment of interest.
- Video of The Virtual UCF Arboretum: https://youtu.be/qFbWvr5SDUE
- The Virtual UCF Arboretum Project: http://mariacrharrington.org/virtualnature.html
- Published on Itch.io – The Virtual UCF Arboretum Software Download. Launched on October 2018: https://the-harrington-lab.itch.io/the-virtual-ucf-arboretum
- Published on PBS LearningMedia – The Virtual UCF Arboretum Website. Launched on January 2019: https://wqed.pbslearningmedia.org/resource/virtual-ucf-arboretum/virtual-ucf-arboretum/?fbclid=IwAR3Sur3GVnALQadQY1SLAOCrIIvxdMGBceGPcEOWG5nKjz8BzBI_Txa1oW4
User-Learner-Centered Design Process
Both of these models of virtual nature, The Virtual UCF Arboretum and the AR Perpetual Garden Apps were designed and developed using the same process with interdisciplinary teams. A modified user-centered design process was used in three cycles to extend and include scientific content review and artistic and aesthetic reviews, as well as learning sciences reviews. First with the scientists ensured factual accuracy in all content relevant to the exhibit, and then approved and released it to the design team. Then an iterative design and development process was used to construct the 3D art. This repeated until there was an aesthetic and technical approval for release. These 3D models were then reviewed with the scientific experts and in a collaborative scientific-artistic partnership each model was refined until there was approval for release by the scientific expert. The app software development was tested in an iterative process with respect to feedback from scientists, artists, and learning scientists goals to ensure a final product that met all objectives.
- “Virtual Nature in Augmented Reality and Virtual Reality for Informal Learning in Museums and Arboretums.” Presented to the University of Pittsburgh, School of Information Sciences. Pittsburgh, PA. Dec. 2018. https://pitt.hosted.panopto.com/Panopto/Pages/Viewer.aspx?id=4b0724b6-4309-4960-a27f-a9af01247fe8
Harrington, Maria. "Augmented and Virtual Reality Dioramas and Arboretums for Museum XR Exhibition Engagement and Learning Design | #MW20-2s." MW20: MW 2020. Published March 28, 2020. Consulted .