University of Redlands
When discussing the different tools used for immersive experiences, there can be considerable confusion and overlapping regarding the boundaries of each technology. To clarify the exploration of the three frontiers within our Creativity Commons, our team has compiled a useful guide that outlines the distinctions between 360º video, Augmented Reality, and Virtual Reality.
The technology of immersive experiences provides an exciting and sometimes daunting opportunity for faculty and students to engage with academic media and content in new ways. With this emerging technology, there are countless possibilities for users to experience and interact with content that is specifically designed for these platforms. However, it can be challenging to understand the different types of immersive experiences and how they differ from each other. Furthermore, it is crucial to recognize how these different affordances may impact your experience, whether you are creating or consuming the content. This resource aims to address these questions by discussing three types of immersive experiences: 360° Video, Virtual Reality (VR), and Augmented Reality (AR).
It is important to note that there may be other terms used to describe these types of experiences. For instance, some refer to immersive experiences as eXtended Reality (XR), while Mixed Reality is occasionally used as an equivalent to AR. As these technologies continue to develop and become more mainstream, the terminology used to describe them and their applications will also evolve. The Instructional Technology team is committed to unpacking these terms and technologies to benefit all University of Redlands students and faculty.
360º video records real-world surroundings and can be enhanced with supplementary instructions, gradually advancing towards a complete VR simulation. On the other hand, AR builds upon live experiences in the physical world by providing additional information.
The Level of Guidance refers to the extent to which the creator has provided direction to the viewer on where to focus their attention in the video.
For instance, a Level 1 video would simply show a stationary camera capturing events without any direction, allowing the viewer to observe without any guidance. A Level 2 video might incorporate subtle visual, textual, or auditory cues or simple transitions to direct the viewer's attention. A Level 3 video would rely on a few more cues and transitions. A Level 4 video would incorporate multiple cues and dialogue. Finally, a Level 5 video would include all the elements mentioned above and a narrative structure that propels the viewer forward.
Another way to view this is to consider the amount of production involved in creating a similar video if you are interested in making one yourself.
The Level of Integration pertains to the degree of linkage between the AR application and the real-world environment established by the developer.
For example, a Level 1 AR app would introduce a pre-existing object or projection into the viewer's space. A Level 2 AR app may establish a connection between the object and the physical environment, such as anchoring to a specific plane or surface. A Level 3 AR app would depend on multiple links to the surroundings, including functional awareness of the conditions in the space. A Level 4 AR app would involve heightened awareness of the conditions and real-time mapping of the content onto the physical environment. Finally, a Level 5 AR app would involve all of the aforementioned aspects and allow for advanced real-time integration of real-world and computer-generated content.
The Level of Interactivity refers to the number of interactive features present in an experience.
For example, a Level 1 experience would be more passive in nature, allowing you to look around freely but not interact with objects in the environment. A Level 2 experience would offer some basic interactivity, such as the ability to move between different scenes. A Level 3 experience would introduce more complex interactions using a remote or controller to trigger actions within the scenes. A Level 4 experience would be fully interactive, but still guided. Finally, a Level 5 experience would provide complete user control, making it fully interactive.
The use of 360º video enables viewers to immerse themselves in another real-world space for a short period of time. In its basic form, it's like standing in a specific location selected by the creator and observing a scene unfold in all directions. The creator can influence the viewer's experience by incorporating additional guidance such as text prompts, transitioning to new scenes, voiceover narration, audio cues, and other elements. In its more advanced form, 360º video may feature question prompts and a logic tree to trigger a sequence of distinct videos, replicating a choose-your-own-adventure-style story.
360º video can be immediately viewed in any web browser that supports the technology (such as Google Chrome), and viewers can change their viewing angle using a mouse or trackpad. Smartphones also allow for playback of 360º content, utilizing the device's accelerometer and other sensors to change the viewing angle by simply moving the device.
There are various options for increasing immersion, including low-cost Google Cardboard headsets that hold a smartphone and split the image into a stereoscopic view. This allows for head movement to trigger the accelerometer and change the viewing angle.
Fully standalone headsets do not require a smartphone and offer higher quality playback using a built-in stereoscopic display. These headsets also feature integrated speakers, adjustable head straps, and handheld controllers to navigate the interface, leading to even greater immersion.
Augmented Reality (AR) overlays additional information on top of the real world environment. AR experiences come in different forms, but all require an intermediary device to superimpose content onto the surrounding environment. Typically, a smartphone or tablet with a rear-facing camera is used as a window into an AR-enhanced space. AR applications can range from placing virtual furniture in a room, trapping digital creatures in a game, measuring objects by pointing at their edges, and more.
Augmented Reality (AR) overlays additional information on top of the real world environment. AR experiences come in different forms, but all require an intermediary device to superimpose content onto the surrounding environment. Typically, a smartphone or tablet with a rear-facing camera is used as a window into an AR-enhanced space. AR applications can range from placing virtual furniture in a room, trapping digital creatures in a game, measuring objects by pointing at their edges, and more.
AR experiences are often available for download on mobile devices, which means that viewers can use their smartphones or tablets to add various overlays to the world around them. Since the mobile device is used as a window for this additional information, at least one or both of the viewer's hands are occupied while interacting with the AR content.
AR glasses or goggles act as a mobile heads-up display for the wearer, enabling them to view additional information about their surroundings while they perform tasks. The content presented through AR glasses only covers a portion of the field of vision, usually in one eye.
A more advanced AR headset provides a comprehensive overlay on the viewer's environment, allowing rich content to appear anywhere the wearer looks while they move around.
Virtual Reality (VR) immerses the viewer in a completely fabricated world, which may or may not be based on real-world experiences. A basic VR experience might simply put the viewer inside a pre-made virtual environment to observe, while more sophisticated VR content enables interaction with and manipulation of the surroundings. This can include a range of actions, such as moving objects, conversing with simulated characters, constructing new items in a 3D space, and many other possibilities.
The viewer can enter a wholly created world through Virtual Reality (VR). This world may or may not be based on real-life experiences. In a simple VR experience, the viewer is placed inside a constructed space as a passive observer. On the other hand, an advanced VR experience allows the viewer to interact with and manipulate the environment around them, including building new items in 3D space, moving objects, talking with simulated characters, and more.
Most VR experiences are designed like computer games and can be loaded on a gaming PC or console, where the viewer would use a keyboard, mouse/trackpad, or a handheld controller to manipulate the simulated space. However, the audio and video quality may vary based on the device and its accessories.
A standalone headset can also be used to view VR content. The viewer can change their vantage point by moving their head, and basic interaction is navigated with a handheld controller. However, the headset's self-contained nature means that it does not provide motion tracking, and A/V quality is limited by the headset's specifications.
By using a high-end PC and an advanced headset, the viewer can experience far higher quality audio and video, and also motion tracking within the simulated environment through included accessories. However, the amount of physical space available and tactile/haptic feedback when interacting with objects using a handheld controller are constraints.
Adding high-end accessories to a PC and advanced headset can significantly increase the viewer's immersion. For example, haptic feedback gloves and other clothing can allow the viewer to feel objects and actions within the experience. VR platforms with moving floors or other dedicated spaces also allow the viewer to roam freely in-world.
