Having seen many trends and technologies being born, die, and be forgotten, I've long been standing in the skeptical camp when it comes to XR. It always seemed to me like a solution looking for a problem. A classic supply-push innovation, eagerly seeking elusive adoption.

And yet, Virtual Reality (VR) and Augmented Reality (AR) clung on stubbornly for more than three decades, much thanks to a clever, pioneering, but very niche community. This could very well be changing now, as Apple joins the game as a latecomer but has the capacity to propel VR and AR into the mainstream.

No writing or visual documentation can aptly describe an immersive experience: you need to try it yourself, which is what I have been doing over time. A few work-relevant capabilities stand out.

The image quality is the first thing to notice, not just due to the insane resolution (23+ Megapixels) but also the pixel density (nearly 3400 Pixels per inch) and high frame rate (100 Hz), packing a very sharp image for internally generated content. The interaction on the device (with eye-tracking and simple pinch gestures) is intuitive, minimising the need for training. The spatial audio experience is also very good, greatly enhancing the experience.

On the downside, a few things will narrow down the use cases for some. Pass-through video feed (because they are not actually "glasses") is not at the same level as the internal graphics. The current ergonomics (with over 600g strapped to your head) can make this uncomfortable for extended use unless you have the neck muscles of a Formula 1 driver. Not to mention, you need to carry a tethered battery pack with an autonomy of about 3h, although these can be swapped. What is not meant to be swapped is the device's user since passing it around requires calibration, and if you need prescription lenses, these will need to be spec'ed individually.

Due to its qualities, we finally have a new category of device: one that can deliver value in real-world work situations and be a far cheaper solution than the traditional alternatives.

More than an expensive gadget

Looking at 3D data on two-dimensional screens may seem good enough until you experience the benefits of looking at the same data in holographic, 3D space. It's a mind shift. At EGGS, we have experience working on projects dealing with geological data analysis, putting the capabilities of existing holographic hardware at the service of teams who need to solve long-existing industry problems, improve workflows, and save time.

The same can be said for most categories of digital twins. Many real-world scenarios (especially in design and engineering) can benefit from virtualised environments, connected to real-time, real data and models. It allows teams to test scenarios, discuss modifications, and feed their learnings back into the system. There are credible use cases for products, factories, systems, and even city plans being developed right now.

The same possibilities can be applied to modeling and visualisation of 3D imagery. This is already being done successfully in the health sector. 

, for example, developed a tool to support a range of surgical applications. It enables doctors and surgeons to collaborate by looking at high-resolution 3D scans of a patient's liver to increase shared understanding and improve the surgery planning process. This is a well-functioning product using the HoloLens: HoloCare was awarded CE and UKCA certification, which meets compliance requirements for broader adoption in the medical industry.

Professional applications

Holocare

A sub-set of 3D imaging can be architectural spaces. Many teams around the world have been doing ground-breaking work using different technologies to solve this.

How do you train staff to familiarise themselves with a hospital that hasn't been built yet? How do you show a technical expert who is on the other side of the planet the problem you are experiencing in your vessel or power plant? How do you build knowledge and confidence among teams that need training in hazardous or hostile environments?

Simulated environments can greatly benefit this, dealing with the practicalities of remote testing of scenarios and providing valuable learning for teams. But it's more than just environments: delicate topics might prove useful to simulate for training, such as mental health patients, such as the project 

 for St. Olav's University Hospital. The team behind 

, whom we helped design their launch product, also started in the VR world to help medical students with a richer learning experience, motivating them through a notoriously tough curriculum.

Æira is a gamified learning platform for medical students. (Image credits: Æira)

Æira

Speaking of hazardous or remote environments, there are many industries where on-site inspections are required by a human. Take 

, energy grids, shipping, or manufacturing, for example. A critical fault can inflict formidable costs. There are cases where these inspections require remotely located peers to advise on assessing the situation. However, second-hand diagnostics can be tricky via 2D images or live feeds when that is possible. A device like this can provide detailed, full-depth pictures with much richer visual information. Sometimes, the extra certainty provided by high-quality 3D images can be instrumental for a team or a client.

There are many high-end solutions for similar use cases today (caves, domes, and other immersive physical installations), but they're expensive to install and maintain. In relative terms—and the people working in the simulation field know this—a device like this is a relative fraction of the cost. What is more, the experience it delivers may now be superior.

In an age where semi-autonomous vehicles are becoming more common, there are cases where it can be beneficial to operate these in a virtual or augmented environment. Operator awareness can now be significantly improved for tasks that are delicate, complex, and need high resolution for effective operations. Until today, the reliability, complexity, and criticality of many such use cases have meant that XR devices were either experimental or not credible. With such hardware coming to the market, this is changing: you can get reliable feeds, real-time 3D environments, and responsive controls that are intuitive to use.

Control centres can also benefit from having AR capabilities, where real estate is virtually expanded and access to multiple screens can be curated for focus and attention — adding a different level of detail for shorter periods of time (search and rescue operations, for example).

Capabilities that can deliver true value, like the ability for teams to collaborate on given tasks and scenarios, are applicable to any of the use cases above. We are already seeing this in projects where teams benefit from exploring the same 3D data visualised during work sessions.

Another real example is the ability to augment human vision through real-time interpretation assisted by machine vision: this can be useful in industrial settings, inspection and repair scenarios, or even medical practice, where we are seeing a growing number of reports documenting the exploration of AR+ML technologies in 

The value added by collaboration, gamification, and AI

None of these use cases are new, and some of the examples given provide evidence that this has already been explored via XR technologies. But the Apple Vision Pro marks a turning point. For one, the quality of the immersive experience is finally credible. And secondly, the Apple Vision Pro has the mainstream power which paves the way for a behavioural change that has held back new technologies before: it won't be a "weird" thing to wear a headset once it becomes commonly used in certain contexts (the same thing happened with voice commands until smart devices and vehicles commodified this form of interaction).

Companies that have invested in 3D simulation systems will likely have used available or proprietary gaming engines, which are largely device-independent. This makes the transition to the Apple Vision Pro less costly and more resilient to obsolescence.

At EGGS, we have a dedicated mixed reality team that has been solving similar problems for customers for the past eight years. We are excited about the new possibilities unlocked by devices like the Apple Vision Pro, which is only the first of a new generation. If you have a work-related problem where this technology could be useful, we would love to hear from you!

Apple Vision - like a Pro