The Metaverse is a social construct.
It only exists because we collectively deem it so.
We invent complex economic systems, written and spoken modes of communication, so that we can better cooperate as a species.
We construct laws, conform to social norms so that we require less overhead when collaborating with one another.
Simple acts like buying food from a restaurant requires a complex supply chain powered by collaboration that is only made possible by such systems.
At the heart of all such systems is connection, which this demo emphasise deeply on.
It paints a future where the Metaverse, expressed in various forms, lives closely in harmony with our work.
It focuses deeply on showing how it “gets out of the way” when it’s no longer required.
It shows how it can be additive, preferring mixed reality over completely immersive experiences frequently found in VR demos.
I really like how it makes use of a sentimental soundstage to further generate resonance.
While it helps to paint a harmonious future, it doesn’t actually educate the audience what Microsoft Mesh is.
I think that should be improved by adapting the scenes to directly show what role Mesh plays.
For so long, the topic of mental health has been a taboo. When it comes to such a sensitive topic, many would rather tiptoe around or even disregard it altogether. Despite its prevalence, people with mental illnesses still face considerable stigma and discrimination1, forming a barrier for those who need to seek treatment. Efforts by mental health advocates and non-profit organizations have made headway in raising awareness of mental illness but combating the stigma remains no easy task. For the healthy, it can be difficult to empathize with the plight of those suffering from mental conditions. This lack of understanding could also bring about the wrong impression that psychiatric patients are violent and are nothing but trouble makers, a sentiment that is further perpetuated by the media.
Opening Screen of Jane’s Story
This is why I was especially intrigued when I came across Jane’s story during my internship at Hiverlab. Jane’s Story is a 360 degree VR video produced by Hiverlabs and TOUCH Community Services which puts you in the shoes of Jane, a student suffering from Depression. Users are put through the anxieties that are faced by Jane and is constantly bombarded by her doubts and insecurities which are conveyed through her thoughts in audio. This creates an intended effect that overwhelms the user as you drag your way through the story. The environment, the audio and the 360 degree viewing angle truly brings about an immersive experience that offers a glimpse of those plagued by mental illnesses.
Screencap of the In-Video Bully
While the video may not be able to fully capture the experience of those with a mental health condition, users would at least be able to understand and empathize what the former goes through. The video presents a great tool for the purposes of raising mental health awareness as it can potentially bridge the empathy gap for those watching it. In fact, social workers at TOUCH Community Services were able to utilize the video to conduct guided sessions with students.
A rather awkward model of the teacher
Despite its successes and utility, the experience in Jane’s Story could still be improved. Primarily, I feel as though the graphics could use more polish as certain models like the teacher as well the trees in the background are glaringly awkward. Obviously, these aren’t the main focus of the video but it has the potential to ruin the immersion for some.
Barring its minor hiccups, I do feel as though the project is a great entry for the utility of VR for portraying mental health conditions. Such efforts could go a long way in aiding the cause for removing the stigma faced by psychiatric patients. With news of more potential episodes, there is much to look forward to for Jane’s Story.
Underground was developed by Grendel Games for surgeons to practice their motor skills in a fun and challenging way.
In the game, the player controls a vehicle equipped with two large mechanical arms suited for underground mining operations, such as drilling into large rocks, picking up debris, moving around objects, and welding pieces of scrap metal together.
Underground is one of the many games that fall under the category of Serious Games, where entertainment is used to maintain players’ interest in the subject, especially since players’ interest tend to diminish when the subject is dry. Serious games transfer knowledge, teach skills, create awareness, change behaviour, and increase motivation of its players. Players are able to practice skills through simulations, or games with less realistic environments so long as the correct action is performed.
Previously, the surgeons at the University Medical Center Groningen (UMCG) made little use of the original simulator, despite having to practice an average of 200 hours a year to keep their motor skills up to standard. Practicing in a serious game provides the player with motivation to keep playing, through exciting characters, an imaginative game world, and competition with other players. Serious games make repetitive exercises a lot more enjoyable, making the player more intrinsically motivated to practice for a long time. Surgeons can practice using a laparoscopic controller that allows them to control the game using motions identical to those performed during laparoscopic surgery.
Underground teaches its players laparoscopic skill sets and knowledge in a more engaging manner. By combining game elements and learning strategies, players learn how to solve problems through challenges and rewards in the game. This makes it more appealing than traditional forms of learning and mediums knowledge is presented in.
Despite being a laparoscopic training tool, Underground has no official way of tracking the performance metrics related to laparoscopic surgery skills. It would have been better if players using the game for laparoscopic surgery practice could monitor their performance, and whether they have improved throughout their time practicing on the game.
I have heard VR+Sports for a long time, but have never believed its practicability — we are living in the real world, why should we do sports in the virtual world? At the end of the day, doing sports virtually is not as convenient as in the real world.
I stuck to this idea stubbornly, until I got my shoulder injury. In a judo sparring, a non-standard Ippon-seoi-nage broke my left shoulder. “AC-joint separation, ” the doctor told me, “had better never do any competitive sports anymore. ” I stopped doing all kinds of sports. But to promote injury recovery and muscle soundstage, I needed to do lots of rehabilitative exercises. The so-called rehabilitative exercises were just some basic upper body movements, which were so boring that I hardly liked to do them.
Since I could not do sports outsides, it is at that time that I started playing VR games at home. Shortly, I found playing VR games can be an ideal substitute for rehabilitative exercises. Especially, The Climb fitted my situation perfectly. First, when playing The Climb, I needed to hold my hands overhead and do lots of overhead movements, which were especially good for my shoulder injury. Second, in The Climb, I did not need to do any quick movements, which prevents me from secondary injury. Third, I did not need to move my location, so I can play it in any place, including my small bedroom. Last but not least, the game scene was so awesome and realistic. I held myself by small pivots. Above me was the cliff. Behind me was the abyss. The wind in the canyon blew me. The eagle whistled while circling in the air. I am fully focused on my movement, looking for any protruding rock to grab, keeping my balance, and carefully moving to the goal, just like a real freestyle solo. Oh, God. What an immersive experience!
After three months of playing this game, I went to the hospital for a recheck. “What did you do?”, the doctor was shocked, “MRI result shows your left shoulder has fully recovered!” I told him about my experience in the virtual world. He said, “Amazing! VR should be a new kind of treatment. The Climb should be known by other patients of mine.”
Via this experience, I realize the practicability of VR+Sports. It is not a substitute but a complement for real-world sports. It gives a chance to experience sports for the people in rehabilitation and the disabled. It also gives a chance to experience extreme sports for normal people without risk.
Although many VR sports games have achieved good performance, there is still room to improve. Take The Climb as an example. After my recovery, I feel it is too easy to play it as an exercise. One simple but useful idea to improve it is, we can design a pair of trackers with removable counterweights. The more counterweights we add, the heavier the trackers are, and the harder the exercise is.
In a previous project, our team became interested in increasing peoples’ awareness of environmental issues through games. Upon our research, we found that recently, immersive experience is widely used to raise the public’s awareness towards environmental issues. The Tree VR, introduced by New Reality Company and Rainforest Alliance, is a good example.
Tree is an award-winning VR experience where users take on the body and perspective of a rainforest tree and immerse themselves in the tragic fate of the tree. The entire game flow is only eight minutes. In the eight minutes, the player will grow from a seed to a majestic Kapok tree and witness a forest fire that destroys the forest. The Tree VR experience was open to visitors in Gardens by the Bay in 2019 with a ticket price of S$5.
Features:
The Tree VR provides a short but highly immersive experience. First of all, the graphics and art style used are very close to reality. The player can see details such as ants on the ground and wind blowing through the branches. In addition, what I liked a lot is the sound effect of the entire experience. There is no background music, and all the player can hear is the sound of the environment: the wind, the animals, the fire, etc. When people wave their controllers(branches), they can hear the slight noise made by the leaves.
Another interesting feature of Tree VR is that there are hardly any interactions throughout the entire game flow. In Tree VR, users will no longer see their hands. Instead, their hands are turned into the two branches of the tree. The player can only look around and wave their branches throughout the game. This design has both pros and cons.
Limiting users’ interactions actually makes the experience more immersive in this particular VR experience, because trees in real life are unable to interact with the environment on their own. When we see the forest fire as a tree, we cannot run away to seek help and have no choice but to wait for the fire to reach us. This is exactly what the game designers wanted to convey: “we must protect the forest for those who can’t speak for themselves such as the birds, animals, fish, and trees”.
However, I also agree that games with very few interactions are usually boring. Actually, I got bored for a while in Tree VR, as nothing is happening in my sight, and all I can do is wait for the next event to happen. If the designers decide to limit the interactions to make the experience more immersive, they should work harder not to make players bored.
Here I found a full playthrough video of the Tree VR, you may get a rough idea about what this VR experience is like after watching it 🙂
Minecraft has been one of the few games that remains popular even after its initial release and it is constantly being updated by the developers. It is one of the greatest gaming sandbox where players can build, craft, explore and play in their own world. Millions of players around the world would spend countless hours everyday getting lost in their own worlds. As it increases its reach and expands its support across various consoles, such as PC, Xbox and mobile, it is not surprising that Minecraft has tried to create support for VR headsets as well.
Why it is engaging:
Virtual reality is a refreshing change from the classic Minecraft gameplay on a screen. After spending so much effort into building and creating a world of your own in Minecraft, what would be better than to enjoy all of that work you spent in person? By using Minecraft VR, players are able to fully enjoy the world around them and see a whole new perspective of their Minecraft world.
Firstly, the sense of scale hits almost all players when they are new to Minecraft VR. As a two block tall character in the Minecraft world, standing among the craggy chasms, being able to look up at the looming mountains, seeing them extend into the sky far above you. One cannot deny that the experience is simply breathtaking. Due to its low-fidelity, block-based graphics, immersing into the Minecraft world gives a cartoon-like feel to players. The lack of fine details made the gameplay comfortable for players to enjoy their time in the virtual world.
Secondly, certain game actions such as swinging the arms to attack a mob, pulling the string of the bow to fire an arrow and hitting the block to mine it was very intuitive and realistic. This helps to make the game more immersive as the player has to mimic the actions in real life in order to complete a certain task in the game.
In addition, with the help of virtual reality, players are able to get up close with mobs such as dogs and cats to “pat” them. Encounters with hostile mobs in Minecraft becomes way scarier. Having to see a hostile mob approaching, attacking or even dropping from the top of the cave down to where the player is inflicts a greater fear in players as everything seems more real. This increases the challenge of the game where players get to fight all the scary mobs in first person, slashing away with their swords or blocking attacks using their shields.
Although being “inside” a Minecraft world is a novelty, it is a game where players spend a lot of time getting lost in their own virtual world with their arbitrary set of goals that they can chase for hours – building a city, exploring all the biomes, slaying the ender dragon. Despite efforts in making the game comfortable in VR such as the ability to toggle between theatre mode and immersive mode, Minecraft VR still faces the challenge of players experiencing vertigo after long hours of playing the game. Players can feel the strain in their eyes, the ache on their necks as well as the headset pressing into their face. Therefore, players would choose not to play Minecraft VR for for long hours unlike its other gaming platform counterparts.
Furthermore, as Minecraft have many controls for mining blocks, placing blocks, crouching, sprinting, jumping, eating as well as switching inventories, players who are new to VR may be overwhelmed by the shear amount of controls to familiarise. Chatting in multiplayer mode is difficult as well since the VR headsets do not provide keyboard inputs for text chats. Other modes of communication such as voice chats can help to alleviate this issue.
Nonetheless, I believe that VR has unlock a huge potential for the gaming industry to improve players’ gaming experience. Minecraft took the plunge to create their own VR experience for players and there will be many more gaming companies that will follow the trend to create VR options for their games in future.
Slowing down, and the world slows down with you. This is one of the most intriguing designs that I have seen in VR games, and you can experience it in Superhot VR.
Superhot VR is a first-person action game of solving puzzles
via dodging bullets and killing enemies developed and published by Superhot
Team. It invites the player to experience both motion and time at a more
precise level than what people could do in real life. In the game, time only
progress when the player moves. Just like the movie Matrix, you can catch each
bullet path and take your time to decide how to keep your body intact while
killing the opponents as the world freezes around you. That is nothing you can experience
in real life.
Another reason why I am particularly fond about the game is its aesthetics. A lot of VR games strive to mimic the real-world environment for immersive gameplay. But Superhot is set in a rather surreal place. Everything in the environment is painted dull white from walls to tables. The enemies seem to be made of crystal red glass that shatter in crisp sounds when you break them. They are like statues devoid of human flesh, facial expression, and blood. I like this reductionist approach towards reconstructing our reality where things are no more than what they need to be. By removing the colour and texture of mundane items, it draws our attention to their form, shape, arrangement, and relationship as we watch the glassy figures jumps out of those constructs. There is definitely a psychological and artistic impact to this game.
Yet, the game feels real because of the flexibility given to players to interact with the tools they have. A gun can be used to shoot but also thrown at enemies when out of bullets. A knife can cut the bullets away in the air. Games often restricts the amount of freedom players have in order to prevent them from going off track, which could be intrusive to the immersion. Having less objects to play around but more freedom to decide what to do with them is a smart way to make the “reality” authentic and engaging.
There are also merits to the interaction design in the game.
To proceed to the next section, the player is to hit, grab, or shoot some
object with real actions as if one is still interacting with the virtual world.
The instructional text is kept minimal and attached to the surrounding
environment, making the game experience holistic and immersive. While the game
requires a lot of body movement, no repositioning through the virtual
environment is needed, avoiding motion sickness.
It is a pity that there is not much variation to the virtual environment since I really love the aesthetics and design techniques of the game and would love to see the game setting in dark or in the wild. In terms of interaction, one small issue is that although it is impossible for players to move around with their feet, the virtual space sometimes surrounds the player with edges that seems like one could fall off. I feel like a small indication of boundary could help the player to move more freely without having to worry about the edges.
Dance Central VR is not just any game, it’s an experience – a lifestyle. You can now indulge in a virtual partying or clubbing environment at the convenience of being at home. Yet, it is also not just a place to gather and dance together, but to also interact with characters in the scene and feel safe to unleash your hidden dance talents. If you have played and enjoyed the past titles of non-VR Dance Central, this game takes your music immersion to the next level.
Seamless Flow from Previous Titles
Harmonix has released various versions on non-VR platforms prior to the 2019 VR version. They have made a noticeable effort to keep characters who were previously present in the older versions. For seasoned players of this series, it gives them a sense of instant connection with the game and it feels less foreign to be dancing with familiar appearances. For newer players, it gives them relevant insights on how other versions are like without having to play them. The game mechanics remain the same for the essential part – the dancing itself. Players still get to choose their favourite tracks and emulate dance moves shown on the screen. As an upgrade, what I really appreciate is the fact that the characters now are more diverse in culture, experiences and also proportions. This adaptation made it more relatable for users as it mirrors the real society’s current efforts to embrace differences in people across the globe
Usage of Characters
The characters are used as a way to provide dance tutorials and a guide for users to visually learn how to dance by copying what they see. I was impressed by the amount of thought placed into designing the characters, as the level of interaction with them is sufficiently deep to immerse you into a whole new social circle whenever you play. Each character has a story to tell, and they are highly relatable to real life scenarios (such as wealth and daddy issues). The mode of interaction requires you to be familiar with the environment and players can text them or even receive a voice message from them! What is really interesting is that despite having a fixed set of songs to dance with, the same song feels different when you dance with different people. In a sense, the game discreetly provides different game paths through the emotions and experience with the characters so that players will constantly find entertainment at their own will.
Ambience and Setting
Together with the presence of interactions within the game, the environment plays a very big significance in making the whole gameplay feel real. You will really feel as if you are partying you are the main character in the club. When you hit combos and the song gets more hyped up, the mood changes are further enhanced by animations and lighting around you and your dance partner. The loading of tracks are also seamless and does not take you out of the experience. Such subtle differences contribute to the emotions players may experience as they dance throughout the songs, thus intrinsically providing motivation to perform better.
Competition
Players can dance alone or with other players in battles. From my personal experiences as a dancer, dance battles in our society are seen more of an exchange, appreciating each other’s hard work and celebrating successes. In this case, the idea of incorporation battles as competition brings this concept over to the virtual world and makes the competitiveness more natural and welcoming. It feels more like a gathering – which links with the setting and story. Even when dancing alone, it brings positive emotions and players can treat it as a self competition, where they practice to be better versions of themselves. This approach provides entertainment and incentives without disturbing the core essence of what it is to enjoy dancing for yourself and with others.
Room for improvement
A possible downside is that despite the characters having strong interactions, the depth of story and plot is not consistent across characters. This means that players may tend to be closer to certain characters over time because they simply offer more. A viable option is to add more story or plot to the characters lacking in it. However, I feel that the connection you feel with someone may not necessarily be proportional to the amount of information you know about each other. Rather, perhaps a better way would be to improve on the frequency of initiative taken by the character(s) to contact the player during gameplay so that more meaningful impressions can be made.
Personal thoughts
Overall, this game gives players a highly stable and holistic VR rhythm experience. It even includes small details such as having a wardrobe of clothes to choose from and dress up before entering the club, having people welcome you as you navigate into the area and possessing a personal phone to play tracks or communicate with others. Fun fact : your interaction with one character affects how another character might perceive their interaction with you. Personally I would say there are no misses in this game, only hits (and combos).
As a gamer, the Half-Life series was one of the first games that I played. A first-person shooter that traversed the lands, battling humans, zombies, headcrabs alike. After years of silence, the full-length game built from the ground up for Virtual Reality, Half-Life: Alyx was finally announced in 2020.
Half-Life: Alyx gameplay
This game has being released as a VR-only game to show the focus of the development of the game to be centered around the VR experience, of which has earned them The Game Award for Best VR/AR Game for 2020.
Why the game is such a hit:
Aside from the fantastic storyline that the half-life series has always delivered. The gaming experience was phenomenal.
Weapon interactivity in VR: Each gun has just the right amount of interactivity to let you know you’re handling something with multiple moving parts. But it’s not so complex that it becomes a burden. The handgun, the first weapon you’re given, is a great example. To use it, you have to grab a magazine out of your backpack, slam it into the grip, and pull the slide to put a round in the chamber.
Reloading is done by hitting a button to drop the magazine and repeating those same actions listed above. Imagine you are crouching behind a pile of cinder blocks, pulling magazines out, loading them and racking a round before physically standing up and returning fire as bullets whiz past your head. It’s a workout that feels like an action movie.
VR Immersion: The screen being what your eye can see definitely helped, but it was also backed by fantastic sound and environment design to truly immerse yourself in the game. However, there are certainly some issues that this medium possessed.
Points of improvement:
The game allows for “continuous” movement, to mimic actually moving through its meticulously designed environments. However, there is so much happening in the world of Alyx, even when you’re standing completely still. It could be a dizzying, disorienting experience as you see you are moving, but you know you are not. This is why a lot of players opt for “blinking” through steps, the VR compromise for anyone who gets motion sickness. This is an on-going issue that continues to be tackled today. It could be made better through segmenting the game into short blocks so as to prevent overloading the players.
Nonetheless, the possibilities of VR just grows by the day and we are taking this module to uncover more.
The pandemic has been caused a huge impact on the world we knew just 2 years ago. Tremendous shifts to lockdowns and Work From Home arrangements have forced many to abandon their usual outdoor schedules and lifestyles. While some have continued or turned to outdoor exercises like jogging and cycling, many others continue to lead more sedentary lifestyles while enjoying the comfort of home. Or rather yet, working out at home can be really boring, especially the feeling of being cramped in a small space while doing your calisthenics workout. However, things are about to change.
Enter HOLOFIT, a VR Fitness app for your VR headset. It connects to fitness equipment like rowing machines, ellipticals/bikes, or cadence sensors for running movement tracking. It uses Bluetooth which sends your workout data to HOLOFIT. That is how your movements are tracked in virtual reality, perfectly synchronized with what you’re doing on your fitness machine.
HOLOFIT helps make your fitness fun, keeps you motivated and gives you the chance to connect with other members from around the world, all from your fitness machine.
VR Fitness has actually been scientifically proven to lessen workout pain because you’re distracted, so you end up working out for longer. Different game modes keep you motivated and keep you coming back for more, while all the amazing worlds keep you entertained.
Personally, I love this application of VR to physical exercise. It is reminiscent of the Wii Sports system years back, where it was revolutionary to be able to swing the remote to play virtual sports on the TV screen. However, times have changed. With technology now more than ever capable of supporting immersive virtual experiences, user engagement in these virtual sports is higher than ever before. Being able to look around the virtual environment while “running” (mimicking the running movements of the arms) makes a big difference compared to watching an avatar on the screen.
What’s more, the multiplayer capability takes the immersion to a whole new level. Seeing other players in the metaverse exercising also triggers that social itch and sense of competitiveness in the human spirit, and nothing powers a good workout more than competition.
The creators of HOLOFIT have also gone and harnessed the fact that anything can be done in the virtual world. Running in abandoned mines, in the snowy mountains, and ancient Egyptian landscapes are all examples of why the experience can be even more exciting than in real life, being able to visit the ends of the Earth from the safety of your own living room; the toilet, kitchen and bed are close-by, not to mention the shelter above your head when raining.
Still, the current HOLOFIT requires a monthly subscription to be able to use their services, which might be a barrier of entry to most casual players looking to join. Why pay for an exercise game when I have “EPIC ROLLERCOASTERS” and many other free alternatives in the VR game catalogue? Also, while I find the graphics decent enough for a casual session, it still has room for further improvement considering the capabilities of graphics engines like Unreal Engine 5 today. Consideration of long-term immersion has to definitely include good graphics, as the visual sense is responsible for 80% of our learning.
Overall, HOLOFIT is a step in the right direction. It is a living and breathing application of the VR capabilities to fitness, albeit with some barriers to entry and room to improve on graphics. Still, I’m sure this sets a precedent for other companies to build bigger and better fitness VR games in the future, alongside many other applications VR has to offer. Perhaps one day, outdoor exercise would be a thing of the past.
