Imagine this: You’re walking down the street at night when a few unfamiliar loiterers begin cat-calling. You ignore them, but they persist. You begin feeling threatened. You try to think of ways to get out of the situation—but you’re not walking through your familiar town. Instead, this is happening in the metaverse. As a new user, you can’t figure out how to block these strangers.
This isn’t an uncommon scenario; the threat of sexual assault, bullying, and other harassment is considered commonplace in the metaverse. So much so, that engineers have been forced to implement privacy features, like a privacy ring that prevents users from approaching another person’s avatar. But these still can’t protect you from verbal taunting and lewd expressions.
With a growing number of projects added daily, the metaverse is set to emerge as a new customer touchpoint. Researchers and experts estimate that the technology will likely penetrate all major industry sectors and geographies, creating a potential market opportunity of $1 trillion-plus in yearly revenues. But as the growing issues of user security and fraud risks become more palpable, it becomes more important than ever for companies to invest in the metaverse with a security-first approach for users.
METAVERSE IS A ‘MICROCOSM’ OF THE WORLD—INCLUDING THE BAD PARTS
The concept of virtual worlds and the metaverse is built on the principle of verisimilitude. This means they try to replicate the real world as closely as possible. Virtual world avatars may still lack legs, but they try to follow human physiognomy and movements faithfully, and no interactions are off-limits. But the real world isn’t comprised of just pristine skies and morning walks in the garden. It contains innumerable shady street corners and rising rates of violence against women since the pandemic. It is of little surprise that misogynistic behavior also rolled over into the virtual world. It’s not just women who are being targeted, either. These attacks span the gamut of sex, gender, race, ethnicity and nationality.
What is surprising, however, is that while victim-blaming is common in the real world, it seems particularly pronounced in the case of cyber assaults or harassment. The argument here is that, since the victim is not physically harmed, they don’t have a credible case for alarm or complaint. Unfortunately, the authentic nature of virtual worlds intended to make the experience more immersive can also make the experience of such assaults much more visceral and invasive than plain old two-dimensional cyberbullying or public shaming on social channels. This problem is only going to get worse as many organizations are actively involved in developing haptic clothing for a more sensory, tactile experience of the metaverse.
WE NEED TO DO A BETTER JOB OF PROTECTING CHILDREN IN THE METAVERSE
One of the most worrying parts about the unchecked proliferation of sexual content in the metaverse is that children could quite easily get exposed to it. As researchers from BBC found out recently, despite a developer-imposed minimum user age of 13, one app allowed anyone with a specific social media account to log into the metaverse—without verifying the user’s age. This could potentially expose young users to egregious sexual content.
Some young adults have taken to performing sexually charged virtual acts such as stripping and lap dances as part of NSFW dance clubs to earn money in the real world—and even coveted game items or digital currencies. While admins are often swift to shut down accounts that don’t keep to stipulated terms of service, it’s largely a game of whack-a-mole. These young adults also regularly face the threat of “doxxing,” or sharing their images, videos or private information without consent, from other users trying to coerce or blackmail them into following their wishes.
UNDERSTANDING THE MULTI-FACETED SAFETY RISKS OF USING THE METAVERSE
An inclusive and equitable metaverse must account for user safety. In its current form, the user moderation implemented by social media companies involved in maintaining virtual worlds remains reactive and inefficient. This kind of moderation happens after the fact and is ineffective at discouraging unwanted behavior.
There is no doubt that companies will need to rethink moderation and implement powerful AI workarounds to offer immediatehelp to users in need.
Growth and innovation have been at the forefront of strategy for social media and tech, often forgoing user safety. While moderation for the sake of moderation is a dangerous path with a slippery slope, moderation with a sense of valid purpose will be both useful and necessary for the metaverse.
Just as people have protections from harassment in the real world, we need similar—or more—protections in the metaverse. AI could potentially help ramp up these initiatives by automatically identifying aggressive behavior and creating an appropriate “punishment.” Think about social media: I have heard plenty of users complain about being in “social media jail.” Because users are even more vulnerable in the metaverse, this is a critical measure.
The advantage of a digital world is that AI is already built in and can be easily manipulated to behave accordingly; however, identifying the behavior is one task, while identifying user intention is another entirely. As Aaron Mak, who volunteered to moderate metaverse events, wrote in a May Slate article, “One of the biggest challenges of being a moderator is determining whether someone is purposefully disrupting an event or simply doesn’t understand how the VR technology works.” Therefore, policing behaviors digitally is still proving challenging.
User experience is key to a platform’s success. Leaders in the industry need to prioritize safety if they hope to see their platform continue to grow, as assaulted or cyber-bullied users aren’t likely to return to the metaverse until measures are taken. User safety needs to be a priority for companies looking to bet long-term on virtual worlds.
Akash Pugalia is the Global President of Trust & Safety at Teleperformance.