Facebook Spaces finally delivers on social VR
Three years ago, when Facebook bought Oculus for $2 billion, many scratched their heads in befuddlement. Social networks and virtual reality seem like such strange bedfellows; one is about connecting you to the world, while the other appears to do the opposite. But CEO Mark Zuckerberg envisioned a world where VR would be a place for communication, not isolation. And, many years later, that vision is much closer to reality. Facebook Spaces is the company’s answer to social VR and it is, as I was amazed to find, surprisingly compelling.
I had the chance to try out Spaces for myself a few hours after it was announced at F8. As soon as I placed the Oculus Rift headset on my head and the Touch controllers were in my hands, I was transported to what appeared like a beautiful park with cherry blossom trees. On my right was my virtual helper, Justin, who appeared in the form of an animated cartoon avatar. In front of me was a tableau of sorts, with a little dashboard in front of me.
Justin told me to select Appearance, and voila, I could customize the appearance of an animated cartoon avatar of myself. You could design one from scratch by customizing individual features like your nose or your hair, but I decided to just have one automatically generated for me. I grabbed one of my profile photos, which were already on display, and Spaces was smart enough to translate it into a cartoon version of me. From there, I also changed the color of my glasses and my shirt, which you can do in the Appearance tab too.
What I noticed almost immediately is how real it seemed, which is really weird considering I was speaking to an animated avatar. Mike Booth, the product manager leading the Spaces development team, says that’s because the Rift and the Touch creates a little motion capture studio. “You get your actual body language,” he said. “It captures head movements, even hand gesticulation.”
What’s more, Spaces also infers what your eyes are looking at, creating what appears to be eye contact, which is integral to face-to-face communications. One of the reasons Spaces can do this so well is because these avatars are stylized and cartoon-like. “They’re not hyper-realistic, where you can find every little flaw,” says Booth.
The same goes with mouth movement. It actually listens to the voice coming through the Rift microphone and then it tries to guess what mouth shapes you’re making. It’s not always accurate — it sort of snaps the mouth around like a Wallace & Gromit cartoon — but that’s entirely on purpose. “We’re not trying to be super photorealistic,” says Booth. “We just want to show that you’re talking.”
There are other fun things you can do with your avatar too. If you point both thumbsticks up, your avatar will laugh. Point them out, and you’ll smile. Place both controllers on your face and you’ll make an “OH” face. Turn them outward, and your avatar will shrug and look confused. Gestures are basically to VR as emojis are to text. “You have to invoke them,” said Booth. “They’re not supposed to be accidental.”
Next, Justin showed me how to share different kinds of media. I could share photos and videos from my own album, or I could share ones from my newsfeed, or I could just share whatever on the web I found interesting. Once selected, I could resize them anyway I want and have them displayed in the background. What’s especially neat is that when you share 360-degree photos and videos, you can sort of throw them in the middle of the tableau and the image will completely envelop the world. It sounds sort of silly perhaps, but when Justin shared a 360-degree video of a CNN documentary of Iceland, I almost felt like we were right there, taking a tour of the glaciers.
You also have the option of using a marker to draw silly doodles, turning them into three-dimensional art. You can toss them around, make duplicates of them or just play silly games with them. And of course, I couldn’t not take a selfie. Yes, there’s a virtual selfie stick, and yes it works just as it sounds. Simply grab the selfie stick, frame the shot you want and snap the perfect shot. From there, you can share it with your friends just like you can with any other photo.
Last but not least, Spaces is also tied in with Messenger. So you can initiate video calls right when you’re in VR. Your friend’s video chat screen will show up in a little floating square (No, they don’t need a VR headset to participate) and only you can hear and see what he or she says — none of your other VR buddies can eavesdrop in the conversation. They can still hear what you say of course, but they can’t hear what your Messenger friend is saying. Facebook tells me there’s no way to enable that just yet, but that functionality might come later in the future.
As cool as all of that is though, what really sold me the most on Spaces are those animated avatars. And they also happen to be one of the factors that was really hard for Facebook to get right. “The biggest challenge was how the avatars were going to look,” said Booth. “You know the uncanny valley? Well the uncanny valley in VR is a lot wider. Anything that’s attached to your head is going to have biological motions; it’s going to seem alive.” That means that anything that was too life-like would look weird.
“Finding the right balance of charming and being human recognizably without being too realistic and creepy, was harder than expected,” said Booth. “One of our early experiments was to have the lips smoothly blend with the shapes, thinking it would be realistic. And it was just way too creepy.” There were also some experiments on non-human avatars, like you’d see on Zootopia, but that was nixed as well. “Facebook is about authentic identity, which is fundamentally about humans.” Still, that doesn’t mean that costumes won’t be an option later on.
“The core of Spaces, the reason it exists, is so you can feel like you’re in person with your friends,” said Booth. “And then it’s having interesting things you can do with your friends. It’s not a chatroom where you’re just talking.
Of course, Facebook Spaces isn’t the only social VR app out there. Oculus even has its own version called Oculus Rooms. The difference between the two, Booth says, is that Oculus’ version is made just for Oculus hardware and is made to drive that particular platform. Facebook Spaces, on the other hand, is supposed to be much more widespread. That’s why even though it’s an Oculus exclusive right now, Booth wants it to be on all VR hardware. Yes, even the Vive.
When I asked what Booth would say to the skeptics of social VR, he said he doesn’t quite know. But what he thinks would really happen, is that VR skeptics would finally be persuaded to use VR because of social. “There are people that are looking at VR, thinking it’s not for me, because they think it’s all about gaming,” he said. “But what we’re trying to build is for everyone.”
“We want to bring you and your friends to VR,” said Booth. “I hope it’ll make more people look at VR as someone that people will actually want.”