> This might be because games are easier or faster to build.
A simpler explanation is that outside of games VR simply doesn't bring much to the table.
My favorite anti-VR-hype example involves sending a letter to people. Do I virtually fold paper into thirds for a virtual envelope and virtually lick the flap to seal it before exiting my virtual house to go to the virtual post-office to buy virtual stamps? Even in a game-world, would anyone want to, once the novelty wore off?
Heck no: I click "Send" on my e-mail client.
All the 3D parts of the workflow get removed, because they're tedious and tiring and not necessary for the goal. There may be some useful 3D visualizations for understanding things, but everybody will quickly realize that standing and crouching and waving their arms around all day "picking up" data-objects and and "dropping" them into virtual filing zones is going nowhere. Moving a mouse is so much faster and easier, even more-so with abstract filter/assistant tools.
Galloping furiously through the forest on my trusty steed, intent on intercepting the courier agent before it arrives in the next town with my 2AM texts to my ex...
I think it could go either way, honestly. As far as modern efficient e-mailing goes, it will simply be nice in many ways to have floating apps in the room instead of windows on a monitor, once the comfort/productivity tradeoff improves. But also, maybe when I open a real letter, my glasses recognize it as a letter, scan it into my library and blow it up into a floating virtual page, with or without OCR, maybe with additional context and history. Maybe I can choose to open a UI to respond digitally, or maybe it physically points me to my paper and pen. I can do any combination of writing a real letter or a virtual letter and sending it digitally or using the oldfashionedletters.com plugin to send out 100 cursive wedding invitations supported by whatever digital back-end is activated when the recipients' glasses detect reception of the letter. Point is, there's a unification of both approaches and they each gain new superpowers.
You're talking about novelty wearing off, but I think that might just be the difference between good and bad skeuomorphic design. Your email scenario is definitely a plausible thing that someone would make right now, and it would absolutely suck and die, but maybe it's just part of an experimental trend that will exhaust itself like that period in the 90s when every new cd-rom you'd pop in would autolaunch a unique, horrendously ugly and confusingly skinned UI that looked like it was straight out of a Cronenberg movie. It suddenly becomes easy to make a bunch of dumb shit and it takes time to see what sticks, and there's a lot of silliness on the road to best practices... but they ARE buried somewhere in there, we DO eventually get to a fundamentally better way of interacting with computers.
I want to be able to put on a pair of glasses and pull up a 3D diagrammatic overlay of anything I'm trying to fix around the house or in my car, complete with tutorials. If I'm in a hardware store, I want to be able to say what it is that I want and have a path to it highlighted. I want to be able to turn a depressing walk in a crummy downtown neighbourhood into a relaxing walk in the forest. I want to be able to stroll along in that forest talking to someone as though they were walking right next to me even though they are very far away.
This stuff is, technically, not that far off. I just hope a company that respects user privacy gets there first.
Yeah, AR is definitely the killer app for me — though the implementation might end up being like Apple’s AR-through-VR.
Games like Horizon Zero Dawn or Cyberpunk 2077 have diegetic AR HUDs that highlight some of the stuff you could do, and I’ve definitely felt the desire to have some of those features available IRL.
It's a but further off than you might think. Even the Vision Pro is on the border of acceptability for working and reading in, and that's literally the bleeding edge of miniturized display technology. Going from a traditional flat panel display to a waveguide and projectors with an optically transparent display is a MASSIVE endeavor, at this point is essentially limited by physics (bound by current research) let alone issues with heat, battery life etc.
The AR products that eventuallg spur mass adoption are almost guaranteed to be backed by billion dollar investments, with the expectation of more user data than ever before.
By your own logic if the Vision Pro is on the border of acceptability, and it's here, now, is it really going to be THAT long? To get to the endgame, sure, but things are only getting better and cheaper, and what intermediate steps will cross that threshold? Yes it takes a long time for the Meta glasses category to fully merge with the Vision Pro category, but moving either one just a little bit towards the other will be incredibly useful and accelerate the process. Also, regarding the "bleeding edge" comment, obviously that's true in many respects, but iirc there ARE a few industrial headsets out there that, for way more money, beat it on some isolated core specs like panel and passthrough resolution (who knows about overall quality; I suspect the Vision Pro is better or equal with lower specs per Apple's MO). There are also other other form factors developing right now, like I suspect that it won't be long before we see some very compelling version of the minimal Bigscreen VR style goggles with the addition of cameras tethered to a Steamdeck-type device that you can hide in a bag (if not pocket).
TL;DR: The killer app is boring (virtual monitors) and we don't have good enough headsets to do it yet
> There may be some useful 3D visualizations for understanding things
> Moving a mouse is so much faster and easier, even more-so with abstract filter/assistant tools.
Exactly. The only thing I'm hyped for so far is the idea that one day, we'll have virtual monitors. First, we need good enough headsets. The technology has improved since OP's article, but there's more work to do.
Some of it is software. We'd have to do the awful work of implementing backward-compatible virtual monitor and window management. Look at X vs Wayland for an example of how hard it is to get things right.
Despite how hard all of this is, I suspect it's the way forward because:
* it'd be cheaper and more flexible than complex multi-monitor standing desks
* thousands of years after inventing writing, we still rely on writing 2D characters on 2D surfaces for language
* we can inset AR and 3D panels into manual windows the way we already do to reality with physical 3D displays
I think headsets are decent enough for virtual monitors, as in the resolution and latency are reasonable and head and hand tracking works just well enough. The software quality, HCI design and UI problems are bigger issues IMO, e.g. having a native multi tasking enviroment, proper mouse support, better gesture control over virtual monitors, better viewing of large surfaces based on eye tracking, voice controls.
TL;DR: Starting with AR overlay monitors + mouse would simplify deliverables to focus on hard technical hurdles could be the focus
IMO, some of what you mentioned is contradictory. That's not a bad thing. For example, virtual monitor and gesture-based headset-only devices might have different use cases. It's like the difference between a an iPhone, iPad, and ARM-based Mac. All might share software and hardware components, but they're each good at very different things.
To my understanding, focusing on the virtual monitors first has a number of benefits:
* Simplify deliverables and OS integration significantly
* Help developers by providing cheaper multi-monitor setups
* Dogfooding
* Get certain technical parts (foveated rendering, etc) right before trying to nail new input methods
> but even everybody will quickly realize that standing and crouching and waving their arms around all day "picking up" data-objects and and "dropping" them into virtual filing zones is going nowhere.
Losing weight is way more about diet than exercise. The body gets really efficient at doing repetitive motions and starts burning fewer calories for the same actions.
> In 2016, Pontzer and colleagues published a study putting forward the constrained energy model: Energy expenditure does increase with more activity, but only to a point. Once physical activity gets really high, the body will adjust other components of the metabolism to keep your daily energy expenditure within a narrow range
Blade & Sorcery was worth the price of VR for me, at least. A couple mods and suddenly you're in the best Jedi simulator ever made. It's also the only way to play DCS or any racing game now. No going back.
Well, Microsoft is killing off WMR so my headset will go with it... And frankly I don't want any VR stations when my headset worked just fine without them.
There's no reason to think there will ever be a sustained demand for VR entertainment. The experience is novel (for a time), but it's not qualitatively better than other delivery systems. And then, of course, the transient novelty never quite justifies the expense. VR's perception simulation has an uncanny valley-like effect. It's a bit too close visually (with the inevitable nausea), but it also calls attention to the absence of other forms of sensation.
I have been playing online multiplayer VR games for years, with servers full of people who would beg to differ.
The things you report (initial novelty, nausea, uncanny valley, little justification for the expense) simply are not applicable to anyone who plays VR for longer than a few Beat Saber sessions in front of friends & family.
Of course it's a niche, but there is demand. Especially in Gen Z, many of whom received Quest HMDs over the last few years and have been rabid adopters who will grow up to be committed customers. Lobbies for basically every game on offer are full of them (for better or worse).
I disagree. 3D movies never really took off because the illusion of depth is limited to a prism around a two-dimensional screen, but VR allows for a full three-dimensional representation and a more complete illusion of depth. It’s like the difference between black-and-white and color film, or between silent film and film with sound. The only reason it seems like a novelty now is because virtually all the VR content is novelty content.
"Or hey, even more amusingly, a killer app could be something B2B, like enabling remote robotic work, where the worker’s commands get recorded and become training data for autonomous robotic systems. This is the core premise of my short story on AI, which I can now plug here. woohoo!"
I actually thought this is where the next big AI company would come from. A gaming company that created a game that also had a business use case. They would use the data from that game to train ML models that were capable of doing work. If someone were able crowd source some AI robot training through gaming, they would be paid by consumers and by businesses. Kind of like how captcha digitized books in the backend.
Having owned a Quest 2, I think Apple has as shot at this, because I think most of these devices are essentially PC Monitors. Apple is the first company that has put a full on laptop chip into the device and unlike Facebook, they control a major desktop operating system, so it will likely be able to run full applications like Word, Excel, and a full Browser and more apps are going to easily be able to port.
Instead of building a wall full of monitors, I think running on the entirely on device makes a lot more sense. Facebook just can’t pull it off, because they don’t have a full operating system like OSX to pull from, but they were right to but the processor in the headset.
I got the Vision Pro, and I'm quite sure that replacing desktop monitors at home or in an office is not something people will want to do. The technology isn't there yet. It's heavy, the external battery and its cable are obtrusive, the field of view is small, and you would still need to use a keyboard and a mouse. There's also a bit of lag with the passthrough video and it jitters when walking around. Maybe in a few years, despite many people having suboptimal monitor setups.
It's not quite as bad, but for this price in 2024, you'd expect better than having no peripheral vision. Having tried many headsets, I'd rate the Vision Pro's FOV as mid-tier at best.
I still think the headset must be merely a display. Feom your phone or desktop you stream to your vr display. The only way people are going to use vr is when the devices are small. Ideally just like a pair of glasses. Before this happens it's not becoming mainstream
> Apple is the first company that has put a full on laptop chip into the device
That's not entirely true. SimulaVR has been working on a full-PC-power, standalone, Linux-based heart for quite a while now. They're just small and don't have Apple's "move the world" money.
Sorry to hijack your comment. You responded to me about a year ago when I was asking about 3D websites when nobody else did and I really appreciate that, so I wanted to thank you even though it's been so long later. Looks like Apple built something similar to what I was thinking with their headset, which I am not too familiar with and haven't gotten to use. To explain some of what I was thinking: when you look at a piece of physical paper you could click on a sentence or word and it would bring up the say definition, or wikipedia page, or on a financial report if you clicked on a line it would bring up the details of the report. Like a website in 3D. I had some other ideas too for desktop integration, but that's not important. Thanks again.
I met my S.O. in the VRchat club scene, where thousands of people get in full body tracking systems every weekend (if not every night) and dance together across dozens of virtual worlds in highly customized avatars decked out in as many graphical features as Unity supports. This scene has existed for years.
A simpler explanation is that outside of games VR simply doesn't bring much to the table.
My favorite anti-VR-hype example involves sending a letter to people. Do I virtually fold paper into thirds for a virtual envelope and virtually lick the flap to seal it before exiting my virtual house to go to the virtual post-office to buy virtual stamps? Even in a game-world, would anyone want to, once the novelty wore off?
Heck no: I click "Send" on my e-mail client.
All the 3D parts of the workflow get removed, because they're tedious and tiring and not necessary for the goal. There may be some useful 3D visualizations for understanding things, but everybody will quickly realize that standing and crouching and waving their arms around all day "picking up" data-objects and and "dropping" them into virtual filing zones is going nowhere. Moving a mouse is so much faster and easier, even more-so with abstract filter/assistant tools.