Apple's WWDC 2023 Animated 'AR Experience' Now Live

[topdrawer]

How about AR-assisted cardio thoracic surgery? Or AR-assisted client walk-throughs of architect designed homes? That's just two of a huge number of AR applications that are in use today.

Those are extremely niche scenarios. So for the off chance that i can actually buy a home, and hire an architect to make me a home, find an architect talented enough and to my liking, the architect also has to be savvy enough to put his designs into ar, i as a client also have to happen to have the right hardware to view said designs? This souns like it would doulbe the design costs. Most architects barely give you plans and sketches during design.

Maybe it is for large developments, but those are usually massive revit models and macs cant even handle them.

Also vr doesnt give you a sense of the right scale.

 

[wigby]

Everybody else in the tech world: focused on AI
Also everybody else in the tech world: forgot about AR/VR

Apple: focused on AR/VR
Also Apple: forgot about Siri

Apple’s going 1000 miles in the wrong direction here.

Everybody is only focused on AI right now because that's where the investors are looking to throw money into. Apple has enough of their own money so they don't need investors in AI or AR/VR. They've been developing all of these things behind the scenes so there is no hype to get everyone's attention until Apple wants attention. Apple needs developers and partners which is why they are announcing and releasing hardware soon. Meanwhile, everyone will lose interest in AI a soon as the next hype arrives in a few months while Apple will be building entire ecosystems around AR/VR. Will Apple still be moving in the wrong direction?

 

[TheYayAreaLiving 🎗️]

This is interesting and unique. Reminds me of the bubbles.

https://twitter.com/x/status/1663576066718400513

 

[citysnaps]

Those are extremely niche scenarios. So for the off chance that i can actually buy a home, and hire an architect to make me a home, find an architect talented enough and to my liking, the architect also has to be savvy enough to put his designs into ar, i as a client also have to happen to have the right hardware to view said designs? This souns like it would doulbe the design costs. Most architects barely give you plans and sketches during design.

Maybe it is for large developments, but those are usually massive revit models and macs cant even handle them.

Also vr doesnt give you a sense of the right scale.

Hardly niche at all. It's a range of applications where AR can be used to help people solve problems.

"and hire an architect to make me a home, find an architect talented enough and to my liking, the architect also has to be savvy enough to put his designs into ar, i as a client also have to happen to have the right hardware to view said designs?"

Architects have been using cad tools for home and commercial building designs for years. Mine used them (five years ago), with 2D walkthrough on his display. Stepping up to AR to make the experience much better and a more real experience for clients, will be super easy.

As far as putting designs in AR, I suspect Apple will have an app for that taking an architect's files for conversion.

 

[Unregistered 4U]

This is interesting and unique. Reminds me of the bubbles.

https://twitter.com/x/status/1663576066718400513

Do the same thing, but over a glossy surface. Apple creates an image that replicates the light of the AR object bouncing off the surface.

 

[Arsenikdote]

So why is this called 'AR' ? Is overlaying something over a camera feed "Augmented Reality" now?

Wasn't it supposed to be about recognizing the objects it's pointed at and adding extra info for them instead of just adding extra stuff in no relation with what you see?

I always dreamed of AR being more like the movies where it is not only smart enough to know what we are wanting to engage with, but also being able to actually engage with something that is "not really there"

From one perspective, the smarter it is about knowing what we want, the better. However, can we get there with just it knowing what we are "focusing" on? With out eyes only? Is that tech able to work when in busy environments and our "focus" might not be clear? Would we then need a neural interface? Would we want a neural interface?

I think the crawl/walk/run methodology there works great. Just like with the iPhone starting with no apps, then apps, then crazy easy integrations into the hardware. I would think that overlaying something over the camera is likely step 1, and future step are dictated by technology progress and market adoption.

 

[Arsenikdote]

Those are extremely niche scenarios. So for the off chance that i can actually buy a home, and hire an architect to make me a home, find an architect talented enough and to my liking, the architect also has to be savvy enough to put his designs into ar, i as a client also have to happen to have the right hardware to view said designs? This souns like it would doulbe the design costs. Most architects barely give you plans and sketches during design.

Maybe it is for large developments, but those are usually massive revit models and macs cant even handle them.

Also vr doesnt give you a sense of the right scale.

The original comment was dismissing the tech as something that could never be used for anything important or for anything requiring accuracy. Are you suggesting you agree with that assertion? I don't want to assume you were agreeing with the original assertion just by responding to these two examples that were given to the original comment.

I do think there are quite a lot of examples people could provide where the technology could be utilized for "daily life" other than these two.

 

[citysnaps]

The original comment was dismissing the tech as something that could never be used for anything important or for anything requiring accuracy.

Yes. I'm hoping the video I posted above (post# 41) with surgeons using AR to assist them in spinal surgeries addresses both importance and accuracy.

 

[topdrawer]

Hardly niche at all. It's a range of applications where AR can be used to help people solve problems.

"and hire an architect to make me a home, find an architect talented enough and to my liking, the architect also has to be savvy enough to put his designs into ar, i as a client also have to happen to have the right hardware to view said designs?"

Architects have been using cad tools for home and commercial building designs for years. Mine used them (five years ago), with 2D walkthrough on his display. Stepping up to AR to make the experience much better and a more real experience for clients, will be super easy.

As far as putting designs in AR, I suspect Apple will have an app for that taking an architect's files for conversion.

I say this as someone who works with architects everyday. Most cad tools are not mac friendly. Just taking a model from one suite to another is a laborious task. Making cad files game/vr ready takes longer than recreating them from scratch.

Most of the cad industry is on pc.

Have you even tried their realityconverter app? It is terrible and really hard to work with. It has been out in beta for many years and it still sucks, and thats just for converting simple objects to usd files.

I cant imagine an apple plugin to convert a revit model into vr.

 

[jakksr]

I'm pretty sure someone else already noticed this, but while trying the AR-demo with AirPods, I could actually hear the sound moving when rotating and moving the device (spatial audio). I think that's really cool and might hint some future AR - audio related technology at this year's WWDC. It also glitched out and I've noticed it even mimics the doppler effect, wow! I also was blown away by the body occlusion, if you for example put your finger in the view.

Pretty cool tech isn't it?

Also for some reason I can not find it on the Apple Website when visiting it with my iPad 9th gen. I airdropped the AR-scene via my iPhone, and it actually works for a few seconds, but then crashes. Any idea why? I mean it does have an A13 Bionic after all...

 

[hagar]

Meh. I nee to move my iPhone for 2 minutes and then see a stupid bubble projected on and above my sofa.

And the iPhone screen dims after 10s.

 

[citysnaps]

I say this as someone who works with architects everyday. Most cad tools are not mac friendly. Just taking a model from one suite to another is a laborious task. Making cad files game/vr ready takes longer than recreating them from scratch.

Most of the cad industry is on pc.

Have you even tried their realityconverter app? It is terrible and really hard to work with. It has been out in beta for many years and it still sucks, and thats just for converting simple objects to usd files.

I cant imagine an apple plugin to convert a revit model into vr.

Before selecting an architect, I interviewed three in the San Francisco Bay Area, and all used CAD tools for design. All said hand-drawn designs were a thing of the distant past. I can't imagine any architect today who designs buildings or homes still using pencil, eraser, scum bag, and drafting board.

The architect I selected produced files (based on BIM modeling) that could be easily walked through on his display in 2D/faux 3D. And were easily printed. That was a HUGE timesaver for me and my architect in rapidly getting to a final design.

As a result, I can't imagine Apple (or Autodesk, etc) not coming up with conversion programs to take those BIM-modeled files and produce a rich 3D walkthrough AR/VR experience for clients. That'll be huge.

If I were to do another home construction project in the future, I'd certainly insist on the architect having that capability. I would also expect those files be usable by interior and landscape designers to show an array of potential interior/landscape designs in 3D that I could walk through, move/change objects, etc.

Here's the issue, in my opinion: I think we approach AR, and likely other technology, differently. It appears you see the AR future for use in design as a set of insurmountable problems. I see the future as a set of amazing opportunities ripe for exploiting. My sense is Apple feels the same (along with Stanford University's AR/VR Laboratory that Apple has been collaborating with for the last 7 years) with respect to their upcoming AR product.

 

[MrTemple]

Can't get excited about AR. It just seems gimmicky (and an excellent way of inducing nausea and accidents)

Can't get excited about 'everyday carry' computers. It just seems gimmicky (and an excellent way of inducing backaches and accidents).

*swaps 2006 iBook for 2008 iPhone*

Ohhhhhh...

 

[MrTemple]

If they can pull a rabbit out of their hat, like they’ve done before:

• Bringing the iPod to the portable digital music market
• Bringing the iPhone to the cell phone market
• Bringing the iPad out of thin air
• Bringing the 🍎Watch to the almost non-existent smart watch market

The difference is, who besides Meta has really pushed into this market? Did the Oculus Rift make an impact in… well, anything really?

On the one hand, Apple has shown they can succeed in both established and nascent markets. OTOH will an Apple AR/VR headset be just noise in the background of all the attention on AI?

AI is part of the (exponentially accellerating) CONTENT of the 'connected world'.

AR is an INTERFACE to the connected world. No more. No less. It's a possibility machine. Like a smart-phone, a voice assistant, computer, etc.

Completely different. CONTENT vs INTERFACE. Two sides of the same coin, enable each other in some strong synergies (most of which we cannot imagine today), but very, very different.

Where AR differs is it makes the connected world omnipresent. Everywhere (like a smartphone), but always on (unlike a smartphone).

You think smartphones changed the world (for good and bad)? Hooo baby, hold on to your butts.

In 5-8y every single one of us, every single day, is going to be wearing a glasses device that puts the connected world (and all its myriad AIs) into the world around us.

Thinking about an app, digging for your phone, then holding it in front of your face is going to seem as archaic in 2030 as waiting until you could walk over to your computer at home to check something on the internet feels to us today.

We used to call it "going on the internet". The smartphone changed that. It ended it for more things than we could imagine.

AR glasses will change "using your phone" to something just as different for more things than we can imagine.

 

[TheYayAreaLiving 🎗️]

Headset confirmed! Pretty cool animation with coding.

https://twitter.com/x/status/1663623166550241281

 

[citysnaps]

AI is part of the (exponentially accellerating) CONTENT of the 'connected world'.

AR is an INTERFACE to the connected world. No more. No less. It's a possibility machine. Like a smart-phone, a voice assistant, computer, etc.

Completely different. CONTENT vs INTERFACE. Two sides of the same coin, enable each other in some strong synergies (most of which we cannot imagine today), but very, very different.

Where AR differs is it makes the connected world omnipresent. Everywhere (like a smartphone), but always on (unlike a smartphone).

You think smartphones changed the world (for good and bad)? Hooo baby, hold on to your butts.

In 5-8y every single one of us, every single day, is going to be wearing a glasses device that puts the connected world (and all its myriad AIs) into the world around us.

Thinking about an app, digging for your phone, then holding it in front of your face is going to seem as archaic in 2030 as waiting until you could walk over to your computer at home to check something on the internet feels to us today.

We used to call it "going on the internet". The smartphone changed that. It ended it for more things than we could imagine.

AR glasses will change "using your phone" to something just as different for more things than we can imagine.

Sounds good, I like that.

I would also add AR helps people in their work, making desicisons, and much more. It's assistive in providing information that would otherwise be less accessible or more cumbersome to engage with.

Like how AR assists the spine surgeon (in the above video, post#41) engaging in less risky surgical procedures with better outcomes, just as an example.

 

[entropys]

I always dreamed of AR being more like the movies where it is not only smart enough to know what we are wanting to engage with, but also being able to actually engage with something that is "not really there"

From one perspective, the smarter it is about knowing what we want, the better. However, can we get there with just it knowing what we are "focusing" on? With out eyes only? Is that tech able to work when in busy environments and our "focus" might not be clear? Would we then need a neural interface? Would we want a neural interface?

I think the crawl/walk/run methodology there works great. Just like with the iPhone starting with no apps, then apps, then crazy easy integrations into the hardware. I would think that overlaying something over the camera is likely step 1, and future step are dictated by technology progress and market adoption.

It will be used for annoying advertising as you walk down the street.

 

[Gengar]

Really cool and very interesting.

 

[topdrawer]

Before selecting an architect, I interviewed three in the San Francisco Bay Area, and all used CAD tools for design. All said hand-drawn designs were a thing of the distant past. I can't imagine any architect today who designs buildings or homes still using pencil, eraser, scum bag, and drafting board.

The architect I selected produced files (based on BIM modeling) that could be easily walked through on his display in 2D/faux 3D. And were easily printed. That was a HUGE timesaver for me and my architect in rapidly getting to a final design.

As a result, I can't imagine Apple (or Autodesk, etc) not coming up with conversion programs to take those BIM-modeled files and produce a rich 3D walkthrough AR/VR experience for clients. That'll be huge.

If I were to do another home construction project in the future, I'd certainly insist on the architect having that capability. I would also expect those files be usable by interior and landscape designers to show an array of potential interior/landscape designs in 3D that I could walk through, move/change objects, etc.

Here's the issue, in my opinion: I think we approach AR, and likely other technology, differently. It appears you see the AR future for use in design as a set of insurmountable problems. I see the future as a set of amazing opportunities ripe for exploiting. My sense is Apple feels the same (along with Stanford University's AR/VR Laboratory that Apple has been collaborating with for the last 7 years) with respect to their upcoming AR product.

here is the problem, i work in architecural visualization, you don't seem to know much about it. i didn't say architects don't work in cad. i'm saying there is a huge gap between cad and vr ready assets.

 

[subjonas]

Can't get excited about AR. It just seems gimmicky (and an excellent way of inducing nausea and accidents)

Kinda sounds like you’re conflating AR and VR. There’s no reason AR would induce either of those, any more than an ordinary billboard would.

 

[xxFoxtail]

Can't get excited about AR. It just seems gimmicky (and an excellent way of inducing nausea and accidents)

I’m not really one to get motion sick. But, one of the first apps I tried on the Oculus Quest when I had one was some free International Space Station simulator. It was cool, though I felt myself start to get really sick really fast. Other VR apps weren’t so bad, I think it was just floating around in space that got me.

I think the thing that really got me hating VR was the $40 apps and games. That’s too expensive for what’s basically a mobile game.

 

[surfzen21]

This is interesting and unique. Reminds me of the bubbles.

https://twitter.com/x/status/1663576066718400513

I just realized that AR is just LSD for Millennials and Gen Z/Alpha

 

[Arsenikdote]

It will be used for annoying advertising as you walk down the street.

Uuuuuuuuuuuuug!!!!! 😖 You just had to go there, didn't you 😝

Apple better put in the "Ask App Not To Track" equivalent or it will be worse than walking through a casino when you are taking your dog for a walk 🤣

 

[Arsenikdote]

AI is part of the (exponentially accellerating) CONTENT of the 'connected world'.

AR is an INTERFACE to the connected world. No more. No less. It's a possibility machine. Like a smart-phone, a voice assistant, computer, etc.

Completely different. CONTENT vs INTERFACE. Two sides of the same coin, enable each other in some strong synergies (most of which we cannot imagine today), but very, very different.

Where AR differs is it makes the connected world omnipresent. Everywhere (like a smartphone), but always on (unlike a smartphone).

You think smartphones changed the world (for good and bad)? Hooo baby, hold on to your butts.

In 5-8y every single one of us, every single day, is going to be wearing a glasses device that puts the connected world (and all its myriad AIs) into the world around us.

Thinking about an app, digging for your phone, then holding it in front of your face is going to seem as archaic in 2030 as waiting until you could walk over to your computer at home to check something on the internet feels to us today.

We used to call it "going on the internet". The smartphone changed that. It ended it for more things than we could imagine.

AR glasses will change "using your phone" to something just as different for more things than we can imagine.

That is both an intriguing and exciting world to think about as well as scary. Either way though, I can't wait for it! However, given the current pace and progress of miniaturization and power constraints, I really do think that a "everyday" item like a pair of glasses might be a bit farther off than that. I hope they can get there quicker, but tech is running into physics issues and not idea issues. Wet chemistry is a limiting factor and there aren't a lot of great ideas that are getting past that right now. The "swiss roll" idea is maybe something. Maybe if we can pair smaller batteries and wireless charging? Anyway, I too am excited for where things are going and can't wait for AR to become mainstream, even if it takes 15 years! I just hope AR glasses don't turn out to be like the flying cars and futuristic cities we were supposed to have by "2025" 😆

 

[citysnaps]

here is the problem, i work in architecural visualization, you don't seem to know much about it. i didn't say architects don't work in cad. i'm saying there is a huge gap between cad and vr ready assets.

OK, if you say so. The good news, for you, is AR is something you'll never need to deal with regarding building/home design and you can keep on doing what you've been doing. And no worries, mate, that's certainly OK.

I know my architect will be all over it jumping in with both feet.