If the R1 can handle all hand tracking and gesture recognition in real time, it would be a major step forward.
Got a tip for us?
Let us know
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.
Unity's Game Development Tools for Vision Pro Now Available in Beta
- Thread starter MacRumors
- Start date
- Sort by reaction score
If the R1 can handle all hand tracking and gesture recognition in real time, it would be a major step forward.
Looking through the WWDC RealityKit videos, I don’t see any reason you couldn’t have it recognize your actual golf club as the controller 🤷♂️
That’s exactly what it does. I was actually impressed with how much articulated hand tracking it does. It differentiates each joint in your hand.
I‘m sure it is indeed relatively trivial to add support for traditional peripherals (assuming Apple provides API support for that in the SDK), but Apple purposely avoided showing any such thing. My point was, Apple is not trying to push traditional gaming as a use case for VP. As long as that is the case, I wouldn’t hold my breath waiting for extensive support for traditional peripherals. Their whole dog and pony show was about how this is a whole new way of computing from the user‘s perspective.It's too bad the Vision Pro doesn't support Bluetooth, so you know, someone could build motion controllers, game controllers, keyboards, mice, etc., for it if an application/game supported it. /s
Apple hit the nail on the head when it comes controlling the VP in a more natural and intuitive way. Adding support for physical controllers and other peripherals is trivial compared to what they've accomplished.
if you think about it, supporting traditional peripherals invalidates the notion that this is a completely new (and better) way to interact with computers in a productive way. If this is really that much better, who would want to use traditional methods?
he was being sarcastic. third party controllers and peripherals over bluetooth are supported.
Glad to see that, but my last question stands. Is the new revolutionary input paradigm better, or are most buyers still going to run out and buy a keyboard, mouse, and/or some other controller?
I have run RealityKit on the Mac in the past. Reality Kit even has lights even thought Apple does not mention them much. The easiest way seems to be to run RealityKit in .nonAR mode and set the deployment target to be an iPad and then there is a checkmark in Xcode to run iPad Apps as native Apps on the Mac, they run native on the Mac without the simulator. Then you just load in your Pixar Universal Scene Description (USD) file and you are good to go! USD Animation and other things like Materials and skinned bone animation all seem to work!
I think you get what you need for what you’re trying to do. Certainly if you’re looking to replace your external monitors you’re going to pair a keyboard. If your 2D gaming, I’d buy a controller.
This device is personal, as in there is no one-size-fits-all use case or configuration of peripherals.
i was talking about reality composer pro. reality composer pro projects are only compatible with xrOS. yes i know how to make usd files, i was looking forward to use RCP shader graph for my project, but you can't author in RCP for both mac and rxOS in its current build.
Isn't Unity written in Windows Mono or something like that and then it runs using an open source implementation of Mono for the Mac? I could be completely wrong! Maybe it changed over time?
1. They showed someone using a game controller while playing that NBA game. They showed someone using a keyboard.
2. Spatial Computing is what they're pushing. VR can exist in it. And they're not "pushing" gaming, because they're trying to differentiate themselves from current head sets.
3. Use whatever makes the most sense for the task at hand (no pun intended) or whatever you're most comfortable with. Adding support for Sony's VR controllers isn't out of the question since they already support many other game controllers. I mean I use an Apple Pencil on my iPad, but I don't have to. It's just easier to draw, hand write and do precision work. And sometimes I like to use a keyboard and mouse on my iPad as well.
You need to re-imagine what gaming is like in Vision Pro. Forget everything you know. It doesn't have to be holding a light saber or anything. You don't hold anything at all. You touch, you pull, you push, you move things, your block, you hit, you punch, you slap, all with your hands and coordinated with your eyes.
Looking forward to hearing more about the games that will be available on Vision Pro.
This regularly pops up, but I'm not convinced.
If they did they'd probably do the normal Apple thing of ignoring every other platform and making it Mac exclusive. So if they owned say Call of Duty I can imagine there then being no PC version anymore, all the PC gamers no longer playing it, and it just being a few Apple gamers at a fraction of the size.
I want Mac games that are cross-platform so I can play against all my PC friends.
It's too bad the Vision Pro doesn't support Bluetooth, so you know, someone could build motion controllers, game controllers, keyboards, mice, etc., for it if an application/game supported it. /s
Apple hit the nail on the head when it comes controlling the VP in a more natural and intuitive way. Adding support for physical controllers and other peripherals is trivial compared to what they've accomplished.
You are so full of **** , so you didn’t even watch the WWDC , and don’t even know anything about this thing
it does have Bluetooth connection so you can connect controller keyboard and stuff using the MR AR blend in virtual reality
People like you need to shut up and stop spreading misinformation
I was looking at an Adobe Substance 3D Modeler video, their VR based 3D DCC tool… I’m having a hard time grasping how all those touch surfaces, pressure sensitivity, etc tools (a must for the task) will translate to hand air gestures.
They already generally support PS4/5, Xbox, switch, etc controllers… I’m assuming vision pro will support them too (I wouldn’t play a VR car game with hand gestures). So MAYBE they might add support for third party made for VR controllers too or at some point make their own.
Where is this assumption that hand gestures are going to replace dedicated controllers for a given task coming from?
Vision Pro supports input peripherals. Mouse/Keyboard/Controllers.
That's unlikely without motion controller support. Very few VR games can get away with hand tracking alone and 2D games with a console controller with a headset is pointless. I keep saying Apple is missing out on a decent market with gamers. Sure, a large majority of them wouldn't buy this, but I would consider it if it had support for existing games and peripherals. Apple would definitely get more developer support had they given an actual flying f*ck about gaming instead of whatever this is supposed to be.