Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

Epic's 'Live Link Face' Leverages ARKit and iPhone's TrueDepth Camera for Real-Time Facial Animation

MacRumors

MacRumors

macrumors bot
Original poster
Apr 12, 2001
67,642
38,057


Epic Games has launched a new iOS app, Live Link Face, that lets creators using the company's Unreal Engine game engine leverage Apple's ARKit platform and the iPhone's TrueDepth camera to capture and stream facial expressions for real-time rendering (via The Verge).

epic_live_link_face.jpg

Capable of working with just a single actor at a desk or as part of a complex motion-capture stage setup, Live Link Face supports timecode syncing to ensure it stays synchronized with any other recording devices involved in the capture process.

And when used at a desk setup, Live Link Face can track head and neck rotation data in addition to facial expressions, for more realistic avatar behavior using nothing more than an iPhone.

For more details on what Live Link Face can do, check out Epic's blog post.

Article Link: Epic's 'Live Link Face' Leverages ARKit and iPhone's TrueDepth Camera for Real-Time Facial Animation
 
Article Link
https://www.macrumors.com/2020/07/09/epic-unreal-engine-live-link-face/
This could be used for advanced "virtual" meeting spaces. Think of the possibilities for VR environments and this technology if it could be done live as opposed to capturing data for later use.
 
I wonder if this technology could grow into low budget mo-cap for independent game developers.
 
  • Like
Reactions: EyeTack
This would work great if it could tun you into a digital version of the guy in the movie “Saw” And you could send it to random people 🙃
 
  • Haha
Reactions: TVreporter
It actually might be kind of cool to use this as an additional level of realism in role-playing games. You would have to actually get into the character itself and your facial expressions will indicate to other NPCs your mood/state of mind. Think of skills such as intimidation, charming, etc. Of course something like this wouldn't be required, but could add more depth to gameplay for the users who want it.
 
Real-time & High-Quality Depth Data Maps (captured via ANY iOS device) are mutually EXCLUSIVE !

With a High-End, newer iPhone, one can get a High-Quality Depth Data Map from a Single Shot Camera, but NOT from one that captures in Real Time !

That "could" change if AAPL provided support for Reading the Focus Pixels output from Image Sensors (currently, it doesn't) !

ALSO, NO Tech Specs anywhere on this on their website !
 
otternonsense said:
I think the total lack of Apple gear on this shot, other than the iPhone, kinda speaks volumes about the setups of actual 'Pros' and not Youtube reviewers/professional advertisers.
Click to expand...
I’m my field we almost only use Macs, there are different kind of pros. Better tool for each job, I doubt making games for Windows is one where Macs are expected...
 
  • Like
Reactions: odin, Saipher, CarlJ and 4 others
macduke said:
It actually might be kind of cool to use this as an additional level of realism in role-playing games. You would have to actually get into the character itself and your facial expressions will indicate to other NPCs your mood/state of mind. Think of skills such as intimidation, charming, etc. Of course something like this wouldn't be required, but could add more depth to gameplay for the users who want it.
Click to expand...
First thought that comes to mind is the Fable games. Where the more “kind” actions you do determines the rest of the game for you. And vice versa for the more evil actions you do, the more the characters in game fear you.
 
  • Like
Reactions: EyeTack
otternonsense said:
I think the total lack of Apple gear on this shot, other than the iPhone, kinda speaks volumes about the setups of actual 'Pros' and not Youtube reviewers/professional advertisers.
Click to expand...

Well for a game developer yes. Web devs often sit with three screens connected to a Mac mini or a MacBook Pro. The equipment you use will always depend on your industry.
 
  • Like
Reactions: LeadingHeat, michaelnugent, Saipher and 1 other person
otternonsense said:
I think the total lack of Apple gear on this shot, other than the iPhone, kinda speaks volumes about the setups of actual 'Pros' and not Youtube reviewers/professional advertisers.
Click to expand...

Speaks volumes? The total lack...such drama! Was that the Earth just tilting a couple extra degrees from Apple being doomed because Apple Pro XDR displays were not used in the above promotion?

The story is about a company called Epic Games releasing an iPhone app. Which runs on an iPhone.
 
  • Like
  • Disagree
Reactions: odin and nickgovier
citysnaps said:
Speaks volumes? The total lack...such drama! Was that the Earth just tilting a couple extra degrees from Apple being doomed because Apple Pro XDR displays were not used in the above promotion?

The story is about a company called Epic Games releasing an iPhone app. Which runs on an iPhone.
Click to expand...

I didn't mention XDR, you did. I didn't say they're "doomed", you did.

Snarky mental gymnastics aside, yes, it's telling that there's not a single Apple device or peripheral in sight, and the running environment is not macOS either. The iPhones and tablets are still pretty good (for me anyways), but their Mac business and popularity, especially for actual Pro use, has pretty much collapsed.
 
  • Disagree
  • Like
Reactions: LeadingHeat and nickgovier
otternonsense said:
I didn't mention XDR, you did. I didn't say they're "doomed", you did.

Snarky mental gymnastics aside, yes, it's telling that there's not a single Apple device or peripheral in sight, and the running environment is not macOS either. The iPhones and tablets are still pretty good (for me anyways), but their Mac business and popularity, especially for actual Pro use, has pretty much collapsed.
Click to expand...

Of course I mentioned XDR, that's the display Apple manufactures. Should Epic Games put an iPad on the desk for use as a prop? Maybe setting up a Mac Pro below the desk for effects? Why would Epic Games feel compelled to do that?

Makes no sense.
[automerge]1594316355[/automerge]
djrod said:
I’m my field we almost only use Macs, there are different kind of pros. Better tool for each job, I doubt making games for Windows is one where Macs are expected...
Click to expand...

Yup.
 
Last edited:
citysnaps said:
Of course I mentioned XDR, that's the display Apple manufactures. Should Epic Games put an iPad on the desk for use as a prop? Maybe setting up a Mac Pro below the desk. Why would Epic Games feel compelled to do that?

Makes no sense.
Click to expand...

Where are you even coming up with these impossible retorts? Can you calm down? You're the only thing that makes no sense.

Epic games isn't compelled to do anything. I'm sharing a simple observation about this dev's choice of workstation and peripherals. I'm not expecting any stunts. It could have been a Mac, magic keyboard, LG 5K displays etc etc but they're not. It could show the Mac universe is falling out of grace with regard to professional design work, or not.

Case in point though, I was on a project in Munich during the last month, BIG client with a large design team and international product (in the EU), and the entire office was outfitted exclusively with Dell displays and hubs. Maybe half or less of the designers had Macs, and their chief had a XPS 13".
 
otternonsense said:
Where are you even coming up with these impossible retorts? Can you calm down? You're the only thing that makes no sense.
Click to expand...

No. You're complaining you don't see any Apple products, other than the iPhone which runs the app Epic Games is announcing.

I'm merely asking you what kind of Apple products you'd like to see. As only non-Apple displays are visible, I suggest PRO XDR displays might make you happy.

How about Apple-branded cables? Would that make you happy? AirPods?

What would you like to see to ameliorate your frothing about the lack of Apple products "speaking volumes?"
 
  • Like
  • Disagree
Reactions: odin and nickgovier
citysnaps said:
No. You're complaining you don't see any Apple products, other than the iPhone which runs the app Epic Games is announcing.

I'm merely asking you what kind of Apple products you'd like to see. As only non-Apple displays are visible, I suggest PRO XDR displays might make you happy.

How about Apple-branded cables? Would that make you happy? AirPods?

What would you like to see to ameliorate your frothing?
Click to expand...

Lol you really sound like you’re having an episode. Relax?

Could be a Magic keyboard & mouse. Who knows. I’ve also written it above. Maybe read what people write instead of reading into things just to project?
 
Anyone recognize what that multi-button panel is next to the keyboard? Everything else looks like Logitech keyboard, speakers, webcam, Dell monitors, etc.
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom
Back