My take on this.
- visual analytics is not new. Facebook and Google also do this, and they can do this on websites. They can track mouse movements, where you hover and for how long, etc.
- the replay feature in Glassbox is a feature available. But the article doesn’t say if the apps actually use that feature. The article only shows apps that use Glassbox. The exception is Air Canada.
- Air Canada is the one that got analyzed and looks like we get a feel how things work. Looks like the screen replay feature does its thing by capturing many screenshots during a user interaction. This gave a slideshow like replay on what the user did. It’s not a full fledge screen recording, and app dev can employ black boxes to hide sensitive data, but of course the problem is that in this instance, Air Canada did a poor job at it.
From Apple’s perspective, there’s probably not much they can do. Many apps are simply a “window” for a web app, thus this tracker can still be applied regardless of Apple’s restriction in the app API side, unless Apple want to severely restrict apps from running a “web view.” One thing that maybe they can enforce is the user notification of capturing of screenshots, but I don’t know if they can do this without breaking some web capabilities inside an app.
Nonetheless, this has been exposed. Each of those app devs must come clean on what they do or don’t do. Apple also should come out explaining what’s actually going on so there’s no FUD (ie. No actual screen recording as it might sound), and come out with steps to discourage developers from doing this.
And let me iterate, this method of analytics is nothing new, and has been employed on websites for ages. Facebook has a tool for it as well. Any digital marketer would know.