Apple Has Acquired Danish Startup Spektral, Focused on Real-Time 'Green Screen' Technology

Discussion in 'MacRumors.com News Discussion' started by MacRumors, Oct 10, 2018.

  1. MacRumors macrumors bot

    MacRumors

    Joined:
    Apr 12, 2001
    #1
    [​IMG]


    Apple has acquired Danish computer vision startup Spektral, according to a paywalled report from Danish newspaper Børsen.

    [​IMG]

    Spektral has developed a technology that can intelligently separate people and objects from their original backgrounds in photos and videos, and overlay a new background, resulting in what is called a "cutout." The solution is driven by deep neural networks and spectral graph theory.

    The technology can be thought of as real-time "green screen" processing powered by machine learning algorithms:
    The report says Apple acquired Spektral, formerly known as CloudCutout, in late 2017. Spektral co-founders Henrik Paltoft and Toke Jansen, who now lists himself as a manager of computational imaging at Apple, are said to have received 200 million Danish krone, or roughly $30 million as of today's exchange rate.


    Spektral's website notes that its solution makes it possible to create unique and immersive mixed reality content. Apple could incorporate the technology into the default Camera app on iPhone, or Messages, or Clips, or use the technology in bigger ways as it continues to push into augmented reality.

    Spektral was founded in 2014 and raised $3.3 million in venture capital prior to its acquisition by Apple, according to Crunchbase.

    Article Link: Apple Has Acquired Danish Startup Spektral, Focused on Real-Time 'Green Screen' Technology
     
  2. Scooz, Oct 10, 2018
    Last edited: Oct 10, 2018

    Scooz macrumors regular

    Joined:
    Apr 9, 2012
    #2
    isn‘t that already doing its thing in portait mode in the X‘s cam?

    Or will it be driving the „twice as good“ upcoming version?
     
  3. BootsWalking macrumors 6502a

    Joined:
    Feb 1, 2014
    #3
    This seems like a perfect technology fit for adding background video (and images) to Animoji. The results should be sick!
     
  4. DoctorTech macrumors 6502

    DoctorTech

    Joined:
    Jan 6, 2014
    Location:
    Indianapolis, IN
    #4
    This is really cool technology- taking what Apple already does (to a degree) to a whole new level. I can see lots of potential for incorporating this into iOS and especially putting it into “GlassesOS” or whatever they call the operating system for AR glasses.
     
  5. karranz macrumors newbie

    karranz

    Joined:
    Oct 24, 2016
    #5
    This means...more animoji anouncements in the feature
     
  6. mazz0 macrumors 68000

    mazz0

    Joined:
    Mar 23, 2011
    Location:
    Leeds, UK
    #6
    Couldn't they already be using this in the XR's portrait mode? That's using software to separate the foreground and background, which is what the software above describes, without depth values.
     
  7. T'hain Esh Kelch macrumors 601

    T'hain Esh Kelch

    Joined:
    Aug 5, 2001
    Location:
    Denmark
    #7
    They might be buying the company primarily for patents or to make sure they weren't bought by competing companies, and then likely got some good skilled people along.
     
  8. HiVolt macrumors 6502

    HiVolt

    Joined:
    Sep 29, 2008
    Location:
    Toronto, Canada
    #8
    I'm calling it now. This feature will be announced for iOS13, and it will not be ready until 13.1.
     
  9. iapplelove macrumors 601

    iapplelove

    Joined:
    Nov 22, 2011
    Location:
    East Coast USA
  10. ryanwarsaw macrumors 68000

    ryanwarsaw

    Joined:
    Apr 7, 2007
    #10
    Yeah little to no risk at that price.
     
  11. NachoGrande macrumors 6502a

    Joined:
    Mar 30, 2010
    #11
    30 million is pricey for that feature, but cheap for the company.
     
  12. AngerDanger, Oct 10, 2018
    Last edited: Oct 10, 2018

    AngerDanger macrumors 68040

    AngerDanger

    Joined:
    Dec 9, 2008
    #12
    YES! I’ve been waiting for this since Apple was rumored to release AR-based features!

    Photo Booth also does an extremely naïve version of this using difference matte:

    difference.gif
     
  13. Greenmeenie macrumors 6502a

    Greenmeenie

    Joined:
    Jan 14, 2013
    #13
    30 million is chump change for a Trillion dollar company like Apple.
     
  14. jonnyb098 macrumors 68020

    jonnyb098

    Joined:
    Nov 16, 2010
    Location:
    Michigan
    #14
    Oh boy another new gimmick to try and sell more phones next year.
     
  15. Krayzkat macrumors 6502a

    Krayzkat

    Joined:
    Apr 22, 2011
    Location:
    UK
    #15
    Well in that case.....


    Apple I’m a chump so give me 30 million :D
     
  16. FunnelDog macrumors member

    Joined:
    May 4, 2015
    Location:
    Atlantic Coast
    #16
    I've been saying for years that Ray Bradbury's "The Happiness Machine" refers to the iPhone... (Does it fit in your pocket? Or do you fit in it?)

    Now I'm further convinced that projectors and this technology combine well to meet his thoughts written in "The Veldt."

    This probably deserves its own thread because I can think of many other RB references that are true today beyond the generic "robots are taking over" connections.

    QUOTE="MacRumors, post: 26641923, member: 3"][​IMG]


    Apple has acquired Danish computer vision startup Spektral, according to a paywalled report from Danish newspaper Børsen.

    [​IMG]

    Spektral has developed a technology that can intelligently separate people and objects from their original backgrounds in photos and videos, and overlay a new background, resulting in what is called a "cutout." The solution is driven by deep neural networks and spectral graph theory.

    The technology can be thought of as real-time "green screen" processing powered by machine learning algorithms:The report says Apple acquired Spektral, formerly known as CloudCutout, in late 2017. Spektral co-founders Henrik Paltoft and Toke Jansen, who now lists himself as a manager of computational imaging at Apple, are said to have received 200 million Danish krone, or roughly $30 million as of today's exchange rate.


    Spektral's website notes that its solution makes it possible to create unique and immersive mixed reality content. Apple could incorporate the technology into the default Camera app on iPhone, or Messages, or Clips, or use the technology in bigger ways as it continues to push into augmented reality.

    Spektral was founded in 2014 and raised $3.3 million in venture capital prior to its acquisition by Apple, according to Crunchbase.

    Article Link: Apple Has Acquired Danish Startup Spektral, Focused on Real-Time 'Green Screen' Technology[/QUOTE]
     
  17. RedGala macrumors regular

    RedGala

    Joined:
    Jun 17, 2015
    #17
    Pretty sure Apple engineers are well equipped to implement this without too much difficulty...
     
  18. djcerla macrumors 68000

    djcerla

    Joined:
    Apr 23, 2015
    Location:
    Italy
    #18
    I suspect your comment is not going to age well.

    You gotta love English language.
     
  19. Kabeyun macrumors 68000

    Kabeyun

    Joined:
    Mar 27, 2004
    Location:
    Eastern USA
    #19
    This is fantastic! Masking is something I frequently want to do with my shots and something which I find very challenging, even after trying it with a number of commercial masking apps. I don’t know if Spektral’s product is high quality, but I’m loving this acquisition.
     
  20. Frantisekj macrumors member

    Frantisekj

    Joined:
    Mar 9, 2017
    #20
    This technology can be useful not just for animoji and portrait mode but in Final Cut and of course all kind of AR Apps.

    And as you can remove background then you can remove foreground and create totally false pics and movies so welcome in fake reality.
     
  21. imgroot macrumors newbie

    Joined:
    Mar 9, 2018
    #21
    Okay, I'll ask. Who's the woman in the promo ad and video? :D
     
  22. Moonjumper macrumors 68000

    Moonjumper

    Joined:
    Jun 20, 2009
    Location:
    Lincoln, UK
    #22
    It says Apple acquired them in 2017, so it could already be their technology powering it.
     
  23. everythingapplerainbow macrumors member

    everythingapplerainbow

    Joined:
    Sep 28, 2017
  24. code-m macrumors 6502a

    code-m

    Joined:
    Apr 13, 2006
    #24
    The tech already exists to make fake yet highly convincing photos, videos and audio of famous figureheads.

    The lines are blurred from reality to virtual. Many don’t have the attention span to pick out the illusion and it’s becoming ever so challenging. Only our true selves know, unless we convince ourselves otherwise.
     
  25. wigby macrumors 65816

    Joined:
    Jun 7, 2007
    #25
    Yes except portrait mode is not video. This company uses AI to create cleaner mattes used specifically for real time video. This acquisition is more about FaceTime, iMovie, FCP and future AR endeavors.
     

Share This Page