Chatbot-Like Siri Patent Includes Intelligent Image, Video, and Audio Recognition Within Messages

Discussion in 'iOS Blog Discussion' started by MacRumors, May 11, 2017.

  1. MacRumors macrumors bot

    MacRumors

    Joined:
    Apr 12, 2001
    #1
    [​IMG]


    A patent application published by the United States Patent and Trademark Office today details a new Apple service where users could make inquiries and talk with the company's AI assistant Siri through Messages (via AppleInsider). The new patent is similar to a filing the USPTO published late last year, but now includes deeper integration with audio, video, and image files.

    Similar to chatbots in Facebook Messenger and other texting services, Apple's patent describes a Siri that could perform her current duties without the user having to speak aloud, which could be helpful in certain public situations.

    The "Intelligent Automated Assistant in a Messaging Environment" could respond to text, audio, images, and video when sent to it by the user, which Apple said would result in "a richer interactive experience between a user and a digital assistant." The patent gives a few examples of a conversation held between Siri and a user in Messages, with the user asking questions regarding calorie content in food, upcoming meetings, and even asking Siri to text a friend.

    [​IMG]

    Interesting applications include a thread where a user texts Siri a picture of a car or a bottle of wine, and Siri sees the images and can intelligently respond to the user's inquiries about them. For the car, the user asks Siri for details on pricing for a specific model using only an image, and Siri searches the internet and returns the relevant MSRP information.

    The bottle of wine image is used as an example to show Siri's memory functions, where a user asks Siri to remember their favorite wine, which she can resurface at a later date. Siri sees the wine image, reads the label, and can then respond to a user's question in text format about the brand and even year it was made.

    [​IMG]

    Other image-related inquiries include "Where is this place?" and "What insect is this?", to which Siri would respond "This is the country Algeria" and "This is an earwig," respectively. Audio and video could also be recognized by Siri, including simple Shazam-like questions related to songs and the content of shared videos.

    Apple points out in its patent that thanks to the chronological format of texting, users would be able to "review previous interactions" with Siri, unlike how current Siri conversations disappear immediately after they conclude. Subsequently, Siri would be able to use that history to become smarter and "define a wider range of tasks."
    The patent includes a description where Siri would be "a participant in a multi-party conversation," allowing group chats to use Apple's AI simultaneously. Apple gives an example where one user asks Siri to list nearby Chinese restaurants to begin making the group's dinner plans, and then another user responds by asking Siri to whittle down the list to only include the cheapest places. One user's personal Siri can even be asked to remind other participants of the upcoming dinner.

    [​IMG]

    Apple is believed to be working on an "enhanced Siri" that might launch in iOS 11 this fall, but the exact specifications as to what would make the new Siri "enhanced" have never been divulged. A questionable rumor in March stated that deep Siri integration is coming to Messages in iOS 11, but the source of the news -- The Verifier -- doesn't have a previous track record of reporting accurate rumors.

    Chatbots are certainly growing in popularity so it wouldn't be too surprising if Apple introduced some kind of text-based Siri interface, particularly considering the multiple patents the company has published on the topic. Still, as with all patents it's best to look at Apple's new filing as an intriguing insight into what the company might be working on for the future, rather than proof of an impending launch.

    Article Link: Chatbot-Like Siri Patent Includes Intelligent Image, Video, and Audio Recognition Within Messages
     
  2. Scottsoapbox macrumors 6502a

    Scottsoapbox

    Joined:
    Oct 10, 2014
    #2
    So instead of fixing Siri's speech interface Apple wants you to type in queries...

    ...so different than Googling.
     
  3. Bacillus, May 11, 2017
    Last edited: May 11, 2017

    Bacillus Suspended

    Bacillus

    Joined:
    Jun 25, 2009
    #3
    Hey !
    Someone at Apple now seems to have noticed the zillions of misunderstood Siri logs they receive any minute.
    That's a positive (even though it is the copycat patent troll...) and at some time they may realize they'd better feed any Siri query they get directly into Alexa / Viv / Google etc.
     
  4. Scottsoapbox macrumors 6502a

    Scottsoapbox

    Joined:
    Oct 10, 2014
    #4
    . . . . . . . . [image of car]

    What should I do with it?

    . . . . . . . . How much does it cost?

    OK, now playing songs by Lady Gaga.
     
  5. lincolntran macrumors 6502a

    lincolntran

    Joined:
    Jan 18, 2010
    #5
    bc lots of people prefer to not talking in to a phone in public places or quite places.
     
  6. NT1440 macrumors G4

    NT1440

    Joined:
    May 18, 2008
    #6
    .....are you asserting that somehow working on one feature means that the core of Siri isn't being worked on?
     
  7. Scottsoapbox macrumors 6502a

    Scottsoapbox

    Joined:
    Oct 10, 2014
    #7
    And most people prefer google search to Siri search so...
     
  8. xflashx macrumors regular

    Joined:
    Aug 12, 2016
    #8
    Seems to be somehow.... useless, like the iMessage stickers are (for me)
     
  9. Soccertess macrumors 65816

    Joined:
    Oct 19, 2005
    #9
    Hopefully this works with what'sapp, because my family and friends all migrated to what'sapp a while ago.

    Apple missed the boat years ago, if they had made it cross platform, they would dominate the messaging world and it would have pushed Apple watch sales like no tomorrow.

    Messages is dying a little bit more every day.
     
  10. rmbpuser macrumors 6502

    Joined:
    Sep 1, 2012
  11. macduke macrumors G3

    macduke

    Joined:
    Jun 27, 2007
    Location:
    Central U.S.
    #11
    I've never noticed this before, but do they always put a real carrier name on these patent mockups? I thought they usually leave them intentionally vague. Looks like Apple is a fan of T-Mobile as well!
     
  12. lincolntran macrumors 6502a

    lincolntran

    Joined:
    Jan 18, 2010
    #12
    So now we have 2 choices (and many others) instead of google, choices are good.
     
  13. lazyrighteye macrumors 68000

    lazyrighteye

    Joined:
    Jan 16, 2002
    Location:
    Denver, CO
    #13
    Low-hanging Siri jokes aside, this seems interesting. I welcome any traction on Siri development. And while today's Siri makes the thought of Siri inquiries via photo or video seems laughable, the next update to Siri could make this concept more plausible.

    As one who tries to interact with Siri as much as possible, this Messages concept could be nice for a couple of reasons.

    1. An archived Siri thread.
    I'm often frustrated when after conducting a Siri inquiry and then leaving the Siri window to (say) check a link, I can't get back to my initial Siri interaction to review, continue or amend. Even a standalone Siri "app" could be interesting. Could offer a simple/intuitive way for users to "get back" to their Siri-ing via Home button double-click to reveal a Siri slide in the app switcher.

    2. The ability to access Siri via text input.
    There are definitely scenarios where accessing Siri via voice isn't always desirable. Being able to interact with her via text is a welcome option.

    Will be interesting to see what Apple has up their sleeve regarding Siri. Will
    Be nice if they update us on Siri dev at WWDC. While it can never been good enough, any development/advancement of Siri will be welcomed.
     
  14. Goatllama macrumors 6502a

    Goatllama

    Joined:
    Jun 24, 2015
    Location:
    Mountaintop Lair
    #14
    A cursory glance through what Google regurgitated showed three schematics that just say 'carrier,' so this does seem to be outside the norm. What it indicates? Who knows, probably nothing. :p
     
  15. Naraxus macrumors 6502a

    Naraxus

    Joined:
    Oct 13, 2016
    #15
    News Flash: The core of Siri hasn't been worked on in a long time, hence the multitude of errors that have placed it firmly in third place behind Amazon & Google assistants.
     
  16. Tastannin macrumors 6502

    Tastannin

    Joined:
    Sep 19, 2003
    Location:
    UT
    #16
    Text access to Siri will be great for those of us who are Deaf/Hard of Hearing or have difficulty speaking.
     
  17. lincolntran macrumors 6502a

    lincolntran

    Joined:
    Jan 18, 2010
    #17
    It's more like fake news instead of news flash, or you have some sort of inside info that the rest of us aren't aware of?

    Of course SIRI core is being worked on constantly. You just choose to look at glass half empty.
     
  18. NT1440 macrumors G4

    NT1440

    Joined:
    May 18, 2008
    #18
    Newsflash: you don't know what you're talking about:

    https://www.macrumors.com/2017/02/22/apples-cambridge-office-siri-research/
    http://www.businessinsider.com/apples-secret-siri-lab-in-cambridge-2016-11
    https://9to5mac.com/2016/11/03/apple-cambridge-rd-office-siri-vocaliq/

    They've been working for over two years to rebuild the backend of Siri. It will be better when it is released.

    So spare me your ignorant nonsense.
     
  19. alayal macrumors member

    Joined:
    Dec 8, 2015
    #19
    if we have this and some offline commands to Siri in iOS 11 I'll be very happy. The important thing is that Siri would have some context based on previous inquires not like now
     
  20. Naraxus macrumors 6502a

    Naraxus

    Joined:
    Oct 13, 2016
    #20
    Siri is lagging behind Alexa no matter how much you wish it weren't so. And the fact that they have been working on it and it still has glaring errors that place it in third place speaks to how lazy Apple has gotten lately with software quality.
     
  21. NT1440 macrumors G4

    NT1440

    Joined:
    May 18, 2008
    #21
    ...it speaks to them not flicking the switch on activating the completely rebuilt backend of Siri. Until that changeover is actually made of course you're not going to notice anything new with Siri.

    Do you understand how software development works? So Alexa is on a different release schedule and is newer than Siri....now, after the next iOS release Siri is going to be newer (and featuring the work these teams have been putting into it for the last 3+ years).

    Frankly I think you're just mad you got called out for a complete and utter falsehood.
     
  22. jonnysods macrumors 603

    jonnysods

    Joined:
    Sep 20, 2006
    Location:
    There & Back Again
    #22
    Hey Siri, let me use my AirPods offline. That would impress me.
     
  23. pweicks macrumors regular

    pweicks

    Joined:
    Dec 23, 2016
    Location:
    USA
    #23
    Apple is way behind on allowing Siri text commands. I remember that was one of the biggest things I missed about my Windows phone when I switched. You could tell Cortana things by typing, not just speaking. It's super convenient.
    --- Post Merged, May 11, 2017 ---
    One of the reasons why you may THINK that Siri is so far behind Google and Alexa is because of how far more extensive Apple has been in developing Siri for other languages. As of now...

    Siri works with....................... 21 languages
    Google Assistant works with....... 6 languages
    Alexa works with...................... 2 languages

    Wikipedia, look it up. Can you imagine how much work it must take to make an AI assistant that works with just 2 or 6 languages?? Not as much as it takes to make an AI assistant that works with 21 languages.
     
  24. macduke macrumors G3

    macduke

    Joined:
    Jun 27, 2007
    Location:
    Central U.S.
    #24
    Apple buys T-Mobile confirmed obviously!!
     
  25. RedGala macrumors regular

    RedGala

    Joined:
    Jun 17, 2015
    #25
    I guess the main difference would be Siri acting on local information like calendars, contacts, and Apps. I think this is mainly useful for when you want to fetch that kind of relevant info and not have to ask for it again if you need to exit the screen and do something else.
     

Share This Page