Future Siri could talk to whoever is calling you, and take notes

Posted:
in iPhone
Apple wants Siri to work the phones for you, make and receive calls, arrange appointments, or just play back different voicemail messages to your partner and your boss.




Face it, Siri is going to have to become a lot more consistent before any of this will ever be used, but Apple has plans. A newly-granted patent called "Digital Assistant Integration with Telephony," details how Siri -- or other voice assistants -- could get you using your iPhone for calls again.

"Telephony has long been a fundamental technological feature for facilitating communication," says Apple. "Recent advancements in digital assistant technology has also improved interactions between humans and devices... however, the full potential of integrating telephony and digital assistant technology has not been fully realized."

At the most basic level, Apple's proposals would mean you could call up Siri with your voice, even while you're on phone call. Siri could intelligently determine that you're asking it to do something, as opposed to complaining to your caller about it.

"For example, a user can provide a speech input containing a user request to a digital assistant operating on an electronic device," continues Apple. "The digital assistant can interpret the user's intent from the speech input and operationalize the user's intent into tasks."

Siri might, for instance, do a dictionary check on the word "operationalize" and whisper back in the user's ear that, yes, surprisingly, it is a real word.

Or if you're in a group call and someone asks, "Does anyone know how late The Pizza Place is open?"... Siri could look up the answer and butt in to the conversation.

But Apple's intention is to do much more than provide regular Siri access where it currently doesn't.

Let Siri screen your calls for you.
Let Siri screen your calls for you.


"For example, conventional digital assistants are not capable of managing incoming and outgoing calls on behalf of users, much less facilitating ongoing calls," continues Apple. "Given the speech-based nature of both digital assistant technology and telephony, an improved system for integrating digital assistants with telephony is desired."

So Apple figures that since you talk to Siri and you talk on the phone, there must be something you can do to combine them. A very great deal of the almost 40,000 words of the patent is concerned with how to enter gestures on the iPhone screen during a call, but then Apple lets into letting Siri take over.

"For example, an incoming call may be received, from a caller, at an electronic device," says Apple. In other words, your iPhone rings and Siri takes the call.

What happens then depends on whether Siri recognizes the caller, as in it's someone in your Contacts list. There are obviously also unknown callers, plus Apple says Siri can detect automated calling systems.

The idea is that it can do different things, it can respond differently, depending on who is calling. Siri can just hang up on automated calling systems, for instance.

Let's have your Siri call my Siri

It isn't just checking against your Contacts list, either. "In some examples, voice identification and speech recognition is utilized in order to determine the identity of a caller," continues Apple.

As ever, Apple follows a comment like that with a lot of detail about privacy. "The generating and storing of voiceprints may require prior approval from the person corresponding to the respective voiceprint in order for such voiceprints to be utilized," it says.

But it suggests users could save voiceprints that "may correspond to speech profiles of persons such as family members or other close contacts."

Apple patents always concentrate on how something may achieved and tend to only skim over possible applications. So the patent moves on to how Siri could assign "various trust levels... associated with callers."

Ugh, not him again.
Ugh, not him again.


"For example, any known contact may be assigned a 'medium' trust level," says the patent. "Certain contacts may be assigned a 'high' trust level, such as contacts belonging to specific groups (e.g., 'family,' 'VIP,' etc.)."

"A high trust level may also be assigned based on a communication frequency," so that when "the user interacts with the caller at least once per day," that caller could be "assigned a 'high' trust level."

Equally, there are "low" trust levels, "such as unknown callers, callers associated with contacts added to a "block" list, and the like."

It's by having this ability to "know" who the caller is, and having an assigned trust level, that means Siri can play your boss a recorded message saying you're in a meeting. And tells your partner you're at a job interview.

Siri can mess with callers

Say you don't know the caller, but because of your work, you can't just block all unknown calls. Apple says that Siri could ask the caller some questions, and depending on the answers, put them through to you or hang up.

In one example, the question is simply "who are you trying to reach?" or something similar.

But it can also go further, specifically to figure out if the caller is a real person, or another Siri trying to phone you about timeshares.

"For example, the digital assistant may provide, to the caller, a prompt including an interrogatory," says Apple, "such as 'Let me ask you some questions. What is the opposite of Monday?'"

If you just blinked at that, Siri knows you're human.

"In this example, the interrogatory may include a nonsensical or otherwise illogical question," continues Apple, "such that a human user would respond with a predictable response and/or response pattern, such as a pause followed by a clarifying question (e.g., 'What do you mean?', 'Excuse me?' etc.)."

Apple says that an automated system "may have difficulty interpreting such an interrogatory.: It might respond with a "pre-configured default recording, such as 'Hi, this is Senator Smith.'"

The patent does not say that the moment Siri hears the word "senator" it ascribes a low trust setting to the caller, but it could.

Let Siri be your virtual assistant and talk to a restaurant's Siri to arrange a booking.
Let Siri be your virtual assistant and talk to a restaurant's Siri to arrange a booking.

Real-world applications

Of course, Siri is an automated system so while the patent does not specifically detail this, the technology proposed has to be capable of placing calls, too.

The diagrams in Apple's patent include the booking of a restaurant table. It's not too big a step to imagine being able to say, "Hey, Siri, book me a table for two at the nearest pizza place sometime Tuesday evening."

Assuming your Siri gets by the pizza place's Siri, the restaurant could offer a reservation for 7pm and have it accepted on your behalf.

Really, though, the concept is to integrate Siri into everything you do, everywhere that it can be of use. So that issues such as being on a phone call are no longer enough to silence Siri's ability to do work for you.

The patent is credited to five inventors, including Marcel Van Os, who has previously worked on smart rings.

Read on AppleInsider

Comments

  • Reply 1 of 13
    DAalsethDAalseth Posts: 2,836member
    A lot of mixed feelings on this. 
    I hate talking on the phone so I like the option of having Siri deal with all that. Of course my current option of, “people I like know to text me, the rest can **** off” works too. But that’s another story. 
    However given how “well” chat-bots seem to work in the real world, I’m not sure my expectations would be too high. Though the idea of Siri matching wits with an automated chat-bot robo-caller might be amusing. 

    Oh and the opposite of Monday? I’d probably say something like oatmeal, and confuse all the systems. 
    cornchipbaconstangwatto_cobra
  • Reply 2 of 13
    I wonder if apple could license or just outright buy Watson from IBM. That would make Siri infinitely better. 
    entropys
  • Reply 3 of 13
    hexclockhexclock Posts: 1,273member
    Siri can field all those calls I get about Camp Lejeune. 
    watto_cobra
  • Reply 4 of 13
    ajmasajmas Posts: 601member
    I’d just be happy for Siri to be improved for the local user. The number of times Siri has had worse responses than Alexa or Google’s assistant seems to be growing. It really feels like Apple has not been putting much development effort into Siri recently. 

    My last experience, being in winter where I am:

    Me: “Hey Siri, how many centimetres of snow is forecast tomorrow?”
    Siri: “Yes it will snow”
    Me: “Argh, I’ll look it up myself”
    (I had tried several times by that point, even trying to do an American accent for it)

    Heck, they don’t even seem to have expanded on the humour or Easter eggs. 


    edited February 2023
  • Reply 5 of 13
    cornchipcornchip Posts: 1,953member
    Voicemail 2.0. 

    Best use of AI I’ve seen so far.
  • Reply 6 of 13
    ajmas said:
    I’d just be happy for Siri to be improved for the local user. The number of times Siri has had worse responses than Alexa or Google’s assistant seems to be growing. It really feels like Apple has not been putting much development effort into Siri recently. 

    My last experience, being in winter where I am:

    Me: “Hey Siri, how many centimetres of snow is forecast tomorrow?”
    Siri: “Yes it will snow”
    Me: “Argh, I’ll look it up myself”
    (I had tried several times by that point, even trying to do an American accent for it)

    Heck, they don’t even seem to have expanded on the humour or Easter eggs. 


    Even with an American accent, you still pronounced “inches” wrong. 😏
  • Reply 7 of 13
    I’m not sure how patentable much of this really is.  It sounds an awful lot like Siri, but while on a phone call, or naming a voice response unit Siri. 
  • Reply 8 of 13
    JapheyJaphey Posts: 1,770member
    Before they get to all this…can they maybe teach Siri how to read a box score? If it can’t even recognize a sports notification and alter its delivery to eliminate abbreviations, I have serious doubts about its ability to conduct my personal business. If you know what I’m talking about, I’m sure you’ll agree on how awful that experience is. And it’s just one of many. 
    baconstang
  • Reply 9 of 13
    entropysentropys Posts: 4,213member
    sir has enough trouble understanding my own Australian dialect. How on earth would I trust it to be a stand in for my communications?
  • Reply 11 of 13
    Google came up with this tech about 5 years ago. It sounds really cool. I’m glad Apple finally decided to play catch-up. 

    ctt_zh
  • Reply 12 of 13
    It's hard enough getting people to leave a VM message.  
    Few would have the patience, or luck, to have a useful exchange with Siri.
  • Reply 13 of 13
    macguimacgui Posts: 2,384member
    Apple software devs sitting around a breakroom table: What say we work on fixing some of the customer complaints plaguing Siri?"

    Several other engineers: "Nah that's a lot like work. Where would we even start? What say we create a lot of new functions Siri also won't be good at?"

    High 5s all around the table.
    logic2.6elijahg
Sign In or Register to comment.