Radar in future HomePods could ID users, monitor some health parameters
Apple devices including HomePod may get the ability to detect the nearby location of a user, act on their gestures, and determine which user it is -- plus use this information to make health assessments.
Apple is looking at including radar transceivers in many devices, such as the HomePod
A new patent application from Apple describes how future devices could employ radar to locate nearby users, or their devices. In conjunction with other tools such as voice, the radar-equipped devices could reconfigure themselves to a user's preferences. HomePod, for example, could use this to distinguish which user in a family is speaking to it, and so offer the correct Apple Music subscription.
"Electronic Device with Co-Located Independent Radar Transceivers" takes pains to describe any number of different devices that could have radar added, including iPhones, iPads, Macs, and Internet of Things devices. But it is particularly concerned with addressing a problem that occurs with voice commands, such as using Siri on HomePod.
"Accurately identifying a user of a voice user interface can be challenging," notes the patent, "which may make it more difficult to accurately customize a voice user interface to the preferences and needs of a particular user."
The overall aim is to have a system that requires "little or no advanced knowledge by a user or training for proper operation." Apple wants the user interface to tailor itself automatically "to a user's preferences and their mental model of a task."
So a device can adapt to different users and their preferences, but the device needs to be be sure which person is currently using it. With this proposed solution, the device gets at least one radar transmitter and one radar receiver. It uses these to determine what is in the vicinity of the device and where, quite precisely, everything is.
That will include other devices, so this could facilitate the ability for an iPhone, say, to locate a nearby iPad and send data to it. But it will also be looking for individuals.
"Moreover, the electronic device may identify the individual based at least in part on the radar measurements," continues the patent. "Identifying the individual can include determining a specific identity of the individual or an identifying attribute or characteristic of the individual."
Devices would intentionally limit the range they would use radar to scan for people and other objects
"[The device may detect] one or more dimensions of the environment," continues the patent. "[This may] include an acoustic property of the object in the environment or an acoustic property of the environment. For example... [it] may access a look-up table, stored in memory, with acoustic properties of different materials and/or objects as a function of radar measurements."
The majority of the patent is concerned with identifying a user and also his or her surroundings. Detecting details of the environment could help with adjusting audio playback, and it could help with the accuracy of radar measurements.
As well as determining how near or far a user is, a radar-equipped device could assess different details about that person. "Furthermore, based at least in part on the radar measurements, the electronic device may determine a vital sign and/or a medical condition of the individual," says the patent.
These health aspects could be extensive. In the patent's example uses, it lists multiple types of vital signs that a device could scan for remotely. "[For instance, it] may determine a vital sign of the individual (such as a pulse, a blood pressure, or a respiration rate of the individual) and/or a medical condition of the individual (such as a medical emergency, a disease, a physical symptom, such as a tremor, a physical condition, e.g., dementia based at least in part on a gait of the individual, etc.)."
The patent is credited to three inventors, Mikheil Tsiklauri, Jouya Jadidian, and Vaneet Pathak. Between them, their prior patents include ones on "wireless power transfer," and "Electronic devices having interconnect radiation mitigation capabilities."
Separately, a previous patent application suggests that Apple is also looking to use small and inobtrusive radar systems for its self-driving car.
Stay on top of all Apple news right from your HomePod or HomePod mini. Say, "Hey, Siri, play AppleInsider Daily," and you'll get a fast update direct from the AppleInsider team.
Apple is looking at including radar transceivers in many devices, such as the HomePod
A new patent application from Apple describes how future devices could employ radar to locate nearby users, or their devices. In conjunction with other tools such as voice, the radar-equipped devices could reconfigure themselves to a user's preferences. HomePod, for example, could use this to distinguish which user in a family is speaking to it, and so offer the correct Apple Music subscription.
"Electronic Device with Co-Located Independent Radar Transceivers" takes pains to describe any number of different devices that could have radar added, including iPhones, iPads, Macs, and Internet of Things devices. But it is particularly concerned with addressing a problem that occurs with voice commands, such as using Siri on HomePod.
"Accurately identifying a user of a voice user interface can be challenging," notes the patent, "which may make it more difficult to accurately customize a voice user interface to the preferences and needs of a particular user."
The overall aim is to have a system that requires "little or no advanced knowledge by a user or training for proper operation." Apple wants the user interface to tailor itself automatically "to a user's preferences and their mental model of a task."
So a device can adapt to different users and their preferences, but the device needs to be be sure which person is currently using it. With this proposed solution, the device gets at least one radar transmitter and one radar receiver. It uses these to determine what is in the vicinity of the device and where, quite precisely, everything is.
That will include other devices, so this could facilitate the ability for an iPhone, say, to locate a nearby iPad and send data to it. But it will also be looking for individuals.
"Moreover, the electronic device may identify the individual based at least in part on the radar measurements," continues the patent. "Identifying the individual can include determining a specific identity of the individual or an identifying attribute or characteristic of the individual."
Devices would intentionally limit the range they would use radar to scan for people and other objects
"[The device may detect] one or more dimensions of the environment," continues the patent. "[This may] include an acoustic property of the object in the environment or an acoustic property of the environment. For example... [it] may access a look-up table, stored in memory, with acoustic properties of different materials and/or objects as a function of radar measurements."
The majority of the patent is concerned with identifying a user and also his or her surroundings. Detecting details of the environment could help with adjusting audio playback, and it could help with the accuracy of radar measurements.
As well as determining how near or far a user is, a radar-equipped device could assess different details about that person. "Furthermore, based at least in part on the radar measurements, the electronic device may determine a vital sign and/or a medical condition of the individual," says the patent.
These health aspects could be extensive. In the patent's example uses, it lists multiple types of vital signs that a device could scan for remotely. "[For instance, it] may determine a vital sign of the individual (such as a pulse, a blood pressure, or a respiration rate of the individual) and/or a medical condition of the individual (such as a medical emergency, a disease, a physical symptom, such as a tremor, a physical condition, e.g., dementia based at least in part on a gait of the individual, etc.)."
The patent is credited to three inventors, Mikheil Tsiklauri, Jouya Jadidian, and Vaneet Pathak. Between them, their prior patents include ones on "wireless power transfer," and "Electronic devices having interconnect radiation mitigation capabilities."
Separately, a previous patent application suggests that Apple is also looking to use small and inobtrusive radar systems for its self-driving car.
Stay on top of all Apple news right from your HomePod or HomePod mini. Say, "Hey, Siri, play AppleInsider Daily," and you'll get a fast update direct from the AppleInsider team.
Comments
Fix Siri and add acoustic awareness and these will be killer home theatre speakers.
This week we saw Israel deploy tracking of individuals using their cell phones, and monitoring people that may have come in contact with infected. Once a government has been authorized to spy on its own people it’s difficult to backtrack. I can see Israel (etc) keeping this power to monitor those that may have come in contact with “dissidents”.
It the US there’s already been warrants issued by analyzing geolocation data...
As for the technology itself, it could be very useful in reporting emergencies. For example, if I grab my chest and fall to the ground, the smart device could ask for a response, and if not forthcoming send alerts to family, request an ambulance, etc.
Maybe when I turn 65+ the benefits will out-way the risks... but for the next 2 decades, no thanks.
It's Apple not Amazon.
Will you say “thanks Siri” in a sarcastic voice?
“You’re welcome Dave.”
Then in your second post you mention that Apple will comply with a lawful request. What lawful requests are you worried about concerning a HomePod (for example) identifying you as a user and maybe noticing health risks?
Users need to use common sense and buy plain old dumb speakers instead of paying for tech you don't want to use. Take the money saved and stockpile tinfoil hats.
I'm confused by every post in this thread except yours. I'm investing in some Reynolds stock.
It's fallen far short of my expectations, not so much what it would do when shipped, which wasn't all that much, but that Apple has failed to improve it in any measurable degree, and give it and the user some degree of improved functionality and control.
All along I've complained it doesn't have a balanced frequency response. It has too much bass, little midrange and treble. There are a lot of people who prefer that type of sound but I don't.
Apple programmed a response map for the HomePod and it's electronics strive to preserve in different rooms or changing configurations, what Apple thought was best. I'd like the ability to change that map to my preference– a sound curve that's much closer to flat.
The HomePod is the first Apple product I've owned that's been a major disappointment. Compared to decent speakers it's lacking, and Siri on it is a joke. But it looks like Apple has moved on and left the currents HomePod on the side of the road.