After a recent update, you no longer need to use Google or Google
commands to interact with your Google Nest hub Max.
Now, using a combination of hardware and software,
your hub Max will already know who is talking to and customize
the experience accordingly just by looking at the device
There are a number of cool
announcements and teases during this year's Google IO Developer Conference.
However, one really fascinating update that piqued my interest in particular
was called Look and Talk
during the segment, talking about updates to Google Assistant, the VP and GM of
Google Assistant revealed that you can now simply look and start talking to the hub
max without any need to use the trigger phrase Google or Google
or heavy Google ecosystem using family with multiple Google homes,
pixel, six phones and third party integrations into Google
Assistant to help manage and control our daily lives.
I own a smaller Google Nest hub, however, after discovering the new feature
I decided to purchase a hub max myself to test out, look and talk.
One of my biggest bugbears is that you have to use the OK
Hey Trigger phrase to start an interaction with Google Assistant
It always felt a little inconvenient and unnatural to have to use a trigger
phrase in certain situations or as part of a string of inquiries.
I'm well aware of the technological limitations but
necessitate the user experience, but it was still quite jarring.
The reason for needing
trigger phrases is that there's no way for your smart devices to be listening
and processing audio in the vicinity for 24 hours a day and accurately pass out
everyday chatter or audio from your TV from actual commands.
The technical logistics just aren't available.
Despite the extremely clever engineers at Google
Google did introduce an evolution of the way you can interact
with this system with continued conversation.
It's been a nice update whereby you can continue
to interact with Google home after using the trigger phrase
once to string together contextual commands and questions.
In practice, though, it isn't always reliable
and sometimes cut out midway through a conversation.
It does its best to recognize contiguous interactions.
But if you pause too long, or if it simply thinks you're no longer
talking to it directly,
Google Assistant will fall deaf and mute this with these frustrations in mind.
That look and talk feels like it's the first step
in trying to bridge the awkward gap in functionality.
The Google Test hub, Max,
includes a lot of hardware that is key to how look and talk works.
Thanks to the high quality microphone, the camera and Google assistant A.I.
the Nest Hub, Max is able to combine them
all to provide a frictionless way to interact with your smart device.
Now, simply being within range of the hub max and facing
it is enough to alert the device that commando interaction is imminent.
Then, without
having to use a trigger phrase, you can begin talking to it as normal.
Look, until it requires that you have a number of different features turned on
that you might not already be using using your Google home app on your phone.
The Nest Hub Max must have camera sensing voice match and face matched.
Hold on.
Also, you have to have the nest cam feature turned off.
The nest cam features the ability to use your hub max like a security camera.
To monitor your home
in a very similar way to individual nest cameras that you can buy.
While this might be a hurdle for some users who rely on the feature,
there is a workaround.
If you use the home and away settings for nest cameras
using the Home and Away feature, you can have the camera turn on
to monitor your home while you're
physically away from your house based on your phone's location.
In theory, most users won't monitor their house while at home
and probably use a hub max for other reasons while at home.
One important note is the feature is only available in English at this time.
As with most Google features, I'm sure that other languages will be supported
in the near future.
Now in the Google Home app, turn on Look and Talk.
Open the Google Home App on the home screen tab settings
in the features section, tap Google Assistant and then face match.
Find the name of your hub max and then turn on look and talk
You will also need Voice Match enabled to get this far.
So some users who haven't saved their voice profiles won't be able to continue
the benefits of using Voice Match all about customizing content by user.
If you live in a household with multiple friends or family members
who also use the Google home devices.
When you set up a voice match on a shared speaker or display
it will identify the current user and tailor music services, YouTube
and personal results to that individual face
match is an extension of this personalization feature whereby it uses
the camera to further refine the way it differentiates between different people.
If you're worried about privacy, Google thought ahead and your video
is only processed on the device and isn't sent to Google's servers.
Once all the features have been in them, all four look and talk.
The camera on the hub Max will analyze the video feed.
If the A.I.
determines you're looking at the device, it will activate the assistant
to help with your interactions.
The hub Max will use visual cues at the top left hand corner,
some of which existing users will already be familiar with the four undulating dots
signify the hub.
Max is detected that you're standing within five feet and looking at the camera.
The multicolored animated lines signify the hub.
Max is detected.
You're speaking and actively listening for a question or command.
The rotating multicolored dots signify the hub.
Max is processing an input.
And then finally, the four shaking multicolored dots signify the assistant.
I couldn't find an answer to your question or command,
but is still listening for a new input.
In practice, the system has a high probability of working
but there are moments of frustration
when it seems like the hub max isn't responding.
It could just be bugs in the first rollout of this feature.
But I have a growing feeling
that the user interface and feedback experience needs some improvement.
For instance, rather than barely noticeable
shaking dots when the assistant is unable to find a response.
Sure, audible feedback would be better for comprehending
when something it hasn't worked for the end user.
Google does include a disclaimer on their support pages
explaining the technology might include errors when used.
Understandably, there will be certain scenarios
where errant results or no results will happen.
Finally, it's worth going over
when look and talk is not available on your desktop. Max.
These include where media is playing, such as music or videos
you stream a security camera or use nest hub max as a nest can
use duo meet or zoom or while gizmo design also fixed
match doesn't work with workspace at this time for professional accounts.
Ultimately, Look and talk is the first step into a truly smart
assistant, reducing the friction to using the Google Assistant A.I..
It feels like we're getting closer to normal human to human interactions
without the stilted requirement for using a keyword to start a conversation
to maximize the look and talk, experience and usability.
Careful placement at the hub max within your main
living space is key on a desk or counter where you're regularly
within the five feet range will mean more seamless interactions.
However, if you have Max is located away from your main living area or over
five feet away, you'll lose the ability to really leverage the technology
in the future.
I could see Google releasing more sophisticated home devices using
look at all the T's new pixel tablet stroke.
Google home hybrid device mentioned during Google.
IO seems to be the natural successor to the tech.
Picking up your smart screen and instantly reducing the effective range
to put the assistant on standby
should produce some very interesting and intriguing use cases
we've yet to think of outside of Google's own laboratories.
Thanks for watching and as always, please like this
video and subscribe to my channel
for more content on the connected home and personal technology.