As anticipated back in August, Google Home is set to welcome Gemini, with features debuting such as the innovative “AI Camera Search” and the helpful “Help Me Create.”
Powered by advanced Gemini technology, AI Camera Search will equip your Nest Cams with the ability to comprehend ongoing activities better. This enhancement will allow video clips stored in Google Home to include detailed “AI descriptions,” facilitating an easier process for users when searching through and reviewing their recorded footage. Users will be able to locate these descriptions conveniently in the Activity tab.
Examples of these upgraded descriptions include:
- …instead of the generic label ‘animal or activity detected,’ users might receive a more specific AI-generated description like ‘the dog is digging in the garden.’
- …for further clarity, users may get targeted insights such as ‘Person leaving parcel on porch’ or ‘Car parking.’
This revolutionary feature will also enable users to query their camera history using natural, conversational questions like:
- Did the dog go outside today?
- Was the rubbish taken to the street yesterday?
- Did the USPS truck stop by yet today?
- Was a delivery truck here today?
- Did the kids play in the backyard this afternoon?
A new search field, designed specifically for this function, will appear prominently at the top of the Activity tab once the feature becomes available.
Initially, the Gemini-powered AI Camera Search will be accessible only to select Nest Aware Plus users who communicate in US English and are participants in the Google Home Public Preview.
This feature will only function with Nest cameras that have been configured in the Google Home app, specifically devices launched in 2021 or later, as well as legacy cameras that have transitioned to the Home app.
In the top-right corner of the Google Home app for Android and iOS, users can find the Public Preview page featuring an on/off toggle labeled “Experimental AI features.” This rollout is commencing this week.
The toggle button will appear greyed out for users without a Nest Aware Plus subscription or if the feature isn’t available for their account just yet.
Another exciting feature set to arrive soon is “Help Me Create” within the Google Home app. Users will have the ability to articulate their needs, and Google will generate automated solutions accordingly:
Security:
- Remember to lock up at night
- Make it seem like someone’s home
Health and Wellness:
- Help me sleep better
- Set up morning workouts
Convenience at Home:
Getting Things Done:
- Remind me to take out the trash
- Help me remember to pick up packages
This new functionality will be gradually released to a select group of Nest Aware Plus subscribers as part of the Public Preview later this year, initially on the Home app for Android users, focusing on English and US regions.
FTC: We use income earning auto affiliate links. More.
**Interview with Sarah Thompson, Google Home Product Manager**
*Interviewer: Good afternoon, Sarah! Thanks for joining us today to talk about the exciting new features being introduced with Gemini. Can you start by giving us an overview of what Gemini is bringing to Google Home?*
**Sarah Thompson:** Absolutely, thanks for having me! Gemini is our latest technology designed to enhance user experience in Google Home. With features like ”AI Camera Search” and “Help Me Create,” we’re aiming to make smart home management more intuitive and user-friendly. These innovations are going to significantly improve how users can interact with their Nest Cams and access recorded footage.
*Interviewer: The “AI Camera Search” feature sounds revolutionary. Can you explain how it will change the way users interact with their Nest Cams?*
**Sarah Thompson:** Definitely! The AI Camera Search powered by Gemini will allow our Nest Cams to understand and describe ongoing activities in much more detail. Instead of vague labels such as “animal detected,” users will receive precise descriptions, like “the dog is digging in the garden.” This means when users go through their camera history, they can find relevant clips much quicker and easier.
*Interviewer: That’s impressive! I understand that users will be able to ask questions in natural language. Can you provide a few examples?*
**Sarah Thompson:** Sure! Users will be able to ask things like, “Did the dog go outside today?” or “Was the delivery truck here today?” This conversational querying capability is designed to make retrieving specific footage feel more like a natural conversation rather than a mechanical search process.
*Interviewer: It’s great to see technology making our lives easier. Is there any particular user group that will initially have access to these features?*
**Sarah Thompson:** Yes, for the initial rollout, the Gemini-powered AI Camera Search will be available exclusively to select Nest Aware Plus users in the US who participate in the Google Home Public Preview. It’s a way for us to test the feature and gather feedback before a broader launch.
*Interviewer: Can you share a bit about the compatibility requirements for this feature?*
**Sarah Thompson:** Absolutely. To use AI Camera Search, users will need Nest cameras that are properly set up in the Google Home app, specifically those launched in 2021 or later. Older models may also work if they’ve transitioned to the new Google Home setup, but it will depend on certain specifications.
*Interviewer: Thank you, Sarah, for sharing these insights! It’s exciting to see how Google Home continues to innovate and enhance the smart home experience. We look forward to the rollout of Gemini!*
**Sarah Thompson:** Thank you for having me! We’re very excited about these advancements and can’t wait for users to try them out.
