Google adds ‘near me’ to multisearch, drops hotword from voice assistant
At the Google I/O conference, the tech giant announced a new addition to its ‘multisearch’ feature introduced last April. The feature allows users to search using both text and images. Prabhakar Raghavan, senior vice president at Google Search, said users can soon add ‘Near me’ to a picture or screenshot containing the product they are looking for, and Google will direct them to the nearest place where they can find it. Multisearch will be available later this year in English and will expand to other languages over time. Source: Google Scene exploration is another key component of multisearch feature, enabling users to pan their phone camera and learn about multiple objects within the scene. For example, Raghavan said, the feature could be used to scan through a section with all kinds of chocolates and narrow down the search to look for a specific type of nut-free chocolate. We recently launched multisearch in the Google app, which lets you search by taking a photo and asking a question at the same time. Later this year, you'll be able to take a picture or screenshot and add "near me" to get local results. #GoogleIO pic.twitter.com/F2kl0m9nYt— Google (@Google) May 11, 2022 “Scene exploration uses computer vision to instantly connect multiple threads that make up the scene and identify all the objects within it simultaneously. It taps into the richness of the web and Google’s Knowledge Graph to surface the most helpful results,” he said. According to Raghavan, scene exploration will be a breakthrough in helping our devices see the world as we do. “Looking further out, this technology could be used beyond everyday needs to help address societal challenges, like supporting conservationists in identifying plant species that need protection or helping disaster relief workers quickly sort through donations in times of need,” he added. #NLP is transforming #GoogleSearch – @Google’s most important product #MultiSearch #nearmeJust take a picture and find anything near you! #MachineLearning at #GoogleIO #GoogleIO2022 pic.twitter.com/07tkq78fpZ— Anna Nerezova (@blv) May 11, 2022 Look and talk “Computers should be adapting to people, and not the other way around” said Sundar Pichai. Google is pushing to make computing more natural and intuitive with the google assistant. Sissie Hsiao, vice president at google assistant announced a fresh update called ‘Look and Talk.’ The feature will allow users to simply look at the display and ask a question without having to preface it with a hotword like ‘Hey Google’. The feature will be available first on nest hub max in the US. Saying #HeyGoogle or worrying about the "right" way to ask something can feel unnatural. That's why we’re improving how Assistant understands you, letting you speak more naturally — like how you’d talk to a friend. Learn more ↓ #GoogleIO https://t.co/YviVJIxhYq— Google (@Google) May 11, 2022 Hsiao said the company’s quick phrases feature will also be available to nest hub max to help users make common requests with ease. Quick phrases are a set of commands like setting the alarm, asking time and temperature, dimming the lights etc. 6/ Conversational AI currently needs a keyword to trigger, but Google fused 5 ML models to detect eye contact – Head Orientation, Proximity, Gaze Direction, Lip Movement, & Contextual Awareness.More movements towards contextually-aware AI that detects body language. #GoogleIO pic.twitter.com/Vyd5hLe3mu— Kent Bye (Voices of VR) (@kentbye) May 11, 2022 Google’s voice assistant will also be able to speak more naturally and understand a natural manner of speech which usually includes pauses or umms in the middle. The assistant will now be able to determine the context of the words and offer a prompt in case the user cannot remember the word. https://twitter.com/WesleyKambale/status/1524445100281147392?s=20&t=y8J8v0wlcy5g4BLbJ7dVHQ
Scene exploration taps into the richness of the web and Google’s Knowledge Graph to surface the most helpful results.
Scene exploration taps into the richness of the web and Google's Knowledge Graph to surface the most helpful results.
[]
["Go", "programming_languages:R", "AI", "ML", "programming_languages:Go", "computer vision", "RAG", "NLP", "R", "ai_applications:computer vision"]
["AI", "ML", "NLP", "computer vision", "RAG", "R", "Go", "programming_languages:R", "programming_languages:Go", "ai_applications:computer vision"]
Poulomi is a Technology Journalist with Analytics India Magazine. Her fascination with tech and eagerness to dive into new areas led her to the dynamic world of AI and data analytics.