Skip to main content

Gboard will integrate with ‘Pixel Sense’ and offer voice ‘Smart Edits’

Last week, a “Magic Cue” capability for the Pixel 10 leaked, and Gboard today revealed upcoming “Pixel Sense” integration.

About APK Insight: In this “APK Insight” post, we’ve decompiled the latest version of an application that Google uploaded to the Play Store. When we decompile these files (called APKs, in the case of Android apps), we’re able to see various lines of code within that hint at possible future features. Keep in mind that Google may or may not ever ship these features, and our interpretation of what they are may be imperfect. We’ll try to enable those that are closer to being finished, however, to show you how they’ll look in case that they do ship. With that in mind, read on.


Pixel Sense

The latest Gboard beta (version 15.5) features strings about how you can “Finish tasks faster with Pixel Sense.” 

[Pixel Sense] brings your info to you, with no need to search

A previous Pixel 10 leak referred to the predictive suggestions capability as “Pixel Sense,” with Google seemingly renaming it to Magic Cue. Whatever the name, this feature can surface answers on your screen by looking at Gmail, Calendar, Keep, Tasks, Contacts, Messages, and Screenshots. The example Google offered was a friend asking for your flight number in a chat and Magic Cue finding it from Gmail for quick sharing.

Advertisement - scroll for more content

With last week’s leak, it was unclear what the interface for this will be. Today’s mentions in Gboard suggest that it will appear in the suggestions row for a quick paste. This is exactly like the Pixel Screenshots “recall” integration introduced in December. 

If you take a screenshot that includes a movie, song/album, or product, Pixel Screenshots will remember that information when you open an app where that information will be useful.

If somebody messaged me a Now Playing screen (e.g. “check this out”) and I saved it to Pixel Screenshots, opening YouTube Music or Spotify gives me a Gboard autofill suggestion for the name of that song.

Smart Edit

Gboard is also working on a feature that lets you make voice edits: “SmartEdit helps you add, remove, or replace words easily with just your voice.” 

“To apply your edits, your editing commands and text that\u2019s edited will be sent to Google and temporarily processed. No audio or voice data is sent.\n\nYour use of the SmartEdit feature in Gboard is subject to the “Generative AI Terms of Service”. To learn how your data is handled, visit the\n”Google Privacy Policy.

This looks to go further than what you can do with the current Assistant voice typing capability. 

FTC: We use income earning auto affiliate links. More.

You’re reading 9to5Google — experts who break news about Google and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Google on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

Comments

Author

Avatar for Abner Li Abner Li

Editor-in-chief. Interested in the minutiae of Google and Alphabet. Tips/talk: [email protected]