Abstract: A method for integrating third-party encryption managers with cloud services includes receiving, at data processing hardware, an operation request requesting a cryptographic operation on data comprising an encryption operation or a decryption operation. When the operation is an encryption operation, the method includes transmitting a data encryption key associated with the data to a remote entity. The remote entity encrypts the data encryption key with a key encryption key and transmits the encrypted data encryption key to the data processing hardware. When the operation is a decryption operation, the method includes transmitting the encrypted data encryption key to the remote entity which causes the remote entity to decrypt the encrypted data encryption key with the key encryption key and transmit the decrypted data encryption key and transmit to the data processing hardware.

Abstract: A method includes accessing, by a server computer, a plurality of electronic mail messages. The method also includes identifying, by the server computer, at least one of the electronic mail messages as a promoted electronic mail message. The method further includes outputting, for display at a client computing device, an electronic mail interface wherein the promoted electronic mail message is represented in a first position of a display order and a remainder of the electronic mail messages are represented subsequent to the promoted electronic mail message in the display order.

Abstract: A method for configuring and deploying execution environments for software applications includes receiving a bootstrap execution environment from a data store, the bootstrap execution environment including a software application, the software application including a manifest of dependencies. The method includes executing the bootstrap execution environment and determining whether an enhanced execution environment is available from the data store. When the enhanced execution environment is available from the data store, the method includes receiving the enhanced execution environment from the data store and enhancing the bootstrap execution environment based on the received enhanced execution environment. When the enhanced execution environment is not available from the data, the method includes enhancing the bootstrap execution environment based on the manifest of dependencies to create the enhanced execution environment and storing the enhanced execution environment in the data store.

Abstract: A selective sensor polling system for a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a template for an action data structure with a plurality of fields. The system can determine to poll a first sensor for data for the first field. The system can determine to obtain data in memory previously collected by the second sensor. The system can generate and transmit the action data structure with the data from the sensor and memory, and transmit the action data structure to a third party device.

Abstract: In some implementations, a language proficiency of a user of a client device is determined by one or more computers. The one or more computers then determines a text segment for output by a text-to-speech module based on the determined language proficiency of the user. After determining the text segment for output, the one or more computers generates audio data including a synthesized utterance of the text segment. The audio data including the synthesized utterance of the text segment is then provided to the client device for output.

Abstract: A method for detecting a hotword includes receiving a sequence of input frames that characterize streaming audio captured by a user device and generating a probability score indicating a presence of a hotword in the streaming audio using a memorized neural network. The network includes sequentially-stacked single value decomposition filter (SVDF) layers and each SVDF layer includes at least one neuron. Each neuron includes a respective memory component, a first stage configured to perform filtering on audio features of each input frame individually and output to the memory component, and a second stage configured to perform filtering on all the filtered audio features residing in the respective memory component. The method also includes determining whether the probability score satisfies a hotword detection threshold and initiating a wake-up process on the user device for processing additional terms.

Abstract: A method for a hybrid content protection architecture includes obtaining, by data processing hardware, a client-side cryptographic key and locally encrypting user content using the client-side cryptographic key. The method also includes communicating the client-side cryptographic key to a third party key manager, the third party key manager configured to store the client-side cryptographic key. In response to the third party key manager storing the client-side cryptographic key, the method includes receiving a token from the third party key manager, the token identifying the client-side cryptographic key stored at the third party key manager. The method further includes uploading the encrypted user content and the token to a server of a cloud computing platform.

Abstract: A server may receive a request from a creator of a message to share one or more rights of the creator of the message with a user referenced in the message. In response to the request, the server may send a notification to the user referenced in the message. The notification includes an option to accept the one or more rights. The server may receive, from a user device of the user, an acceptance of the one or more rights and perform an operation related to the message based on the rights accepted by the user.

Abstract: A method for training an endpointer model includes short-form speech utterances and long-form speech utterances. The method also includes providing a short-form speech utterance as input to a shared neural network, the shared neural network configured to learn shared hidden representations suitable for both voice activity detection (VAD) and end-of-query (EOQ) detection. The method also includes generating, using a VAD classifier, a sequence of predicted VAD labels and determining a VAD loss by comparing the sequence of predicted VAD labels to a corresponding sequence of reference VAD labels. The method also includes, generating, using an EOQ classifier, a sequence of predicted EOQ labels and determining an EOQ loss by comparing the sequence of predicted EOQ labels to a corresponding sequence of reference EOQ labels. The method also includes training, using a cross-entropy criterion, the endpointer model based on the VAD loss and the EOQ loss.

Abstract: Systems, devices, and methods for eyebox expansion in wearable heads-up displays (WHUD) are described. A WHUD includes a support structure, a scanning laser projector (SLP), a split mirror, an optical splitter, and a holographic combiner. When the WHUD is worn on the head of a user the holographic combiner is positioned in a field of view of the user. The SLP scans light signals onto the split mirror which reflects the light signals onto the optical splitter. The optical splitter redirects the light signals towards the holographic combiner such that subsets of the light signals originate from spatially-separated virtual positions. The holographic combiner redirects the light to the eye resulting in spatially-separated exit pupils. The spatial separation of the exit pupils results in an expanded eyebox. The indirect path of light from SLP to optical splitter enables a smaller and therefore more aesthetically desirable design for the WHUD.

Abstract: A system includes an electronic display for emitting light toward an eye-ward side of the system. A beam splitter receives emitted light from the display. The beam splitter includes a polarization beam splitting (PBS) film and a mirror coating to generate two orthogonal polarization states with different optical paths thereby creating a first focal plane and a second focal plane at the eye-ward side of the system. At least one liquid crystal switch is positioned to receive light from the display in a light path between the display and the eye-ward side of the system.

Abstract: Systems, devices, and methods for aperture-free hologram recording are described. The apertures typically used for hologram recording create unwanted secondary holograms by diffracting light. Aperture-free hologram recording eliminates these unwanted secondary holograms. Aperture-free hologram recording includes applying a mask to the holographic recording medium. The mask controls the size of the recorded hologram like an aperture but does not create unwanted secondary holograms. Hologram fringes are only present in the desired recording area and a thin boundary region. The mask may be present during recording, or the mask may be used to pre-bleach the holographic recording medium. Pre-bleaching the holographic recording medium renders a portion of the holographic recording medium insensitive to light, the hologram is recorded in the light-sensitive portions of the holographic recording medium.

Abstract: Systems, devices, and methods for aperture-free hologram recording are described. The apertures typically used for hologram recording create unwanted secondary holograms by diffracting light. Aperture-free hologram recording eliminates these unwanted secondary holograms. Aperture-free hologram recording includes applying a mask to the holographic recording medium. The mask controls the size of the recorded hologram like an aperture but does not create unwanted secondary holograms. Hologram fringes are only present in the desired recording area and a thin boundary region. The mask may be present during recording, or the mask may be used to pre-bleach the holographic recording medium. Pre-bleaching the holographic recording medium renders a portion of the holographic recording medium insensitive to light, the hologram is recorded in the light-sensitive portions of the holographic recording medium.

Abstract: Methods, systems, and apparatus, for receiving a native application search result that identifies a native application and a first URI that causes the native application to display a native application page that includes content responsive to the query; determining, at the user device, whether the user device has a native application installed that can process the first uniform resource identifier (URI) of the native application search result; in response to determining that the user device does not have a native application installed that can process the first URI, processing, at the user device, a second URI that can be processed by the first application, where the second URI, when processed, causes the first application to display a first application page that includes content responsive to the query; wherein the content included in the first application page and the content included in the native application page are synchronized content.