Abstract: A method for conserving resources in a distributed system includes receiving an event-criteria list from a resource controller. The event-criteria list includes one or more events watched by the resource controller and the resource controller controls at least one target resource and is configured to respond to events from the event-criteria list that occur. The method also includes determining whether the resource controller is idle. When the resource controller is idle, the method includes terminating the resource controller, determining whether any event from the event-criteria list occurs after terminating the resource controller, and, when at least one event from the event-criteria list occurs after terminating the resource controller, recreating the resource controller.

Abstract: Systems and Methods disclosed herein relate to providing a message to an application programming interface (API). The message includes a request for data from a data model, a submission of data to the data model, or both; and a host selection between: a representational state transfer (REST) host and a subscription-based application programming interface (API) host, wherein the REST host receives REST-based messages and the subscription-based API host receives messages in accordance with a standard of the subscription-based API host; wherein the request for data, the submission of data, or both are configured to create, delete, modify, or any combination thereof data related to a smart-device environment structure, a thermostat, a hazard detector, or any combination thereof stored in a data model accessible by the API.

Abstract: This document describes systems, methods, devices, and other techniques for determining media items to insert in a media stream. A first media client can play a primary media stream that is multicast to various media clients including the first media client and other media clients. The first media client identifies a start of a primary programming timeslot in the primary media stream, and in response, obtains and stores a secondary media item. After storing the secondary media item at the first media client, the first media client detects an insertion signal in the primary media stream that indicates a secondary programming timeslot is about to begin in the primary media stream. The first media client can then play the secondary media item in place of the primary media stream during the secondary programming timeslot.

Abstract: Various aspects of the subject technology relate to systems, methods, and machine-readable media for sharing content with a nearby device. A system is configured receive, from a sending device, a request to share content, wherein the request comprises location information associated with a location of the sending device and content characteristics, determine, based on the location information and the content characteristics, that one or more receiving devices are within a proximity threshold of the location of the sending device and are capable of loading content associated with the content characteristics, receive, from the sending device, a selection of a receiving device from the one or more receiving devices and content to be shared, and provide the content to be shared to the selected receiving device.

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session.

Abstract: Methods, systems, and media for presenting media content items belonging to a media content group are provided.

Abstract: The various implementations described herein include methods, devices, and systems for clarifying media content. In one aspect, a method is performed at a client device that includes a microphone, memory, and one or more processors. The method includes: (1) receiving, via the microphone, audio content of a media content item playing on a second client device in proximity to the client device; (2) receiving, via the microphone, a verbal query from a user of the client device to clarify a portion of the media content item; (3) sending a request to a remote server system; (4) receiving from the remote server system information responsive to the verbal user query for the portion of the media content item; and (5) presenting the information to the user.

Abstract: An image block is coded using entropy-inspired directional filtering. During encoding, intensity differences are determined for at least some pixels of an image block based on neighboring pixels of respective ones of the at least some pixels. Angles are estimated for each of those pixels based on the intensity differences. A main filtering direction of the image block is then determined based on the estimated angles. The image block is filtered according to the main filtering direction to remove artifacts along oblique edges associated with the image block. The filtered image block is then encoded to an encoded image. During decoding, an angular map indicating angles estimated for pixels of an encoded image block is received and used to determine the main filtering direction of the image block. The image block can then be filtered according to the main filtering direction and then output for display or storage.

Abstract: An alert peripheral device that provides sensory notification to a user of the device includes: a power subsystem; a communication mechanism by which notification signals is received from a first user equipment (UE) that generates and transmits the notification signals in response to detection of specific events at the first UE; and a response notification mechanism that provides a sensory response of the peripheral device following receipt of a notification of a detected event (NDE) signal. The device further includes an embedded controller coupled to each of the other components and which includes firmware that when executed on the embedded controller configures the embedded controller to: establish a communication link between the communication mechanism and the first UE; and in response to detecting a receipt of the NDE signal from the first UE, trigger the response notification mechanism to exhibit the sensory response.

Abstract: A system is provided for use with a video input signal and a video unit. The video input signal can be one of a two dimensional video signal and a three dimensional video signal. The video unit can display a three dimensional video and a two dimensional video. The system includes a receiver portion, a processing portion, a switching portion and an output portion. The receiver portion can receive the video input signal. The processing portion can output a first signal in a first mode of operation and can output a second signal in a second mode of operation, wherein the first signal is based on the video input signal and the second signal is based on the video input signal. The switching portion can switch the processing portion from the first mode of operation to the second mode of operation.

Abstract: An electronic device can include a first image sensor configured to capture a first image of a field of view and a second image sensor configured to capture a second image of the field of view. The electronic device can include a color filter adjacent to the second image sensor such that the field of view is viewable by the second image sensor through the color filter. The first image can have a first pixel resolution. The second image can have a second pixel resolution. The electronic device can include a controller configured to determine a third image based on luminance content of the first image and color content of the second image. The third image can have a third pixel resolution indicative of a spatial resolution of the first image and a spectral resolution of the second image.

Abstract: Techniques of displaying a virtual environment in a HMD involve generating a lighting scheme within a virtual environment configured to reveal a real object in a room in the virtual environment in response to a distance between a user in the room and the real object decreasing while the user is immersed in the virtual environment. Such a lighting scheme protects a user from injury resulting from collision with real objects in a room while immersed in a virtual environment.

Abstract: Methods, systems, and apparatus, including a housing defining a top surface, a bottom surface, and first and second side surfaces. Also included is a first rail extending from the first side surface and a second rail extending from the second surface such that when the first and second rails are slidably engaged with a third surface. A blower device is included that is axially disposed between the top and bottom surface, wherein a first end of the housing defines a first plenum outlet, the top surface defines a plenum inlet, the bottom surface defines a second plenum outlet that is positioned on a second side of the blower device and that fluidly couples the first plenum chamber to the second plenum chamber. Further, the second plenum chamber is formed by the first and second rails, the bottom surface and the third surface has a third plenum outlet.

Abstract: An apparatus is described that include a line buffer unit composed of a plurality of a line buffer interface units. Each line buffer interface unit is to handle one or more requests by a respective producer to store a respective line group in a memory and handle one or more requests by a respective consumer to fetch and provide the respective line group from memory. The line buffer unit has programmable storage space whose information establishes line group size so that different line group sizes for different image sizes are storable in memory.

Abstract: A parallel convolutional neural network is provided. The CNN is implemented by a plurality of convolutional neural networks each on a respective processing node. Each CNN has a plurality of layers. A subset of the layers are interconnected between processing nodes such that activations are fed forward across nodes. The remaining subset is not so interconnected.

Abstract: In one aspect, a method and system are described for receiving input for a virtual user in a virtual environment. The input may be based on a plurality of movements performed by a user accessing the virtual environment. Based on the plurality of movements, the method and system can include detecting that at least one portion of the virtual user is within a threshold distance of a collision zone, the collision zone being associated with at least one virtual object. The method and system can also include selecting a collision mode for the virtual user based on the at least one portion and the at least one virtual object and dynamically modifying the virtual user based on the selected collision mode.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media for performing multi-task learning. In one method a system obtains a respective set of training data for each of multiple machine learning tasks. For each of the machine learning tasks, the system configures a respective teacher machine learning model to perform the machine learning task by training the teacher machine learning model on the training data. The system trains a single student machine learning model to perform the multiple machine learning tasks using (i) the configured teacher machine learning models, and (ii) the obtained training data.

Abstract: A method includes a processor of an electronic device receiving first input signals from a first sensor in response to user contact at a first edge of the device and second input signals from a second sensor in response to user contact at a second edge of the electronic device. The first and second sensors are covered by a housing of the device. The processor determines an external context of the device based on analysis of the first input signals and the second input signals. The determined external context indicates at least a position of the device relative to a user or an orientation of the device relative to a user. Responsive to determining the external context, the electronic device executes a particular user input action.

Abstract: Systems and techniques are provided for restricted accounts on a mobile platform. A request to create a restricted account may be received. The restricted account may be a user account with a restriction. Credentials for the restricted account may be received. A restriction for the restricted account may be received. The restriction may include an access restriction or a lifetime restriction. An access restriction may prevent an application from accessing the restricted account and a lifetime restriction may limit the lifetime of the restricted account. The restricted account may be stored with the credentials and the restriction. A request may be received for a list of user accounts from an application. The restricted account may be determined to include an access restriction that prevents the application from accessing the restricted account. The list of user accounts may be sent to the application and without an identifier for the restricted account.

Abstract: Methods and systems for learning long-term dependencies in recurrent neural networks. In one aspect, a neural network system is configured to receive a respective input for each of a plurality of time steps and to generate a respective output for each time step, the neural network system comprising one or more recurrent neural network layers, wherein, for each of the time steps, each of the recurrent neural network layers is configured to receive a layer input for the time step; apply an input weight matrix to the layer input to generate a first output; apply a recurrent weight matrix to a hidden state of the recurrent neural network layer for the time step to generate a second output; combine the first and second outputs to generate a combined output; and apply a rectified linear unit activation function to the combined output to generate a layer output for the time step.

Abstract: Systems and methods using one or more processors of a user electronic device for receiving user interactions and sending data related to those user interactions to another device. This may include receiving input comprising an interaction with the user device, identifying an application installed on the user device to which the interaction is directed to, and sending data over a network comprising an indication of a model of the user device, an identifier of the application, and an indication of the interaction. Sending the data may initiate one of a video playback, a tutorial, a demonstration, or a simulation, based on the data, on a device different than the user device. In some arrangements, the interaction is directed to a process running on the user device instead of an application.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resolving ambiguity in received voice queries. An original voice query is received following one or more earlier voice queries, wherein the original voice query includes a pronoun or phrase. In one implementation, a plurality of acoustic parameters is identified for one or more words in the original voice query. A concept represented by the pronoun is identified based on the plurality of acoustic parameters, wherein the concept is associated with a particular query of the one or more earlier queries. The concept is associated with the pronoun. Alternatively, a concept may be associated with a phrase by using grammatical analysis of the query to relate the phrase to a concept derived from a prior query.

Abstract: In one general aspect, a method can include triggering display of a virtual environment in a head mounted display (HMD) device operating in a physical environment, triggering display of a first virtual object representing a second virtual object, the first virtual object having a size smaller than a size of the second virtual object, receiving an indication of an interaction of a user with the first virtual object, the user having a first size larger than the size of the first virtual object, and triggering an interaction with the second virtual object in response to an interaction with the first virtual object, the user having a second size larger than the first size when interacting with the second virtual object.

Abstract: Methods and apparatus related to identifying a query template that includes one or more terms and a member of an entity category and ranking the query template. Query suggestions may be determined based on the query template. The ranking of the query template may be utilized to determine if the query template is a valid query template. The ranking of the template may be based on at least a count of occurrences of one or more of the entities of the entity category in past queries that conform to the query template.

Abstract: Methods, apparatus, systems, and computer-readable media are provided for interactive assistant modules to safely access and provide restricted content in group contexts. In various implementations, a dialog between a first individual and an interactive assistant module may be determined to be sensorially perceivable by at least a second individual. Restricted content that is to be automatically incorporated into the dialog by the interactive assistant module may be identified. In various implementations, access to the restricted content may be controlled by the first individual. In various implementations, the restricted content may be conditionally incorporated into the dialog in response to a determination that the second individual is authorized to perceive the restricted content.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training an object representation neural network. One of the methods includes obtaining training sets of images, each training set comprising: (i) a before image of a before scene of the environment, (ii) an after image of an after scene of the environment after the robot has removed a particular object, and (iii) an object image of the particular object, and training the object representation neural network on the batch of training data, comprising determining an update to the object representation parameters that encourages the vector embedding of the particular object in each training set to be closer to a difference between (i) the vector embedding of the after scene in the training set and (ii) the vector embedding of the before scene in the training set.

Abstract: Methods, systems, and media for presenting recommended content based on social cues are provided. In accordance with some embodiments, a method for presenting recommended content is provided comprising: receiving a query associated with a user; generating a list of relevant media content items based on the query; selecting items for presentation to the user based on social relevance scores based on social connections of the user that have consumed a relevant item and contextual relevance scores for each item; causing the selected items to be presented to the user; and indicating that a particular item was consumed by a particular social connection.

Abstract: Methods, systems, and apparatus for a matrix multiply unit implemented as a systolic array of cells are disclosed. The matrix multiply unit may include cells arranged in columns of the systolic array. Two chains of weight shift registers per column of the systolic array are in the matrix multiply unit. Each weight shift register is connected to only one chain and each cell is connected to only one weight shift register. A weight matrix register per cell is configured to store a weight input received from a weight shift register. A multiply unit is coupled to the weight matrix register and configured to multiply the weight input of the weight matrix register with a vector data input in order to obtain a multiplication result.

Abstract: A text query from a user may be received. Playlists associated with the text query may be identified. A relevance score may be calculated for each of the playlists based at least in part on a relevance of the corresponding playlist to the text query. Furthermore, content items may be identified where each of the content items is included in at least one of the playlists. For each of the identified content items, one or more playlists that includes the corresponding content item may be identified. A score for each of the content items may be calculated based on the relevance score for each of the playlists that includes the corresponding content item. Furthermore, a new playlist may be generated for the user based on the scores for each of the content items.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for providing app store search results. An example method includes responsive to a first search query directed to an app store: revising the first search query to produce a second search query different from the first search query; obtaining, from an Internet search engine, second search results responsive to the second search query; analyzing the second search results to identify apps available on the app store that are relevant to the second search query; obtaining, from the app store, first search results responsive to the first search query that identify apps available in the app store; and modifying the first search results based on analyzing the second search results.

Abstract: A database server receives a request from a client application for performing a data transaction on persistent data storage. The request is sent to a set of replication servers. An acknowledgement for the request is received from each replication server, including a start sequence number and an end sequence number for data that is stored in local cache of the replication server, and a latest committed sequence number for data that was written to the persistent data storage by the replication server. A maximum value of latest committed sequence numbers received from the set of replication servers is determined. For each replication server, it is examined whether there is a gap between the start sequence number for data stored in local cache and the maximum value of the latest committed sequence numbers. Based on the examining, it is determined whether there is an occurrence of loss of data.

Abstract: Embodiments of the disclosed innovations provide systems and methods for locating data associated with rendered documents. Some embodiments support the use of a handheld document data capture device.

Abstract: Systems and methods for determining vehicle crowdedness are provided. A method can include obtaining, by a computing system, real-time location data including information identifying a real-time location corresponding to a transit station for each of a plurality of user computing devices; determining, by the computing system using a vehicle crowdedness model, a vehicle crowdedness for one or more transit vehicles departing from one or more transit stations based at least in part on the real-time location data; and communicating, by the computing system, data indicative of the vehicle crowdedness for the one or more transit vehicles to a particular user computing device. The data indicative of the vehicle crowdedness can include information for displaying the vehicle crowdedness for the one or more transit vehicles on the particular user computing device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining a clustering of images into a plurality of semantic categories. In one aspect, a method comprises: training a categorization neural network, comprising, at each of a plurality of iterations: processing an image depicting an object using the categorization neural network to generate (i) a current prediction for whether the image depicts an object or a background region, and (ii) a current embedding of the image; determining a plurality of current cluster centers based on the current values of the categorization neural network parameters, wherein each cluster center represents a respective semantic category; and determining a gradient of an objective function that includes a classification loss and a clustering loss, wherein the clustering loss depends on a similarity between the current embedding of the image and the current cluster centers.

Abstract: A computer-implemented method can include identifying a first set of text samples that include a particular potentially offensive term. Labels can be obtained for the first set of text samples that indicate whether the particular potentially offensive term is used in an offensive manner. A classifier can be trained based at least on the first set of text samples and the labels, the classifier being configured to use one or more signals associated with a text sample to generate a label that indicates whether a potentially offensive term in the text sample is used in an offensive manner in the text sample. The method can further include providing, to the classifier, a first text sample that includes the particular potentially offensive term, and in response, obtaining, from the classifier, a label that indicates whether the particular potentially offensive term is used in an offensive manner in the first text sample.