Abstract: A near-eye display for an augmented reality display system couples a self-emitting microdisplay to a transmissive waveguide through an input coupler. Light from the self-emitting microdisplay propagates along the waveguide and through an output coupler for generating a virtual image that is visible together with a real-world scene through the waveguide within an eyebox located in front of the output coupler. A light sensor detects light levels within different portions of the real world scene visible within the eyebox. Drive electronics control the light output from individual pixels of the self-emitting microdisplay to preserve desired local contrast values between the virtual image and the real-world scene.

Abstract: In some examples, a virtual surface presented by an artificial reality (AR) system may be a virtual drawing surface in an artificial reality environment, with which users may interact using a physical peripheral device. For example, the AR system may enable a user to draw or write on a surface of the peripheral device and may simultaneously, i.e., along with the user inputs, render virtual markings corresponding to the user inputs on a virtual drawing surface locked to the surface of the peripheral device. In some cases, the AR system enables the user to “transfer” the virtual markings rendered on the surface of the peripheral device (e.g., a virtual drawing) to another virtual drawing surface (e.g., to a planar or other surface in the artificial reality environment).

Abstract: An apparatus and method are described for a non-uniform rasterizer. For example, one embodiment of an apparatus comprises: a graphics processor to process graphics data and render images using the graphics data; and a non-uniform rasterizer within the graphics processor to determine different resolutions to be used for different regions of an image, the non-uniform rasterizer to receive a plurality of polygons to be rasterized and to responsively rasterize the polygons in accordance with the different resolutions.

Abstract: In general, the disclosure describes artificial reality (AR) systems and techniques for generating and presenting virtual surfaces within an artificial reality environment and for facilitating user interaction with the virtual surfaces using a physical peripheral device. For example, AR systems are described that generate and render virtual surfaces, such as a virtual pinboard or a virtual drawing surface (e.g., a virtual canvas) in an artificial reality environment, for display to a user. The AR systems enable the user to interact with the virtual surfaces using a physical peripheral device, which may be manipulated and otherwise interacted with by the user to provide input to an AR system through pose tracking of the peripheral device and/or via one or more input devices of the peripheral device, such as a presence-sensitive surface.

Abstract: A contextual filter system configured to perform operations that include, capturing an image frame at a client device, wherein the image frame includes a depiction of an object, identifying an object category of the object based on the depiction of the object within the image frame, accessing media content associated with the object category within a media repository, generating a presentation of the media content, and causing display of the presentation of the media content within the image frame at the client device.

Abstract: A method, a computer-readable storage medium with instructions, a device, and a system for calibrating a pair of augmented-reality glasses in a transportation vehicle and a transportation vehicle and a pair of augmented-reality glasses suitable for the method. A set of points in an interior of the transportation vehicle is illuminated sequentially. At least a subset of the illuminated points are captured by a camera arranged in the pair of augmented-reality glasses. Through a comparison of the subset of the illuminated points that have been captured by the camera with a known geometry of the set of points, a transformation specification for the pair of augmented-reality glasses is determined.

Abstract: Computer-based method and system for geo-spatial analysis for determining groundwater potential zones within a geographic area are disclosed herein. The method and system facilitate a user, without any hard knowledge of geographic information system (GIS) to perform quick geo-spatial analysis with a fully automated, single step, and single input process including automatically retrieving a set of satellite images and digital elevation model (DEM) corresponding to a geographic area and a time frame provided by the user, automatically processing the set of satellite images and DEM to determine one or more spectral indices and topographic wetness index (TWI) corresponding to the geographic area and time frame, automatically determining the groundwater potential zones using the one or more spectral indices and the TWI and automatically presenting a visualization depicting the groundwater potential zones within the geographic area.

Abstract: A system, method and computer program products for prioritizing the stacking order of virtualized objects within a z-index of an augmented reality system by presenting the most valuable, relevant or important information more prominently. Prioritization of the virtualized object may occur dynamically, as a function of the user's primary focus. As the user's primary focus changes from one physical object to another, the stacking order may change in response to the shift in focus. Embodiments may use one or more techniques to identify the primary focus such as the direction of the user's gaze, the focal point of one or more visual recording systems (i.e. cameras) or the user may manually highlight one or more objects via the HUD or interface of the augmented display system. The disclosed embodiments allow for the more predominate or relevant virtualized objects within the augmented display to receive priority, unobscured viewing by the user.

Abstract: An augmented reality display system included in a vehicle generates an augmented reality display, on one or more transparent surfaces of the vehicle. The augmented reality display can include an indicator of the vehicle speed which is spatially positioned according to the speed of the vehicle relative to the local speed limit. The augmented reality display can include display elements which conform to environmental objects and can obscure and replace content displayed on the objects. The augmented reality display can include display elements which indicate a position of environmental objects which are obscured from direct perception through the transparent surface. The augmented reality display can include display elements which simulate one or more particular environmental objects in the environment, based on monitoring manual driving performance of the vehicle by a driver. The augmented reality display can include display elements which identify environmental objects and particular zones in the environment.

Abstract: An electronic device determines target information about a target and recommends a target based on the target information.

Abstract: In some examples, a method comprises: obtaining, by an artificial reality system including a head mounted display (HMD), image data via an image capture device, the HMD configured to output artificial reality content; detecting, by the artificial reality system, a physical peripheral device from the image data; detecting, by the artificial reality system, a pose of the peripheral device; generating, by the artificial reality system, based on the pose of the peripheral device, a virtual pointer along at least a portion of a line between the peripheral device and a virtual surface, the virtual pointer pointing at a location of the virtual surface; performing, by the artificial reality system, one or more actions based on the location of the virtual surface; and rendering, by the artificial reality system, the virtual pointer and the virtual surface for display at the HMD.

Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.

Abstract: Methods, apparatus, systems are disclosed for altering displayed content on a display device responsive to a user's proximity. In accord with one example, a computing system includes a memory, a sensor to collect data representative of a viewing distance between a display and a user of the display, and a scaler to adjust a size of at least one object displayed by the display based on the viewing distance from the display.

Abstract: An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.

Abstract: Methods, systems, and computer program products are provided for remediating an instance of a visual notification interfering with an output of an application on a display device of an electronic device. An instance of a visual notification is identified on a display device. The visual notification is determined to be interfering with the output of the application on the display device. User response to the output of the application is monitored. An assessment is made, based on the monitoring, of an effectiveness of the output of the application. It is determined, based on the assessment, that there exists a failure of the effectiveness of the output of the application. A remediation action is performed in response to the determined failure. The remediation action may include removal of the instance of the visual notification, terminating a parent process of the instance of the visual notification, or restarting the electronic device.

Abstract: Techniques for modifying video data to be displayed using a particular output device include receiving initial video data that includes a first set of pixels. A focal region within the pixels is determined automatically or through user input. Viewing data is generated based on the focal region. The viewing data indicates a boundary of a subset of the pixels of the initial video data. The subset has at least one dimension smaller than a corresponding dimension of the first set of pixels. The initial video data is modified, based on the viewing data, to form modified viewing data that includes the subset of pixels and the focal region. The modified video data may then be output using a display having different dimensions or other characteristics than a device used to output the initial video data.

Abstract: Disclosed are systems and methods for influencing the mood of a person using a synthetic window. The system includes storing one or more excitement scenes and one or more calming scenes, where the excitement scenes when displayed on the display produce an excitatory environment and the calming scenes when displayed on the display produce a calming environment. The system also includes receiving input as to a type of mood of the person, selecting an excitement scene or a calming scene in response to the mood type received, and displaying the selected scene on the display.

Abstract: Described are systems and methods that enable users to virtually experience an environment at a destination location from their own user device, control their experience and even interact with others that are physically located within the environment. Likewise, the user's experience may even be improved with the inclusion of enhancements that are presented to the user as the user experiences the environment. User's may interact with the enhancements to obtain additional enhancements, interact with others physically located within the environment, interact with and direct a guide that is physically located within the environment, and receive near real-time video and audio that is transmitted from a guide device located within the environment.

Abstract: An information processing apparatus including circuitry configured to acquire information indicating a spatial relationship between a real object and a virtual object, and initiate generation of a user feedback based on the acquired information, the user feedback being displayed to be augmented to a generated image obtained based on capturing by an imaging device, or augmented to a perceived view of the real world, and wherein a characteristic of the user feedback is changed when the spatial relationship between the real object and the virtual object changes.

Abstract: A modular computer-implemented XR health platform is adapted for diagnostic, therapeutic, and care delivery to patient. The platform incorporates one or more modules including a clinical platform module, XR platform module, configuration module, web portal and companion application module, integration module, light module, anatomy module, movement module, neurological module, mental health module, pain module, procedural and digital anesthetic module, hardware module, and billing module. A combined extended reality display and computing device are adapted for implementing one or more of the plurality of modules.