Facebook Patents

Facebook, Inc. operates a social media website and mobile app that enables people to connect, share and discover opinions, ideas, photos and videos. The company also owns Instagram, a mobile application for sharing photos and videos, as well as WhatsApp, a mobile messaging application.

Facebook Patents by Type
  • Facebook Patents Granted: Facebook patents that have been granted by the United States Patent and Trademark Office (USPTO).
  • Facebook Patent Applications: Facebook patent applications that are pending before the United States Patent and Trademark Office (USPTO).
  • Publication number: 20220150553
    Abstract: According to examples, a system for generating and delivering enhanced content utilizing remote rendering and data streaming is described. The system may include a processor and a memory storing instructions. The processor, when executing the instructions, may cause the system to transmit a selected engagement content item for transmission to a user device and receive an indication of interest relating to the selected engagement content item. The processor, when executing the instructions, may then select, based on the received indication of interest, an enhanced content item, process the enhanced to content item to generate a stream of content data associated with the enhanced content item and transmit the stream of content data associated with the enhanced content item to the user device.
    Type: Application
    Filed: November 9, 2021
    Publication date: May 12, 2022
    Applicant: Facebook, Inc.
    Inventors: Rakesh RAVURU, Brian FOX, Keenan Christopher PRIDMORE, Miguel Angel PEREZ, Xin ZHOU, Adetunji Toritseju OLOJEDE, Kyle Scot SHANK, Robert Thomas MOAKLER, Nikhil Girish NAWATHE, Lara Jessamine ANDREWS, Tatiana Borrell PECK, Rotem DRUKER, Siqi HUANG, Siyi WANG, Hoang Viet NGUYEN
  • Patent number: 11330460
    Abstract: Disclosed herein are related to a system and a method of reducing contention in accessing a wireless link. In one aspect, a first device includes a transceiver configured to communicate with a second device via a wireless link. In one aspect, the first device includes a processor configured to determine that a type of content to be transferred between the first device and the second device through the wireless link. In one aspect, the processor is configured to modify one or more parameters for the first device to access the wireless link, from a first set of values to a second set of values, in response to determining that the type of content is artificial reality. In one aspect, the processor is configured to cause the transceiver to access the wireless link using the second set of values.
    Type: Grant
    Filed: July 29, 2020
    Date of Patent: May 10, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Nabeel Ahmed, Sam Padinjaremannil Alex, William Louis Abbott, Fabrizio Guerrieri, Payam Torab Jahromi
  • Patent number: 11327438
    Abstract: Techniques disclosed herein relate to modifying refractive index modulation in a holographic optical element, such as a holographic grating. According to certain embodiments, a holographic optical element or apodized grating includes a polymer layer comprising a first region characterized by a first refractive index and a second region characterized by a second refractive index. The holographic optical element or apodized grating includes a plurality of nanoparticles dispersed in the polymer layer. The nanoparticles have a higher concentration in either the first region or the second region. In some embodiments, the nanoparticles may be configured to increase the refractive index modulation. In some embodiments, the nanoparticles may be configured to apodize the grating by decreasing the refractive index modulation proximate to sides of the grating. The refractive index may be modulated by applying a monomer reservoir buffer layer to the polymer layer, either before or after hologram fabrication.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Matthieu Charles Raoul Leibovici, Austin Lane, Wanli Chi, Hee Yoon Lee
  • Patent number: 11327651
    Abstract: Disclosed herein are related to systems and methods for providing inputs through a virtual keyboard with an adaptive language model. In one approach, one or more processors determine whether a user intended to provide semantically meaningful characters or not, when providing a hand motion or a hand pose with respect to a virtual keyboard. The virtual keyboard may be located on a surface without physical keys. In one approach, the one or more processors determine an input to the virtual keyboard based on the hand motion or the hand pose. In one approach, the one or more processors determine weight of a language model according to the determined user intention. In one approach, the one or more processors modify the detected input according to the determined weight of the language model.
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Mark A. Richardson, Robert Y. Wang
  • Patent number: 11327566
    Abstract: The disclosed method may include receiving neuromuscular activity data over a first time series from a first sensor on a wearable device donned by a user receiving ground truth data over a second time series from a second sensor that indicates a body part state of a body part of the user, generating one or more training datasets by time-shifting at least a portion of the neuromuscular activity data over the first time series relative to the second time series, to associate the neuromuscular activity data with at least a portion of the ground truth data, and training one or more inferential models based on the one or more training datasets. Various other related methods and systems are also disclosed.
    Type: Grant
    Filed: March 27, 2020
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Nadine Hussami, Patrick Kaifosh, Alexandre Barachant, Daniel Wetmore
  • Patent number: 11330193
    Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Patent number: 11328942
    Abstract: A pick-up head assembly comprises a body of a liquid crystalline elastomer (LCE) that undergoes a reversible expansion when exposed to a first frequency of light and contracts when exposed to a second frequency of light. Selective portions of the LCE in the pick-up head assembly are irradiated with the first frequency to cause an expansion in the selective portions. The adhesive forces of the expanded portions of the LCE are used to pick-up semiconductor devices from a first substrate. The semiconductor devices are placed on a second substrate by exposing the expanded portions of the LCE to the second frequency of light, causing the expanded portions to contract.
    Type: Grant
    Filed: September 10, 2019
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Thomas John Farrell Wallin, Yigit Mengue, Pooya Saketi, Ali Sengül, Nicholas Roy Corson, Katherine Healy, Remi Alain Delille, Oscar Torrents Abad, Daniel Brodoceanu, Robert Manson, Leif-Erik Sharif Simonsen
  • Patent number: 11328211
    Abstract: A method for classifying a gesture made in proximity to a touch interface. A system receives data related to the position and/or movement of hand. The data is delimited by identifying a variable length window of touch frames. The variable length window of touch frames is selected to include touch frames indicative of feature data. The variable length window of touch frames is classified based upon classifications learned by the classifying module to identify gestures.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Ricardo Jorge Jota Costa, Clifton Forlines
  • Patent number: 11327266
    Abstract: A housing assembly for mounting a first lens and a second lens includes a first lens holder. The first lens holder includes a ring-shaped structure configured to mount the first lens. The housing assembly also includes a second lens holder including a cup-shaped structure. The cup-shaped structure includes an upper portion configured to mount the first lens holder, and a lower portion configured to mount the second lens.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: May 10, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Aiqing Chen, Weihua Gao, Daozhi Wang, Ashvath Sharma, Matthew Erich, Mark Alan Tempel
  • Patent number: 11327314
    Abstract: A display device including a laser-based light engine is disclosed. Optical interference effects due to the coherent nature of a laser light source are mitigated by shortening a coherence length of the laser source. The coherence length shortening is achieved by at least one of the following: providing a multiple longitudinal mode laser source, pulsing a laser source to achieve spectral broadening, or providing multi-emitter laser source(s) with emission wavelength varying from emitter to emitter.
    Type: Grant
    Filed: April 15, 2020
    Date of Patent: May 10, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Chloe Astrid Marie Fabien, Daniel Guenther Greif, Scott Charles McEldowney, Maxwell Parsons
  • Patent number: 11327306
    Abstract: A near eye display (NED) includes multiple PBP optical elements combined with one or more C-plates to improve optical angular performance. The PBP optical elements may be configured for beam steering or for focusing light to a point. A C-plate may reduce or eliminate an undesirable polarization phase shift introduced by the PBP optical elements to angular, off-axis light. Birefringence of the PBP optical elements produces such a polarization phase shift. A C-plate provides an additional polarization phase shift that is opposite to the extra polarization phase shift by the PBP optical elements. Thus, the additional polarization phase shift by the C-plate at least partially reduces the phase shift by the PBP element.
    Type: Grant
    Filed: June 12, 2018
    Date of Patent: May 10, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Wai Sze Tiffany Lam, Lu Lu
  • Patent number: 11327311
    Abstract: A head mounted display (HMD) includes a field curvature corrected (FC) display to mitigate field curvature in an image that is output to a user's eyes. The FC display includes elements that generate the image light and elements to mitigate field curvature from the image light. The FC display may include a display panel with lenses, a display panel with a reflective polarizer and reflective surface, or other optical elements. The FC display may include a pancake lens configuration including a polarized display with a quarter wave plate, a reflective mirror, and a polarization reflective mirror.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Ying Geng, Jacques Gollier, Stephen James McNally, Brett Joseph Bryars, Scott Charles McEldowney
  • Patent number: 11320527
    Abstract: The disclosed radar system may include a radar mechanism comprising a transmitter and at least one receiver. The radar system may also include a signal generator that generates a frequency-modulated radar signal. In addition, the radar system may include a delay mechanism that (1) receives the frequency-modulated radar signal from the signal generator and (2) after a certain period of delay, passes the frequency-modulated radar signal to the transmitter to be transmitted to a transponder located on a wearable artificial reality device. The radar system may also include a processing device that (1) receives the frequency-modulated radar signal from the signal generator, (2) detects a signal returned to the receiver from the transponder, and (3) calculates a distance between the transponder and the receiver based at least in part on an analysis of the signal returned from the transponder and the frequency-modulated radar signal received from the signal generator.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: May 3, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Riccardo DeSalvo, Giuseppe Castaldi, Andrea Cusano, Vincenzo Galdi, Paolo Mattera, Roberto Parente, Fereydoun Daneshgaran, Joseph Minh Tien, Dustin Jeffery Gordon Krogstad
  • Patent number: 11318375
    Abstract: A head mounted display (HMD) includes an electronic display configured to display a virtual scene to a user, an optics block, an eye tracking system, and a varifocal actuation that mechanically changes a distance between the optics block and the electronic display. The varifocal actuation block is configured to change a location of an image plane of the HMD and includes a motor, a power screw coupled to the actuating motor configured to turn responsive to actuation of the motor, and a nut sled on the power screw that is coupled to the electronic display. The nut sled is configured to move back and forth along a length of the power screw responsive to the power screw being turned by the motor that results in movement of the electronic display relative to the optics block.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: May 3, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Ryan Michael Ebert
  • Patent number: 11320896
    Abstract: In one embodiment, a method includes capturing, using one or more cameras implemented in a wearable device worn by a user, a first image depicting at least a part of a hand of the user holding a controller in an environment, identifying one or more features from the first image to estimate a pose of the hand of the user, estimating a first pose of the controller based on the pose of the hand of the user and an estimated grip that defines a relative pose between the hand of the user and the controller, receiving IMU data of the controller, and estimating a second pose of the controller by updating the first pose of the controller using the IMU data of the controller. The method utilizes multiple data sources to track the controller under various conditions of the environment to provide an accurate controller tracking consistently.
    Type: Grant
    Filed: August 3, 2020
    Date of Patent: May 3, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Tsz Ho Yu, Chengyuan Yan, Christian Forster
  • Patent number: 11322095
    Abstract: Embodiments relate to a display device including an active display area with pixels arranged in rows and columns, where a focus area of the active display area is operated in a progressive scanning manner and a non-focus area of the active display area is operated in an interlaced scanning manner. The active display area is driven by a gate driver circuit that supplies gate signals the pixels. First stages of the gate driver circuit are coupled to first rows of the pixels that are in the focus area and output first gate signals in the progressive scanning manner. Second stages of the gate driver circuit are coupled to second rows of the pixels that are in the non-focus area and output second gate signals in the interlaced scanning manner.
    Type: Grant
    Filed: March 5, 2021
    Date of Patent: May 3, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Zhiming Zhuang, Min Hyuk Choi, Donghee Nam, Wonjae Choi
  • Patent number: 11320906
    Abstract: A haptic device including a magnet, a rigid and conductive material arranged with respect to the magnet so as to create a gap between the magnet and the rigid and conductive material is disclosed. The haptic device is configured such that a magnetic field is generated in the gap by the magnet. The haptic device also includes a plurality of coils each connected to a respective one of a plurality of protruding elements where each of the plurality of coils are configured to be positioned within the gap. Each of the plurality of protruding elements are configured to produce a respective contact with an object when the respective coil is energized. In some embodiments, the object is a hand of a user.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: May 3, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Massimiliano Di Luca
  • Patent number: 11320684
    Abstract: An optical element includes a first boundary layer and a second boundary layer. A solution is disposed between the first boundary layer and the second boundary layer. The solution includes liquid crystals co-mingled with oblong photochromic dye molecules.
    Type: Grant
    Filed: April 21, 2020
    Date of Patent: May 3, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jasmine Soria Sears, Afsoon Jamali, Yun-Han Lee
  • Patent number: 11321838
    Abstract: In one embodiment, a method for eye-tracking comprises capturing images of a user using one or more cameras, the captured images of the user depicting at least an eye of the user, storing the captured images of the user in a storage device, reading, from the storage device, a down-sampled version of the captured images of the user, detecting one or more first segments in the down-sampled version of the captured images by processing the down-sampled version of the captured images using a machine-learning model, the one or more first segments comprising features of the eye of the user, reading, from the storage device, one or more second segments in the captured images corresponding to the one or more first segments in the down-sampled version of the captured images, and computing a gaze of the user based on the one or more second segments in the captured images.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: May 3, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Jeffrey Hung Wong, Martin Henrik Tall, Jixu Chen, Kapil Krishnakumar
  • Publication number: 20220129082
    Abstract: Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes.
    Type: Application
    Filed: January 10, 2022
    Publication date: April 28, 2022
    Applicant: Facebook Technologies, LLC
    Inventor: Hayden Schoen
  • Patent number: 11315330
    Abstract: A sensor assembly for determining one or more features of a local area is presented herein. The sensor assembly includes a plurality of stacked sensor layers. A first sensor layer of the plurality of stacked sensor layers located on top of the sensor assembly includes an array of pixels. The top sensor layer can be configured to capture one or more images of light reflected from one or more objects in the local area. The sensor assembly further includes one or more sensor layers located beneath the top sensor layer. The one or more sensor layers can be configured to process data related to the captured one or more images. A plurality of sensor assemblies can be integrated into an artificial reality system, e.g., a head-mounted display.
    Type: Grant
    Filed: June 24, 2020
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Xinqiao Liu
  • Patent number: 11314566
    Abstract: In one embodiment, a method includes creating, by a computing device, an inter process communication (IPC) channel for communication from a producer process to a consumer process. The IPC channel includes a message buffer mapped to a first virtual address space of a kernel of an operating system and to a second virtual address space of the consumer process in a user space of the operating system. A sender handle for the message buffer is sent to the producer process. The kernel receives a request, which includes the sender handle, to send a message from the producer process to the consumer process through the IPC channel. Responsive to a determination that the request is permitted, the kernel writes the message to the message buffer using the sender handle, such that message written in the message buffer is accessible to the consumer process through the second address space.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Christoph Klee, Bernhard Poess, Sumit Kamath
  • Patent number: 11315327
    Abstract: In one embodiment, a method includes determining a first time interval for rendering pixel values for a first portion of a display, where the first portion of the display is one of a plurality of portions of the display, accessing a representation of virtual objects in a virtual scene, and determining that the first time interval is insufficient for rendering pixel values for the first portion of the display based on the representation of virtual objects. The method further includes, for each of the portions of the display, determining a current viewpoint of a user, rendering, based on the current viewpoint of the user, pixel values for that portion of the display, and sending the rendered pixel values to be output by the display, where the rendered pixel values for the first portion of the display are rendered based on a simplified representation of virtual objects in the virtual scene.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Larry Seiler, Alexander Nankervis, John Adrian Arthur Johnston, Jeremy Freeman
  • Patent number: 11314320
    Abstract: Disclosed herein are devices and methods related to an interface between a host processor and a wireless processor of a first device for maintaining an artificial reality session with a second device. In one aspect, the host processor is configured to provide data of the artificial reality session to the wireless processor, and the wireless processor is configured to transmit the data to the second device through a wireless medium. In one aspect, the host processor is configured to provide an indicator indicating an end of transmission of the data, to the wireless processor, to cause the wireless processor to transmit the indicator to the second device through the wireless medium, and to cause the host processor and the wireless processor to enter a sleep state in response to transmission of the indicator. The indicator may cause the second device to enter the sleep state.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: April 26, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Gang Lu, Jiwon Steve Han, Nihar Doshi, Xiaoguang Wang, Qi Qu, Dong Zheng, Chunyu Hu
  • Patent number: 11315329
    Abstract: In one embodiment, a method includes accessing a plurality of points, wherein each point (1) corresponds to a spatial location associated with an observed feature of a physical environment and (2) is associated with a patch representing the observed feature, determining a density associated with each of the plurality of points based on the spatial locations of the plurality of points, scaling the patch associated with each of the plurality of points based on the density associated with the point, and reconstructing a scene of the physical environment based on at least the scaled patches.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Alexander Sorkine Hornung, Alessia Marra, Fabian Langguth, Matthew James Alderman
  • Patent number: 11316610
    Abstract: Systems and methods for beamforming include a device including at least one of a head wearable display (HWD) or a console. The device establishes a first connection between an active HWD radio-frequency integrated circuit (RFIC) and an active console RFIC. The device compares a modulation and coding scheme (MCS) of the first connection to an MCS threshold. The device performs MCS measurements for a second connection of at least one of an idle HWD RFIC or an idle console RFIC, while the first connection is maintained, in response to the MCS not satisfying the MCS threshold. The device compares the MCS measurements of the second connection to the MCS threshold. The device switches to the second connection when at least one of the one or more MCS measurements satisfies the MCS threshold and/or above the MCS of the first connection.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: April 26, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Dong Zheng, Yuting Fan, Qi Qu, Gang Lu
  • Patent number: 11315570
    Abstract: The technology disclosed relates to a machine learning based speech-to-text transcription intermediary which, from among multiple speech recognition engines, selects a speech recognition engine for accurately transcribing an audio channel based on sound and speech characteristics of the audio channel.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Shamir Allibhai
  • Patent number: 11314093
    Abstract: A device includes one or more light guides. The device also includes a first in-coupling element configured to couple a first light having a first input field of view (“FOV”) into a first light guide, and a second in-coupling element configured to couple a second light having a second input FOV into a second light guide. The device also includes a first out-coupling element configured to couple the first light out of the first light guide as a first output light having a first output FOV, and a second out-coupling element configured to couple the second light out of the second light guide as a second output light having a second output FOV substantially non-overlapping with the first output FOV. A combination of the first output FOV and the second output FOV is larger than at least one of the first output FOV or the second output FOV.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: April 26, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Scott Charles McEldowney, Babak Amirsolaimani, Yun-Han Lee, Lu Lu, Mengfei Wang, Junren Wang
  • Patent number: 11315541
    Abstract: The disclosed computer-implemented method may include applying, via a sound reproduction system, sound cancellation that reduces an amplitude of various sound signals. The method further includes identifying, among the sound signals, an external sound whose amplitude is to be reduced by the sound cancellation. The method then includes analyzing the identified external sound to determine whether the identified external sound is to be made audible to a user and, upon determining that the external sound is to be made audible to the user, the method includes modifying the sound cancellation so that the identified external sound is made audible to the user. Various other methods, systems, and computer-readable media are also disclosed.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew Lovitt, Antonio John Miller, Philip Robinson, Scott Selfon
  • Patent number: 11317188
    Abstract: An audio system for providing content to a user. The system includes a first and a second transducer assembly of a plurality of transducer assemblies, an acoustic sensor, and a controller. The first transducer assembly couples to a portion of an auricle of the user's ear and vibrates over a first range of frequencies based on a first set of audio instructions. The vibration causes the portion of the ear to create a first range of acoustic pressure waves. The second transducer assembly is configured to vibrate over a second range of frequencies to produce a second range of acoustic pressure waves based on a second set of audio instructions. The acoustic sensor detects acoustic pressure waves at an entrance of the ear. The controller generates the audio instructions based on audio content to be provided to the user and the detected acoustic pressure waves from the acoustic sensor.
    Type: Grant
    Filed: July 17, 2020
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Ravish Mehra, Antonio John Miller, Morteza Khaleghimeybodi
  • Patent number: 11314941
    Abstract: In one embodiment, a method includes receiving a user input comprising one or more words at a client system, wherein each word comprises one or more characters, inputting the words to a convolutional neural network (CNN) model stored on the client system, accessing a plurality of character-embeddings for a plurality of characters, respectively, from a data store of the client system, generating one or more word-embeddings for the one or more words, respectively, based on the accessed character-embeddings by processing the accessed character-embeddings with one or more convolutional layers and one or more gated linear units of the CNN model, determining one or more tasks corresponding to the user input for execution based on an analysis of the one or more word-embeddings by the CNN model, and providing an output responsive to the user input based on the execution of the one or more tasks at the client system.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Ahmed Aly, Arun Babu, Armen Aghajanyan
  • Patent number: 11315328
    Abstract: A system can include a device and a graphics processing unit (GPU). The device can be configured to receive a first image from one or more cameras corresponding to a first view and a second image from the one or more cameras corresponding to a second view. The GPU can include a motion estimator and configured to receive the first image and the second image and be configured to receive the first image and the second image. The motion estimator can be configured to determine first disparity offsets for the first image and second disparity offsets for the second image. The device can be configured to generate, for rendering 3D image using the first image and the second image, a first depth buffer for the first image derived from the first disparity offsets and a second depth buffer for the second image derived from the second disparity offsets.
    Type: Grant
    Filed: January 28, 2020
    Date of Patent: April 26, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Volga Aksoy, Dean Joseph Beeler
  • Patent number: 11307654
    Abstract: Techniques disclosed herein relate to eye illumination for eye tracking in a near-eye display system. One example of an eye illumination system includes a substrate transparent to visible light and infrared light and configured to be placed in front of an eye of a user, and a shortwave-pass filter on a first surface of the substrate. The shortwave-pass filter includes regions configured to transmit visible light and reflect infrared light in ambient light, and a plurality of windows configured to transmit both visible light and infrared light in the ambient light.
    Type: Grant
    Filed: January 10, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Qi Zhang, Andrew John Ouderkirk, Robin Sharma, Brian Wheelwright, Robert Dale Cavin
  • Patent number: 11308972
    Abstract: The disclosure is generally directed to a system for reducing wind noise. A system includes one or more processors coupled to a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to obtain signals respectively generated from two or more microphones during a time period, the signals representing acoustic energy detected by the two or more microphones during the time period, determine a coherence between the signals, and determine a filter based on the coherence. The filter is configured to reduce wind noise in one or more of the signals.
    Type: Grant
    Filed: May 11, 2020
    Date of Patent: April 19, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Gongqiang Yu, Michael Smedegaard, Tetsuro Oishi
  • Patent number: 11308698
    Abstract: In one embodiment, a computing system may generate and display a virtual reality environment to a user. The computing system may determine a head pose of the user based on headset tracking data associated with a headset worn by the user. The computing system may determine a hand pose of the user based on hand tracking data associated with a device held or worn by a hand of the user. The computing system may access scene information associated with the displayed virtual reality environment. The computing system may determine a predicted focal point of the user within the virtual reality environment by processing the head pose, the hand pose, and the scene information using a machine-learning model.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Kara Emery, Marina Zannoli, Lei Xiao
  • Patent number: 11307415
    Abstract: An optical system for a head mounted display (HMD) includes a display layer, an illumination layer, an optical combiner, and an active optics block. The display layer is configured to emit display light and the illumination layer includes an array of point light sources configured to emit calibration light. The optical combiner is configured to pass the display light to a front side of the optical system and to direct the calibration light to a camera. The active optics block includes an adjustable lens disposed between the illumination layer and the optical combiner, where the adjustable lens is configured to pass the calibration light to the optical combiner and to focus the display light for a user of the HMD. The active optics block is further configured to adjust an optical power of the adjustable lens based on a calibration image captured by the camera responsive to the calibration light.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Robin Sharma, Katherine Marie Smyth, Andrew John Ouderkirk, Karol Constantine Hatzilias, Christopher Yuan-Ting Liao
  • Patent number: 11307217
    Abstract: Described herein are accelerometers, apparatus and systems incorporating accelerometers, and techniques for controlling sensing operations in an accelerometer. In certain embodiments, an accelerometer is a microelectromechanical systems (MEMS) device including a proof mass, an anchor, a spring between the proof mass and the anchor, a drive electrode, and a sense beam. The anchor is located in an opening defined by a body of the proof mass. The spring and the proof mass form a spring system suspended from the anchor. The sense beam is configured to oscillate at a particular resonance frequency that changes according to a force generated by movement of the proof mass in response to acceleration. In some embodiments, a support structure couples the anchor to the spring and operates as a stress decoupling area that prevents or limits propagation of stress from the anchor to the sense beam and the spring system.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: April 19, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Doruk Senkal, Yuri Toride
  • Patent number: 11309947
    Abstract: The disclosed computer-implemented method may include (1) establishing a directional wireless link between a first computing device and a second computing device in a first direction, (2) exchanging, over the directional wireless link in the first direction, first data between the first computing device and the second computing device, (3) determining, via a sensor of the first computing device, a change to a position or an orientation of the first computing device, (4) redirecting, based on the change, the directional wireless link to a second direction, and (5) exchanging, over the directional wireless link in the second direction, second data between the first computing device and the second computing device. Various other methods and systems are also disclosed.
    Type: Grant
    Filed: November 19, 2018
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Reza Tusi, Ohad Meitav
  • Patent number: 11308681
    Abstract: In one embodiment, a method includes, generating rays for casting into an artificial reality scene that includes one or more surfaces to determine whether the one or more surfaces are visible from a viewpoint. An origin and a trajectory of each ray are based on the viewpoint. The method includes applying a geometric transformation to the rays to modify their respective trajectory into the artificial reality scene. The geometric transformation is based on one or more distortion characteristics of a display system. The method includes determining, based on the modified trajectories of the rays, points of intersection of rays with the one or more surfaces in the artificial reality scene. The method includes providing, for display by the display system, color values generated based on the determined points of intersection.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Larry Seiler, Alexander Nankervis, John Adrian Arthur Johnston, Jeremy Freeman
  • Patent number: 11309464
    Abstract: Techniques disclosed herein relate to micro light emitting diodes (micro-LEDs) for a display system. A display system includes an array of micro light emitting diodes (micro-LEDs), an array of output couplers optically coupled to the array of micro-LEDs and configured to extract light emitted by respective micro-LEDs in the array of micro-LEDs, a waveguide display, and display optics configured to couple the light emitted by the array of micro-LEDs and extracted by the array of output couplers into the waveguide display. Each output coupler in the array of output couplers is configured to direct a chief ray of the light emitted by a respective micro-LED in the array of micro-LEDs to a different respective direction.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Stephan Lutgen, François Gérard Franck Olivier, Vasily Zabelin, William Padraic Henry, Markus Broell, Thomas Lauermann, David Massoubre, Daniel Bryce Thompson, Michael Grundmann
  • Patent number: 11305180
    Abstract: A capacitive sensing assembly comprises a nonconductive interface material, a conductive plastic, an electrode, and a controller. The capacitive sensing assembly is configured to detect a proximity of skin to the nonconductive interface material. The nonconductive interface material comprises a first surface and a second surface that are opposite one another. The first surface receives contact with the skin. The conductive plastic is coupled to the second surface of the interface material. The electrode is electrically coupled to the conductive plastic and configured to provide an electrical signal. The electrical signal corresponds to a surface capacitance of the nonconductive interface material that is based in part on the conductive plastic, the nonconductive interface material, and the proximity of the skin to the interface material. The controller determines the proximity of the skin based on the electrical signal that corresponds to the surface capacitance.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Raymond Louis Nicoli
  • Patent number: 11308284
    Abstract: In one embodiment, a method includes receiving a user input from a user from a client system associated with the user, wherein the client system comprises one or more cameras, determining one or more points of interest in a field of view of the one or more cameras based on one or more machine-learning models and sensory data captured by the one or more cameras, generating a plurality of media files based on the one or more points of interest, wherein each media file is a recording of at least one of the one or more points of interest, generating one or more highlight files based on the plurality of media files, wherein each highlight file comprises a media file that satisfies a predefined quality standard, and sending instructions for presenting the one or more highlight files to the client system.
    Type: Grant
    Filed: October 21, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Lisa Xiaoyi Huang, Eric Xiao, Nicholas Michael Andrew Benson, Yating Sheng, Zijian He
  • Patent number: 11306193
    Abstract: A method of forming a nanovoided composite polymer includes forming a resin-containing layer over a substrate, the resin-containing layer including a polymer-forming phase and a sacrificial phase, curing the polymer-forming phase to form a polymer matrix containing the sacrificial phase, and removing the sacrificial phase selectively with respect to the polymer matrix to form a nanovoided composite polymer including the polymer matrix and nanovoids dispersed throughout the polymer matrix. The nanovoids may be randomly or regularly dispersed throughout the matrix. Various other methods, systems, apparatuses, and materials are also disclosed.
    Type: Grant
    Filed: December 10, 2018
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Austin Lane, Jack Lindsay, Katherine Marie Smyth, Thomas John Farrell Wallin, Andrew John Ouderkirk, Tanya Malhotra, Christopher Yuan Ting Liao, Yigit Mengue
  • Patent number: 11307357
    Abstract: Techniques for overcoating slanted structures and devices obtained using the techniques are disclosed. In some embodiments, a method of forming an overcoat layer on a surface-relief structure on a substrate includes receiving the substrate with the surface-relief structure. The surface-relief structure includes a plurality of ridges slanted with respect to the substrate, and a plurality of grooves each between two adjacent ridges. The method further includes depositing, in each cycle of a plurality of cycles, a uniform layer of an overcoat material on surfaces of the plurality of ridges and bottoms of the plurality of grooves. The deposited layers of the overcoat material and the plurality of ridges collectively form a light-coupling structure on the substrate. A surface of the overcoat layer is planar.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Nihar Ranjan Mohanty
  • Patent number: 11307347
    Abstract: A device for illuminating a spatial light modulator includes a light source and an optical element. The light source is configured to provide illumination light. The optical element has a first surface, a second surface that is distinct from and non-parallel to the first surface, and a third surface that is distinct from and non-parallel to the first surface and the second surface. The optical element is configured to receive the illumination light at the first surface, propagate the illumination light via total internal reflection, and output the illumination light from the third surface. Also disclosed is a method performed by the device.
    Type: Grant
    Filed: May 12, 2020
    Date of Patent: April 19, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Ying Geng, Adrian Travis, Gang Li
  • Patent number: 11308920
    Abstract: In one embodiment, a computing system may access an image to be displayed by a display. The system may determine one or more characteristics associated with a content of the image. The one or more characteristics may include a spatial frequency of the content in a spatial frequency domain. The system may determine a display persistence time period for the display to display the image based on the one or more characteristics associated with the content of the image. The system may configure the display to display the image using the display persistence time period.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Alexander Goettker, Thomas Scott Murdison, Kevin James MacKenzie, Larry Seiler
  • Patent number: 11307647
    Abstract: This disclosure describes an artificial reality system that presents artificial reality content or artificial reality effects based on, or in response to, interactions with one or more physical objects within a physical environment. In one example, this disclosure describes a method that includes determining that a user has performed a trigger action on a trigger object; responsive to determining that the user has performed the trigger action, generating artificial reality content; presenting the artificial reality content on a display associated with a head-mounted display; determining that the user has performed a de-trigger action; and responsive to determining that the user has performed the de-trigger action, discontinuing presentation of the artificial reality content.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: April 19, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Lars Anders Bond, Christopher John Ocampo, Stefano Zanetti
  • Patent number: 11302063
    Abstract: A 3D conversation system can facilitate 3D conversations in an augmented reality environment, allowing conversation participants to appear as if they are face-to-face. The 3D conversation system can accomplish this with a pipeline of data processing stages, which can include calibrate, capture, tag and filter, compress, decompress, reconstruct, render, and display stages. Generally, the pipeline can capture images of the sending user, create intermediate representations, transform the representations to convert from the orientation the images were taken from to a viewpoint of the receiving user, and output images of the sending user, from the viewpoint of the receiving user, in synchronization with audio captured from the sending user. Such a 3D conversation can take place between two or more sender/receiving systems and, in some implementations can be mediated by one or more server systems. In various configurations, stages of the pipeline can be customized based on a conversation context.
    Type: Grant
    Filed: July 21, 2020
    Date of Patent: April 12, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Brian Keith Cabral, Albert Parra Pozo
  • Patent number: 11302841
    Abstract: Embodiments relate to a method for fabricating a light-emitting-diode (LED). A metal layer is deposited on a p-type semiconductor. The p-type semiconductor is on an n-type semiconductor. The metal layer is patterned to define a p-metal. The p-type semiconductor is etched using the p-metal as an etch mask. Similarly, the n-type semiconductor is etched using the p-metal and the p-type semiconductor as an etch mask to define individual LEDs.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: April 12, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Celine Claire Oyer, Allan Pourchet
  • Patent number: 11303816
    Abstract: A wearable device includes a strap, a base connected to the strap, a display detachably connected to the base, and a camera embedded within the display. The display is configured to rotate around a perimeter of the base to adjust the orientation of the camera with respect to the base. Rotating the display allows the camera to capture one or more fields-of-view at different positions with respect to the base. In some embodiments, the display includes two or more cameras having distinct lenses. In some embodiments, the lenses of the two or more cameras are macro lenses, prime telephoto lenses, optical zoom lenses, or normal lenses. In some embodiments, the wearable device includes a second alternative display having one or more embedded second cameras. The second display is configured to detachably couple to the base after detaching the first display.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: April 12, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventor: Ingrid Anda Cotoros