Lucasfilm Patents
Advertisement
Lucasfilm Ltd. produced the Star Wars and Indiana Jones motion pictures. The company was acquired by the Walt Disney Company in 2012.
Lucasfilm Patents by Type
- Lucasfilm Patents Granted: Lucasfilm patents that have been granted by the United States Patent and Trademark Office (USPTO).
- Lucasfilm Patent Applications: Lucasfilm patent applications that are pending before the United States Patent and Trademark Office (USPTO).
Patent number: 9324179
Abstract: Among other aspects, on computer-implemented method includes: receiving at least one command in a computer system from a handheld device; positioning a virtual camera and controlling a virtual scene according to the command; and in response to the command, generating an output to the handheld device for displaying a view of the virtual scene as controlled on a display of the handheld device, the view captured by the virtual camera as positioned.
Type:
Grant
Filed:
January 12, 2015
Date of Patent:
April 26, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Kevin Wooley, Michael Sanders, Steve Sullivan, Spencer Reynolds, Brian Cantwell
Patent number: 9317954
Abstract: Techniques for facial performance capture using an adaptive model are provided herein. For example, a computer-implemented method may include obtaining a three-dimensional scan of a subject and a generating customized digital model including a set of blendshapes using the three-dimensional scan, each of one or more blendshapes of the set of blendshapes representing at least a portion of a characteristic of the subject. The method may further include receiving input data of the subject, the input data including video data and depth data, tracking body deformations of the subject by fitting the input data using one or more of the blendshapes of the set, and fitting a refined linear model onto the input data using one or more adaptive principal component analysis shapes.
Type:
Grant
Filed:
December 26, 2013
Date of Patent:
April 19, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Hao Li, Jihun Yu, Yuting Ye, Christoph Bregler
Patent number: 9307231
Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus comprises one or more planar surfaces. The apparatus includes at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable.
Type:
Grant
Filed:
April 8, 2014
Date of Patent:
April 5, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Ronald Mallet, Jason Snell, Jeff Saltzman, Douglas Moore, Paige Warner
Patent number: 9307232
Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus includes a hollow body having an interior surface, an exterior surface and at least one window formed in the hollow body through which the interior surface is visible. A plurality of distinguishable fiducial markers are arranged in a predetermined pattern along the interior and exterior surface of the hollow body. The fiducial markers can be distinguishable such that, for any given image of the target captured by a camera, there is only one position, rotation, distortion value, and focal length for the camera of interest.
Type:
Grant
Filed:
September 30, 2014
Date of Patent:
April 5, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventor:
Paige Warner
Publication number: 20160093112
Abstract: A method may include receiving a plurality of objects from a 3-D virtual scene. The plurality of objects may be arranged in a hierarchy. The method may also include generating a plurality of identifiers for the plurality of objects. The plurality of identifiers may include a first identifier for a first object in the plurality of objects, and the identifier may be generated based on a position of the first object in the hierarchy. The method may additionally include performing a rendering operation on the plurality of objects to generate a deep image. The deep image may include a plurality of samples that correspond to the first object. The method may further include propagating the plurality of identifiers through the rendering operation such that each of the plurality of samples in the deep image that correspond to the first object are associated with the identifier.
Type:
Application
Filed:
September 30, 2014
Publication date:
March 31, 2016
Applicant:
LUCASFILM ENTERTAINMENT COMPANY, LTD.
Inventors:
SHIJUN HAW, XAVIER BERNASCONI
Patent number: 9300852
Abstract: Among other disclosed subject matter, a system includes a first camera generating a live image of a scene, the first camera configured for being placed in a plurality of locations by robotic motion. The system includes a handheld device that includes a display device for continuously presenting the live image, wherein movement of the handheld device causes the handheld device to generate an output that controls the robotic motion.
Type:
Grant
Filed:
February 24, 2014
Date of Patent:
March 29, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventor:
Domenico Porcino
Publication number: 20160078675
Abstract: Methods are disclosed for the computer generation of data for images that include hair, fur, or other strand-like material. A volume for the hair is specified, having a plurality of surfaces. A fluid flow simulation is performed within the volume, with a first surface of the volume being a source area through which fluid is simulated to enter the volume, and a second surface being an exit surface through which fluid is simulated as exiting the volume. The fluid flow simulation may be used to produce fluid flow lines, such as from a velocity vector field for the fluid. Fluid flow lines are selected, and image data of hairs that follow the fluid flow lines are generated. Other embodiments include generating animation sequences by generating images wherein the volume and surfaces vary between frames.
Type:
Application
Filed:
September 16, 2014
Publication date:
March 17, 2016
Applicant:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Stephen D. Bowline, Nicholas Grant Rasmussen
Patent number: 9280034
Abstract: A movie set can include light sources each producing a light corresponding to a light channel, at least one high-frame rate camera, and a controller connected to the light sources and camera to synchronize the camera and light sources. The number of light channels can be proportional to the frame rate. For example, if the filming frame rate is 120 frames per second (fps) and the playback frame rate is 24 fps, then 5 light channels can be used. In this example, for every one playback frame, 5 frames were filmed by the high frame rate camera. The controller modulates the light channels such that each of the 5 frames has different lighting characteristics. In post-production, contributions from each of the light channels can be included or excluded from the final frame. An optical flow algorithm can be used to stitch together frames with different dynamic light characteristics.
Type:
Grant
Filed:
September 5, 2013
Date of Patent:
March 8, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Kimberley Sean Libreri, Curt Isamu Miyashiro
Patent number: 9275490
Abstract: A method of applying a post-render motion blur to an object may include receiving a first image of the object. The first image need not be motion blurred, and the first image may include a first pixel and rendered color information for the first pixel. The method may also include receiving a second image of the object. The second image may be motion blurred, and the second image may include a second pixel and a location of the second pixel before the second image was motion blurred. Areas that are occluded in the second image may be identified and colored using a third image rendering only those areas. Unoccluded areas of the second image may be colored using information from the first image.
Type:
Grant
Filed:
May 4, 2015
Date of Patent:
March 1, 2016
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Victor Schutz, Patrick Conran
Patent number: 9256973
Abstract: A system includes a computer system capable of representing one or more animated characters. The computer system includes a blendshape manager that combines multiple blendshapes to produce the animated character. The computer system also includes an expression manager to respectively adjust one or more control parameters associated with each of the plurality of blendshapes for adjusting an expression of the animated character. The computer system also includes a corrective element manager that applies one or more corrective elements to the combined blendshapes based upon at least one of the control parameters. The one or more applied corrective elements are adjustable based upon one or more of the control parameters absent the introduction of one or more additional control parameters.
Type:
Grant
Filed:
December 23, 2013
Date of Patent:
February 9, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Michael Koperwas, Frederic P. Pighin, Cary Phillips, Steve Sullivan, Eduardo Hueso
Patent number: 9256778
Abstract: In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.
Type:
Grant
Filed:
December 15, 2014
Date of Patent:
February 9, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Kevin Wooley, Ronald Mallet
Publication number: 20160012598
Abstract: A system includes a visual data collector for collecting visual information from an image of one or more features of an object. The system also includes a physical data collector for collecting sensor information provided by at one or more sensors attached to the object. The system also includes a computer system that includes a motion data combiner for combining the visual information the sensor information. The motion data combiner is configured to determine the position of a representation of one or more of the feature in a virtual representation of the object from the combined visual information and sensor information. Various types of virtual representations may be provided from the combined information, for example, one or more poses (e.g., position and orientation) of the object may be represented.
Type:
Application
Filed:
September 21, 2015
Publication date:
January 14, 2016
Applicant:
LUCASFILM ENTERTAINMENT COMPANY, LTD.
Inventors:
STEVE SULLIVAN, KEVIN WOOLEY, BRETT A. ALLEN, MICHAEL SANDERS
Patent number: 9223488
Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes defining a first portion of a display as a workspace for a graphical representation of a portion of a network of processing operations. The workspace provides a navigable view of the graphical representation for editing the displayed portion of the network. The method also includes defining at least a second portion of the display, different from first portion, for a compressed view of a portion of the network of processing operations external to the first portion of the display. The method also includes simultaneously presenting the first portion and the second portion on the display.
Type:
Grant
Filed:
May 26, 2011
Date of Patent:
December 29, 2015
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventor:
Dave Lajoie
Publication number: 20150350628
Abstract: A method may include presenting a scene from linear content on one or more display devices in an immersive environment, and receiving, from a user within the immersive environment, input to change an aspect of the scene. The method may also include accessing 3-D virtual scene information previously used to render the scene, and changing the 3-D virtual scene information according to the changed aspect of the scene. The method may additionally include rending the 3-D virtual scene to incorporate the changed aspect, and presenting the rendered scene in real time in the immersive user environment.
Type:
Application
Filed:
December 15, 2014
Publication date:
December 3, 2015
Applicant:
Lucasfilm Entertainment Co. Ltd.
Inventors:
Mike Sanders, Kim Libreri, Nick Rasmussen, John Gaeta
Publication number: 20150348326
Abstract: A method may include displaying, on one or more display devices in a virtual-reality environment, a visual representation of a 3-D virtual scene from the perspective of a subject location in the virtual-reality environment. The method may also include displaying, on the one or more display devices, a chroma-key background with the visual representation. The method may further include recording, using a camera, an image of the subject in the virtual-reality environment against the chroma-key background.
Type:
Application
Filed:
September 11, 2014
Publication date:
December 3, 2015
Applicant:
Lucasfilm Entertainment Co. Ltd.
Inventors:
Mike Sanders, Kim Libreri, Nick Rasmussen, John Gaeta
Patent number: 9196074
Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes producing an animation model from one or more representations of an object provided from a deformable likeness of the object. The one or more representations are based upon position information from a collection of images of the object captured by at least one camera. The method also includes refining the animation model to produce representations that substantially match the one or more representations provided by the deformable likeness of the object. Refining the animation model is based upon the position information from the collection of images of the object and one or more constraints.
Type:
Grant
Filed:
June 24, 2011
Date of Patent:
November 24, 2015
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Kiran S. Bhat, Delio Tramontozzi, Tim Harrington
Patent number: 9183660
Abstract: A system includes a computing device that includes a memory for storing instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes combining, in a nonlinear manner, a first set of vertex displacements that represent the difference between a first animated expression and a neutral animated expression with a second set of vertex displacements that represent the difference between a second animated expression and the neutral animated expression. The number of vertices associated with the first set of vertex displacements of the first animated expression is equivalent to the number of vertices associated with the second set of vertex displacements of the second animated expression.
Type:
Grant
Filed:
November 26, 2013
Date of Patent:
November 10, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Michael Koperwas, Frederic P. Pighin
Publication number: 20150317765
Abstract: A method of compressing a deep image representation may include receiving a deep image, where the deep image may include multiple pixels, and where each pixel in the deep image may include multiple samples. The method may also include compressing the deep image by combining samples in each pixel that are associated with the same primitives. This process may be repeated on a pixel-by-pixel basis. Some embodiments may use primitive IDs to match pixels to primitives through the rendering and compositing process.
Type:
Application
Filed:
April 30, 2014
Publication date:
November 5, 2015
Applicant:
Lucasfilm Entertainment Company, Ltd.
Inventor:
Shijun Haw
Patent number: 9177408
Abstract: A computer-implemented method for handling a modification of an animation having a constraint includes detecting a user modification of an animation that involves at least first and second objects, the first object constrained to the second object during a constrained period and non-constrained to the second object during a non-constrained period. The method includes, based on the user modification, selecting one of at least first and second compensation adjustments for the animation based on a compensation policy; and adjusting the animation according to the selected compensation adjustment.
Type:
Grant
Filed:
June 15, 2011
Date of Patent:
November 3, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Greg James, John Horn, Laurie Berliner, Adam Schnitzer, Max S-Han Chen
Publication number: 20150294492
Abstract: A method of generating unrecorded camera views may include receiving a plurality of 2-D video sequences of a subject in a real 3-D space, where each 2-D video sequence may depict the subject from a different perspective. The method may also include generating a 3-D representation of the subject in a virtual 3-D space, where a geometry and texture of the 3-D representation may be generated based on the 2D video sequences, and the motion of the 3-D representation in the virtual 3-D space is based on motion of the subject in the real 3-D space. The method may additionally include generating a 2-D video sequence of the motion of the 3D representation using a virtual camera in the virtual 3-D space where the perspective of the virtual camera may be different than the perspectives of the plurality of 2-D video sequences.
Type:
Application
Filed:
August 25, 2014
Publication date:
October 15, 2015
Applicant:
Lucasfilm Entertainment Co., Ltd.
Inventors:
Hilmar Koch, Ronald Mallet, Kim Libreri, Paige Warner, Mike Sanders, John Gaeta
Publication number: 20150288951
Abstract: Methods and systems are disclosed for calibrating a camera using a calibration target apparatus that contains at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable. Parameters of the camera are inferred from at least one image of the calibration target apparatus. In some embodiments, pixel coordinates of identified fiducial markings in an image are used with geometric knowledge of the apparatus to calculate camera parameters.
Type:
Application
Filed:
April 8, 2014
Publication date:
October 8, 2015
Applicant:
LUCASFILM ENTERTAINMENT COMPANY, LTD.
Inventors:
RONALD MALLET, JASON SNELL, JEFF SALTZMAN, DOUGLAS MOORE, PAIGE WARNER
Publication number: 20150288956
Abstract: An apparatus is disclosed which may serve as a target for calibrating a camera. The apparatus comprises one or more planar surfaces. The apparatus includes at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable.
Type:
Application
Filed:
April 8, 2014
Publication date:
October 8, 2015
Applicant:
LUCASFILM ENTERTAINMENT COMPANY, LTD.
Inventors:
RONALD MALLET, JASON SNELL, JEFF SALTZMAN, DOUGLAS MOORE, PAIGE WARNER
Patent number: 9147288
Abstract: This document describes systems and techniques for representing computer-generated objects with a limit mesh. In general, the systems and techniques may generate an object's form or appearance based on an estimation of how the object would look if shapes that form the object were infinitely subdivided to create a smooth surface for the object. For example, when a user views a distance object in a video game, its shape can be estimated by calculating an approximation of what the object would look like if the polygons that make up the object were infinitely divided. As the user approaches the object, curving solutions that may be embedded in the object can be used to construct curves for the object so that it appears smooth.
Type:
Grant
Filed:
November 8, 2006
Date of Patent:
September 29, 2015
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Eric R. Johnston, Philip R. Peterson
Patent number: 9142024
Abstract: A system includes a visual data collector for collecting visual information from an image of one or more features of an object. The system also includes a physical data collector for collecting sensor information provided by at one or more sensors attached to the object. The system also includes a computer system that includes a motion data combiner for combining the visual information the sensor information. The motion data combiner is configured to determine the position of a representation of one or more of the feature in a virtual representation of the object from the combined visual information and sensor information. Various types of virtual representations may be provided from the combined information, for example, one or more poses (e.g., position and orientation) of the object may be represented.
Type:
Grant
Filed:
July 21, 2009
Date of Patent:
September 22, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Steve Sullivan, Kevin Wooley, Brett A. Allen, Michael Sanders
Patent number: 9142055
Abstract: This disclosure describes technology, which can be implemented as a method, apparatus, and/or computer software embodied in a computer-readable medium, capable of deforming internal geometry within an outer geometry to account for light bending due to refraction, for example, for real-time modeling of a gaze direction of a 3D computer generated character's eyes. In some implementations, internal eye geometry can be deformed to capture the effect of refraction in real-time such that the gaze direction of a 3D character's eyes can be modeled during an animation phase prior to a rendering phase in the production of a computer generated motion picture.
Type:
Grant
Filed:
July 1, 2011
Date of Patent:
September 22, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Jason Smith, Kiran S. Bhat
Patent number: 9123175
Abstract: An animation rig is displayed in a plurality of reference poses. The animation rig has a pose deformation in each pose. A refinement deformation for each reference pose is received. Each refinement deformation is mapped to a respective point in n-dimensional space. A complex is built in the n-dimensional space. The complex includes a mesh of simplices, each corner of each simplex associated with one of the deformations.
Type:
Grant
Filed:
June 29, 2012
Date of Patent:
September 1, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Adrian R. Goldenthal, Julien F. Cohen Bengio
Patent number: 9118902
Abstract: In one aspect, a method is performed by one or more processors. The method includes receiving a primary view image showing a scene from a view of a primary camera; depth values for one or more objects in the scene; and a camera offset between the primary camera and a secondary camera. The method further includes determining disparities for each pixel in the primary view image. The method further includes generating a secondary view image using the primary view image, the depth values, and the camera offset. At least some of the pixels are repositioned according to the determined disparities.
Type:
Grant
Filed:
July 5, 2011
Date of Patent:
August 25, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Patrick N. P. Conran, Douglas Moore, Jason Billington, Dev Mannemela
Publication number: 20150235407
Abstract: A method of applying a post-render motion blur to an object may include receiving a first image of the object. The first image need not be motion blurred, and the first image may include a first pixel and rendered color information for the first pixel. The method may also include receiving a second image of the object. The second image may be motion blurred, and the second image may include a second pixel and a location of the second pixel before the second image was motion blurred. Areas that are occluded in the second image may be identified and colored using a third image rendering only those areas. Unoccluded areas of the second image may be colored using information from the first image.
Type:
Application
Filed:
May 4, 2015
Publication date:
August 20, 2015
Applicant:
Lucasfilm Entertainment Company Ltd.
Inventors:
Victor Schutz, Patrick Conran
Publication number: 20150215623
Abstract: Systems and techniques for dynamically capturing and reconstructing lighting are provided. The systems and techniques may be based on a stream of images capturing the lighting within an environment as a scene is shot. Reconstructed lighting data may be used to illuminate a character in a computer-generated environment as the scene is shot. For example, a method may include receiving a stream of images representing lighting of a physical environment. The method may further include compressing the stream of images to reduce an amount of data used in reconstructing the lighting of the physical environment and may further include outputting the compressed stream of images for reconstructing the lighting of the physical environment using the compressed stream, the reconstructed lighting being used to render a computer-generated environment.
Type:
Application
Filed:
January 24, 2014
Publication date:
July 30, 2015
Applicant:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Michael SANDERS, Kiran BHAT, Curt Isamu MIYASHIRO, Jason SNELL, Stephane GRABLI
Patent number: 9094608
Abstract: A virtual director's viewfinder includes: a housing with a form factor of a director's viewfinder; at least one mechanical viewfinder control connected to the housing, the virtual director's viewfinder encoding a setting of the mechanical viewfinder control into digital setting information; at least one communication device for communication of the digital setting information to a computer system, and for receiving from the computer system an image generated using the digital setting information; and a display device that presents at least the image received from the computer system.
Type:
Grant
Filed:
December 30, 2010
Date of Patent:
July 28, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Kevin Wooley, Spencer Reynolds, Michael Sanders
Patent number: 9082229
Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes identifying one or more frames included in series of frames that represent a portion of an animated character. The identified one or more frames can be reconstructed from a portion of the series of frames absent the identified one or more frames. The method also includes removing the identified one or more frames from the series of frames to produce a reduced series of frames, and, transforming the reduced series of frames to produce an animation model that is capable of reconstructing the series of frames for an interactive virtual environment.
Type:
Grant
Filed:
May 10, 2011
Date of Patent:
July 14, 2015
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventor:
Jerome Scholler
Patent number: 9077961
Abstract: A device includes a plurality of vertically aligned pairs of light sources. The device is configured to sequentially illuminate the vertically aligned pairs of light sources. The output illuminating can be captured by a camera having a rolling shutter delay to create an image having a rolling shutter artifact. The image can be analyzed to determine the rolling shutter delay of the camera.
Type:
Grant
Filed:
March 14, 2013
Date of Patent:
July 7, 2015
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventor:
Jeffrey Saltzman
Patent number: 9070208
Abstract: The present disclosure includes, among other things, systems, methods, and program products for estimating radiant exitance due to subsurface scattering. For example, one or more aspects of the subject matter described in this disclosure can be embodied in one or more methods that include distributing a plurality of sample points across the surface of a 3D object model to be rendered into a 2D image and determining a solid angle subtended by a first sample point and a second sample point relative to a region on the 3D object model. Depending on the determined solid angle relative to a threshold value, a previously determined subsurface scattering contribution for the region or a newly determined subsurface scattering contribution for the region may selectively be used for rendering a portion of the 2D image.
Type:
Grant
Filed:
May 27, 2011
Date of Patent:
June 30, 2015
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Charlie A. Kilpatrick, Clifford Ramshaw
Patent number: 9035949
Abstract: Visually representing a composite graph of image functions includes providing a visual representation of a composite graph for an image, the visual representation including first items corresponding to respective image functions, and second items corresponding to containers for image functions, the image to be rendered by performing the image functions in an order defined by the composite graph. The user selects an expansion mode for presenting contents of a first container, each of the containers having a first expansion mode wherein the contents are displayed generally adjacent the visual representation, and a second expansion mode where the contents are displayed generally within the visual representation. A modified visual representation of the composite graph is provided in response to the input, wherein the modified visual representation maintains the order of the image functions defined by the composite graph and has the first container expanded according to the selected expansion mode.
Type:
Grant
Filed:
April 7, 2010
Date of Patent:
May 19, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Kent Oberheu, Piotr Stanczyk, Edward Hanway, Patrick Tubach
Publication number: 20150130801
Abstract: Among other aspects, on computer-implemented method includes: receiving at least one command in a computer system from a handheld device; positioning a virtual camera and controlling a virtual scene according to the command; and in response to the command, generating an output to the handheld device for displaying a view of the virtual scene as controlled on a display of the handheld device, the view captured by the virtual camera as positioned.
Type:
Application
Filed:
January 12, 2015
Publication date:
May 14, 2015
Applicant:
LUCASFILM ENTERTAINMENT COMPANY, LTD.
Inventors:
KEVIN WOOLEY, MICHAEL SANDERS, STEVE SULLIVAN, SPENCER REYNOLDS, BRIAN CANTWELL
Patent number: 9030477
Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes defining at least one of a location in a virtual scene and a time represented in a timeline as being associated with a performance of an animated character. The method also includes aggregating data that represents actions of the animation character for at least one of the defined location and the defined time. The method also includes presenting a user interface that includes a representation of the aggregated actions. The representation is editable to adjust at least one action included in the aggregation.
Type:
Grant
Filed:
June 24, 2011
Date of Patent:
May 12, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Adam Schnitzer, Joshua Goldenberg, Kent Oberheu, Domenico Porcino, Louise Rasmussen
Patent number: 9025902
Abstract: A method of applying a post-render motion blur to an object may include receiving a first image of the object. The first image need not be motion blurred, and the first image may include a first pixel and rendered color information for the first pixel. The method may also include receiving a second image of the object. The second image may be motion blurred, and the second image may include a second pixel and a location of the second pixel before the second image was motion blurred. The method may additionally include locating the first pixel in the first image using the location of the second pixel before the second image was motion blurred. The method may further include coloring the second pixel using the rendered color information for the first pixel.
Type:
Grant
Filed:
September 25, 2013
Date of Patent:
May 5, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Victor Schutz, Patrick Conran
Patent number: 9025007
Abstract: A computer-implemented method for configuring stereo cameras includes detecting, in a computer system, a relocation of a manipulator in a virtual set. The manipulator defined in the computer system to specify an aspect of the virtual set. The method includes receiving an input in the computer system, the input specifying an aspect of a projection environment. The method includes configuring, using the relocation and the input, first and second cameras to capture a stereo view of a scene such that the stereo view is compatible for being projected in the projection environment.
Type:
Grant
Filed:
April 28, 2009
Date of Patent:
May 5, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Jed Parsons, Arkell Rasiah, Douglas Moore, Tom Martinek
Patent number: 9002064
Abstract: A computer program product tangibly embodied in a computer-readable storage medium includes instructions that when executed by a processor perform a method. The method includes identifying a frame of a video sequence, transforming a model into an initial guess for how the region appears in the frame, performing an exhaustive search of the frame, performing a plurality of optimization procedures, wherein at least one additional model parameter is taken into account as each subsequent optimization procedure is initiated. A system includes a computer readable storage medium, a graphical user interface, an input device, a model for texture and shape of the region, the model generated using the video sequence and stored in the computer readable storage medium, and a solver component.
Type:
Grant
Filed:
November 4, 2013
Date of Patent:
April 7, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Christoph Bregler, Kiran S. Bhat, Brett A. Allen
Patent number: 9001132
Abstract: A computer-implemented method for providing retargeting of actor motion includes: receiving, in a computer system, an input generated by user selection of at least one of multiple real-time constraint scenarios, each real-time constraint scenario corresponding to a relationship between motion capture information from an actor and a position or movement of a character driven by the motion capture information; activating, based on the selected real-time constraint scenario, one or more of multiple limb solvers for the character which determines at least a first joint angle for a corresponding character limb; registering, for at least one character limb where the corresponding limb solver is not activated, a corresponding joint angle from the motion capture information as a second joint angle; and determining a root location for the character based on at least the first and second joint angles.
Type:
Grant
Filed:
December 13, 2011
Date of Patent:
April 7, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Kevin Wooley, Kiran S. Bhat, Michael Sanders
Patent number: 9001122
Abstract: A first geometry and a second geometry are accessed. They are positioned so that the first geometry and the second geometry at least in part intersect. The first geometry is divided into portions based on the intersection with the second geometry. At least a first portion of the first geometry is classified as being on one side of the second geometry. At least a second portion of the first geometry is classified as being on another side of the second geometry. At least a third portion of the first geometry is unclassified. The classifying includes comparing an angle weighted normal of a face with a property of the second geometry. The third portion is reclassified as either above the second geometry or below the second geometry according to the classification of a neighboring portion.
Type:
Grant
Filed:
August 2, 2012
Date of Patent:
April 7, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventor:
Jeffrey D. Smith
Patent number: 9003287
Abstract: Interaction between a 3D animation and a corresponding script includes: displaying a user interface that includes at least a 3D animation area and a script area, the 3D animation area including (i) a 3D view area for creating and playing a 3D animation and (ii) a timeline area for visualizing actions by one or more 3D animation characters, the script area comprising one or more objects representing lines from a script having one or more script characters; receiving a first user input corresponding to a user selecting at least one of the objects from the script area for assignment to a location in the timeline area; generating a timeline object at the location in response to the first user input, the timeline object corresponding to the selected object; and associating audio data with the generated timeline object, the audio data corresponding to a line represented by the selected object.
Type:
Grant
Filed:
November 18, 2011
Date of Patent:
April 7, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventors:
Joshua Goldenberg, Louise Rasmussen, Adam Schnitzer, Domenico Porcino, George Lucas, Brett A. Allen
Publication number: 20150084950
Abstract: Techniques for facial performance capture using an adaptive model are provided herein. For example, a computer-implemented method may include obtaining a three-dimensional scan of a subject and a generating customized digital model including a set of blendshapes using the three-dimensional scan, each of one or more blendshapes of the set of blendshapes representing at least a portion of a characteristic of the subject. The method may further include receiving input data of the subject, the input data including video data and depth data, tracking body deformations of the subject by fitting the input data using one or more of the blendshapes of the set, and fitting a refined linear model onto the input data using one or more adaptive principal component analysis shapes.
Type:
Application
Filed:
December 26, 2013
Publication date:
March 26, 2015
Applicant:
LucasFilm Entertainment Company Ltd.
Inventors:
Hao LI, Jihun YU, Yuting YE, Christoph BREGLER
Publication number: 20150084991
Abstract: A method of applying a post-render motion blur to an object may include receiving a first image of the object. The first image need not be motion blurred, and the first image may include a first pixel and rendered color information for the first pixel. The method may also include receiving a second image of the object. The second image may be motion blurred, and the second image may include a second pixel and a location of the second pixel before the second image was motion blurred. The method may additionally include locating the first pixel in the first image using the location of the second pixel before the second image was motion blurred. The method may further include coloring the second pixel using the rendered color information for the first pixel.
Type:
Application
Filed:
September 25, 2013
Publication date:
March 26, 2015
Applicant:
LUCASFILM ENTERTAINMENT COMPANY, LTD.
Inventors:
VICTOR SCHUTZ, PATRICK CONRAN
Patent number: 8988435
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are disclosed for animations that simulate skin deformation relative to a muscle. Displacement of a skin representation in response to deformation of a muscle representation and sliding of the skin representation over the deformed muscle representation can be determined quickly and interactively by monitoring changes in position and scale of defining ring elements of the muscle representation's geometry. The determined in displacements can be constrained to prevent portions of the displaced skin representation from sinking into the underlying muscle representation's geometry.
Type:
Grant
Filed:
September 6, 2013
Date of Patent:
March 24, 2015
Assignee:
Lucasfilm Entertainment Company Ltd.
Inventor:
Julien F. Cohen Bengio
Publication number: 20150077418
Abstract: In one general aspect, a method is described. The method includes generating a positional relationship between one or more support structures having at least one motion capture mark and at least one virtual structure corresponding to geometry of an object to be tracked and positioning the support structures on the object to be tracked. The support structures has sufficient rigidity that, if there are multiple marks, the marks on each support structure maintain substantially fixed distances from each other in response to movement by the object. The method also includes determining an effective quantity of ray traces between one or more camera views and one or more marks on the support structures, and estimating an orientation of the virtual structure by aligning the determined effective quantity of ray traces with a known configuration of marks on the support structures.
Type:
Application
Filed:
November 21, 2014
Publication date:
March 19, 2015
Applicant:
LUCASFILM ENTERTAINMENT COMPANY, LTD.
Inventors:
Steve Sullivan, Colin Davidson, Michael Sanders, Kevin Wooley
Publication number: 20150062863
Abstract: A movie set can include light sources each producing a light corresponding to a light channel, at least one high-frame rate camera, and a controller connected to the light sources and camera to synchronize the camera and light sources. The number of light channels can be proportional to the frame rate. For example, if the filming frame rate is 120 frames per second (fps) and the playback frame rate is 24 fps, then 5 light channels can be used. In this example, for every one playback frame, 5 frames were filmed by the high frame rate camera. The controller modulates the light channels such that each of the 5 frames has different lighting characteristics. In post-production, contributions from each of the light channels can be included or excluded from the final frame. An optical flow algorithm can be used to stitch together frames with different dynamic light characteristics.
Type:
Application
Filed:
September 5, 2013
Publication date:
March 5, 2015
Applicant:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventors:
Kim Libreri, Curt Miyashiro
Patent number: 8970592
Abstract: A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes obtaining first data corresponding to a first simulation of matter in a space domain. The method also includes performing, using the first data, a second simulation that produces second data representative of particles in the space domain. The method also includes rasterizing the second data representative of the particles as defined by cells of a grid, wherein each cell has a common depth-to-size ratio, and, rendering an image of the particles from the rasterized second data.
Type:
Grant
Filed:
April 19, 2011
Date of Patent:
March 3, 2015
Assignee:
Lucasfilm Entertainment Company LLC
Inventor:
Frank Losasso Petterson
Patent number: 8964052
Abstract: Among other aspects, on computer-implemented method includes: receiving at least one command in a computer system from a handheld device; positioning a virtual camera and controlling a virtual scene according to the command; and in response to the command, generating an output to the handheld device for displaying a view of the virtual scene as controlled on a display of the handheld device, the view captured by the virtual camera as positioned.
Type:
Grant
Filed:
December 30, 2010
Date of Patent:
February 24, 2015
Assignee:
LucasFilm Entertainment Company, Ltd.
Inventors:
Kevin Wooley, Michael Sanders, Steve Sullivan, Spencer Reynolds, Brian Cantwell
Patent number: D751627
Type:
Grant
Filed:
September 30, 2014
Date of Patent:
March 15, 2016
Assignee:
LUCASFILM ENTERTAINMENT COMPANY LTD.
Inventor:
Paige Warner