Abstract: A mapping system receives sensor data from an unmanned aerial vehicle. The mapping system further receives images from a camera of the unmanned aerial vehicle. The mapping system determines an altitude of the camera based on the sensor data. The mapping system calculates a footprint of the camera based on the altitude of the camera and a field of view of the camera. The mapping system constructs a localized map based on the images and the footprint of the camera.

Abstract: A spherical image capture device may include two lenses, which may be protected by lens covers. During capture of visual content, usage of the lens covers may be checked to determine whether one or both of the lenses are covered by lens covers. Based on one or both of the lenses being covered by lens covers, an alarm may be generated to notify the user about the lens covers.

Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.

Abstract: Systems and methods are disclosed for replaceable outer lenses for use in water. For example, an image capture device may include a lens barrel in a body of the image capture device; a replaceable lens structure mountable on the body of the image capture device, the replaceable lens structure including a first set of two or more stacked lenses, including a first outer lens, and a first retaining ring configured to fasten the first set of two or more stacked lenses against a first end of the lens barrel in a first arrangement, wherein the first set of two or more stacked lenses is configured to collimate light incident on the first outer lens when the first outer lens is underwater at an interface between the lens barrel and the first replaceable lens structure; and an image sensor mounted within the body at a second end of the lens barrel.

Abstract: Image analysis includes obtaining, from an image signal processor, image processing information corresponding to a previously processed image, obtaining scene classification information for an input image based on the image processing information, generating a processed image by processing the input image based on the scene classification information, and outputting the processed image. The image processing information includes automatic white balance correction information and obtaining the scene classification information includes obtaining the scene classification information based on the automatic white balance correction information.

Abstract: Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.

Abstract: An image capture device may include a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

Abstract: An image capture device may include an image sensor configured to capture an image and processing apparatus. The processing apparatus may be configured to obtain data and associate a function for each of the obtained data. The processing apparatus may be configured to store each function instance as analytic data. The processing apparatus may determine an analytic trigger occurrence and determine if the analytic trigger occurrence is greater than a function instance threshold. The processing apparatus may be configured to display a notification based on the analytic data.

Abstract: A first portion of a first video segment may be obtained from a user. A second portion of a second video segment may be obtained from the user. The first portion and the second portion may be aggregated to form an aggregated video segment. A first set of capture settings associated with capture of the first portion may be obtained. A second set of capture settings associated with capture of the second portion may be obtained. Preferences for capture settings of an image capturing device may be determined based upon the first and second set of capture settings. Instructions may be transmitted to the image capturing device. The instructions may include the determined preferences for the capture settings and may be configured to cause the image capturing device to adjust the capture settings to the determined preferences.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences change in position during the capture duration. The trajectory of the image capture device is smoothed based on a look ahead of the trajectory. A punchout of the visual content is determined based on the smoothed trajectory. The punchout of the visual content is used to generate stabilized visual content.

Abstract: A pipeline in a controller may be configured to interface between sensors and actuators. The pipeline may include elements such as drivers, filters, a combine, estimators, controllers, a mixer, and actuator controllers. The drivers may receive sensor data and pre-process the received sensor data. The filters may filter the pre-processed sensor data to generate filtered sensor data. The combine may package the filtered sensor data to generate packaged sensor data. The estimators may determine estimates of a position of a vehicle based on the packaged sensor data. The controllers may generate control signals based on the determined estimates. The mixer may modify the generated control signals based on limitations of the vehicle. The actuator controllers may generate actuator control signals based on the modified control signals to drive the actuators.

Abstract: Video information defining video content may be obtained. The video content may include video frames and may have a progress length. The video frames may be encoded into video packets, with the video packets being of particular sizes. One or more size criteria for detecting a given moment within the video content may be obtained. The sizes of the video packets may be compared with the one or more size criteria. One or more sets of the video packets that satisfy the one or more size criteria may be identified. One or more portions of the video content having video frames defined by the set(s) of video packets that satisfy the one or more size criteria may be identified as the given moment within the video content. Storage of the identification of the given moment within the video content in a storage medium may be effectuated.

Abstract: A multi-configuration mounting system has been disclosed. The multi-configuration mounting system comprises an adapter configured to couple to a first device, and a receptacle defining an opening within a surface of the adapter. The receptacle receives a tab of a clip housing that secures a second device, thereby forming an interference fit between the tab and the receptacle to couple the second device to the first device via the adapter.

Abstract: An image capture device may include an image sensor, a processor, and a memory. The image sensor may be configured to obtain an image. The processor may be configured to generate a grid on the image. The grid may include one or more vertices. The one or more vertices may be used to form tiles. The processor may be configured to determine a flare level of each vertex. The processor may be configured to assign a maximum flare level for each tile of the image. The processor may be configured to sort the tiles. The tiles may be sorted based on the maximum flare level of each tile. The processor may be configured to apply a flare compensation to a subset of the tiles to obtain a processed image. The processed image may have reduced flare artifacts or no flare artifacts. The processed image may be stored in the memory.

Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.

Abstract: Disclosed is a configuration to control automatic return of an aerial vehicle. The configuration stores a return location in a storage device of the aerial vehicle. The return location may correspond to a location where the aerial vehicle is to return. One or more sensors of the aerial vehicle are monitored during flight for detection of a predefined condition. When a predetermined condition is met a return path program may be loaded for execution to provide a return flight path for the aerial vehicle to automatically navigate to the return location.

Abstract: A camera system includes a lens assembly and image processing electronics internal to the camera housing and thermally coupled to the battery assembly. The battery assembly is sensitive to low ambient temperatures and may become damaged if the temperature of the assembly becomes sufficiently low. The camera system comprises a thermal management system that dissipates heat from electronic components of the camera to increase or maintain the temperature of the battery assembly. The thermal management configures the electronic components in different modes to create a step-wise increase of the resistive heat generated in the camera system and thereby increase the temperature of the components in the camera system.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.

Abstract: Methods and apparatus for instant capture of content are described. A method may include placing an image capture device in an aware state and capturing aware state data. The aware state may include enabling low power sensors or entering the image capture into an event mode. A content capture opportunity is automatically determined from the captured aware state data. The aware state data may be image information and a classifier classifies the image information. The aware state data may be position data for the image capture device and when the image capture device is in a capture position, the image capture device may instantly capture image information. An image capture device mode is automatically selected for the content capture opportunity and content is automatically captured with the selected image capture device mode.

Abstract: An electronic device includes a body, electronic components contained in the body, and two finger members. The two finger members movable relative to the body between an extended state and a collapsed state. In the extended state, the two finger members extend outward from the body for receipt by a mount of an external support. In the collapsed state, the two finger members are collapsed toward the body. In the extended state, the two finger members may extend parallel with each other for receipt in parallel slots of the mount of the external support.

Abstract: A viewing window for a spherical video may define which extents of the spherical video are viewable. Abrupt changes in the extents defined by the viewing window may result in non-smooth views of the spherical video, such as stagger, jitter, and/or other jerky motions being included in the views of the spherical video. Changes in the extents defined by the viewing window may be smoothed to provide smoother views of the spherical video.

Abstract: A system and/or method configured to determine highlight segments. Content files that define content in a content segment set may be obtained. A highlight segment set may be determined from the content segment set. Determining the highlight segment set may include iterating (a)-(c) for multiple iterations. At (a), individual content segments included in the content segment set may be selected as a selected content segment for inclusion in the highlight segment set. At, (b) diversity scores for content segments that are (i) included in the content segment set and (ii) not yet selected for inclusion in the highlight segment set may be determined. At (c), one or more of the content segments may be disqualified for inclusion in the highlight segment set for future iterations based on the diversity scores.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include determining a sequence of orientation estimates based on sensor data from one or more motion sensors; based on the sequence of orientation estimates, invoking a mechanical stabilization system to reject motions of an image sensor occurring within a first operating bandwidth with an upper cutoff frequency; receiving an image from the image sensor; based on the sequence of orientation estimates, invoking an electronic image stabilization module to correct the image for rotations of the image sensor occurring within a second operating bandwidth with a lower cutoff frequency to obtain a stabilized image, wherein the lower cutoff frequency is greater than the upper cutoff frequency; and storing, displaying, or transmitting an output image based on the stabilized image.

Abstract: An image capture device may capture video frames while experiencing motion. The video frames may be stored in a visual track, and rotational positions of the image capture device may be stored in a rotational position track. The visual track and the rotational position track may not be temporally aligned. A looping stabilized view of the view frames and a synchronization adjustment option may be presented on a display. The synchronization adjustment option may enable user modification of timing of the rotational positions stored within the rotational position track. Timing modification of the rotational positions may cause changes in the looping stabilized view, which may be used as feedback on whether the synchronization between the visual track and the rotational position track is being improved or not by the timing modification of the rotational positions.

Abstract: Disclosed is an electronic gimbal with camera and mounting configuration. The gimbal can include an inertial measurement unit which can sense the orientation of the camera and three electronic motors which can manipulate the orientation of the camera. The gimbal can be removably coupled to a variety of mount platforms, such as an aerial vehicle, a handheld grip, or a rotating platform. Moreover, a camera can be removably coupled to the gimbal and can be held in a removable camera frame. Also disclosed is a system for allowing the platform, to which the gimbal is mounted, to control settings of the camera or to trigger actions on the camera, such as taking a picture, or initiating the recording of a video. The gimbal can also provide a connection between the camera and the mount platform, such that the mount platform receives images and video content from the camera.

Abstract: A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.

Abstract: A method for a zero shutter-lag (ZSL) mode of an image capture device includes, in response to detecting a first event indicative of the ZSL mode, setting the image capture device to the ZSL mode. Setting the image capture device to the ZSL mode includes setting a sensor of the image capture device to a first resolution that is higher than a second resolution of a non-ZSL mode, and setting a timer to expire after a predefined period. The method also includes, in response to the timer expiring after the predefined period, setting the image capture device to the non-ZSL mode. The non-ZSL mode cancels the ZSL mode.

Abstract: An image capture device is disclosed that includes: a body; first and second image capture devices supported within the body so as to define respective, overlapping first and second fields-of-view; and a thermal spreader. The first image capture device includes a first integrated sensor-lens assembly (ISLA) with a first image sensor and a first lens, and the second image capture device includes a second ISLA with a second image sensor and a second lens. The first lens faces in a first direction, and is positioned to receive and direct light onto the first image sensor, and the second lens faces in a second direction, and is positioned to receive and direct light onto the second image sensor, wherein the second direction is generally opposite to the first direction. The thermal spreader extends between, and is connected to, the first and second ISLAs, and is configured to transfer heat therebetween.

Abstract: Implementations of the present disclosure are generally directed to receiving, a plurality of items of digital content from one or more data sources associated with a user, providing a plurality of clusters of digital content, each cluster including one or more items of digital content of the plurality of items of digital content, for a cluster: determining a goodness measure for each item of digital content within the cluster, the goodness measure being at least partially based on metadata associated with a respective item of digital content, and selecting at least one item of digital content from the cluster for inclusion in the media presentation, and providing the media presentation for display on a computing device of the user, the media presentation including the at least one item of digital content.

Abstract: An image capture device may switch operation between a spherical capture mode or a non-spherical capture mode. Operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on the visual content generated by multiple image sensors. Operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content based on visual content generated by a single image sensor.

Abstract: Video content may be captured by an image capture device during a capture duration. The video content may include video frames that define visual content viewable as a function of progress through a progress length of the video content. Rotational position information may characterize rotational positions of the image capture device during the capture duration. Time-lapse video frames may be determined from the video frames of the video content based on a spatiotemporal metric. The spatiotemporal metric may characterize spatial smoothness and temporal regularity of the time-lapse video frames. The spatial smoothness may be determined based on the rotational positions of the image capture device corresponding to the time-lapse video frames, and the temporal regularity may be determined based on moments corresponding to the time-lapse video frames. Time-lapse video content may be generated based on the time-lapse video frames.

Abstract: First video information defining first video content may be accessed. The first video content may have been captured by a first image sensor from a first conveyance position. Second video information defining second video content may be accessed. The second video content may have been captured by a second image sensor from a second conveyance position. A first highlight criterion may be selected for the first video content based on the first conveyance position. A second highlight criterion may be selected for the second video content based on the second conveyance position. A first set of highlight moments within the first video content may be identified based on the first criterion. A second set of highlight moments within the second video content may be identified based on the second criterion. The identification of the first set of highlight moments and the second set of highlight moments may be stored.

Abstract: Systems and methods are disclosed for reducing unwanted noise during image capture. The noise may be airborne or structure-borne. For example, airborne sound may be sound that is emitted from a motor of a motorized gimbal into the air, which is then detected by a microphone of an imaging device along with the desired sound. Structure-borne noise may include vibrations from the motor that reach the microphone. Structure-borne noise may lead to local acoustic pressure variation by the microphone or pure vibration of the microphone.

Abstract: A gimbal sleeve for connecting to a camera gimbal may float between a floor surface and a ceiling surface of an aerial vehicle chassis such that the gimbal sleeve has freedom of motion in yaw, pitch, and roll directions relative to the vehicle chassis. The gimbal sleeve may comprise a pair of connection points to the lower dampers on a floor surface of the vehicle chassis. The gimbal sleeve may furthermore comprise a ball joint coupled to a back surface of the vehicle chassis. The connection points include spring forces that enable the gimbal sleeve to return to an equilibrium position in response to external vibrations and reduce the magnitude of vibrations transferred from the aerial vehicle to the gimbal and camera systems.

Abstract: Disclosed is an aerial vehicle. The aerial vehicle may include a removable battery. Various embodiments of removable battery assemblies include a pull-bar battery assembly, a latch battery assembly, and a lever battery assembly. The aerial vehicle may also include a propeller locking mechanism to which propellers may be removably coupled. The propeller locking mechanism may obviate the need for tools for coupling or decoupling propellers to the aerial vehicle. Vents in the arm of the aerial vehicle may provide an air pathway, providing convective cooling for the electronics aerial vehicle.

Abstract: Implementations disclosed herein include an image capture device, a system, and a method for performing multiscale denoising of an image. An image processor of the image capture device obtains a first image. The first image may be in any format and may include noise artifacts. The image processor decomposes the first image into one or more sub-images. The sub-images may range from a coarse scale to a fine scale. In some implementations, the image processor iteratively denoises each of the one or more sub-images from the coarse scale to the fine scale. The image processor reconstructs the one or more denoised sub-images to produce a denoised image. A memory of the image capture device may be configured to store the denoised image.

Abstract: A motor controller of an unmanned aerial vehicle (UAV) is optimized to improve operation of the UAV. The motor control optimizations include controlling a motor of a UAV to reduce an operating temperature of the UAV, reducing an amount of latency or jitter resulting from motor operation, and applying a smoothing filter for motor operation. For example, controlling a motor of a UAV to reduce an operating temperature of the UAV can include using a temperature model for the unmanned aerial vehicle or an operating temperature measurement to determine a current operating temperature and comparing that current operating temperature to a threshold. If the threshold is exceeded, settings of the motor are adjusted to cause the motor to operate in a manner that reduces the current operating temperature.

Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

Abstract: A camera system includes a camera and an underwater housing. The underwater housing, when submerged underwater, causes refraction of light entering the camera, thereby affecting focus. The camera includes a lens assembly adjustable between a first secured position at a first distance from an image sensor to enable the camera to capture images that are in focus when the camera is outside of water. The lens assembly is adjustable to a second secured position at a second distance from the image sensor to enable the camera to capture images that are in focus when the camera operates within the underwater housing and submerged under water.

Abstract: A method and system for configuring a USB3 input/output port in a camera are disclosed. The method comprises responsive to an indication that a peripheral device is a non-USB3 device, remapping pins of the USB3 input/output port to a first predefined port configuration associated with an I2C protocol by remapping a RX1? pin to communicate a first I2C signal and remapping a RX1+ pin to communicate a second I2C signal, and responsive to successful authentication between the camera and the peripheral device via the I2C protocol, enabling communication with the peripheral device and remapping the pins of the USB3 input/output port to a second predefined port configuration compatible with operation of the authenticated peripheral device by remapping a TX2+ pin to communicate a first general purpose input/output signal and remapping a TX2? pin to communicate a second general purpose input/output signal.

Abstract: An image or a video may include a spherical capture of a scene. A punchout of the image or the video may provide a panoramic view of the scene.

Abstract: Image captured with an image capture device with a rolling shutter may be deformed due to changes in imaging sensor orientation during image capture. Image deformities may occur due to rolling shutter that exposes rows of pixels to light at slightly different times during image capture. Deformities such as wobble, for example, and/or other deformities may be corrected by constructing an output image. The output image may be constructed by determining corresponding pixels within the input image. The location of the input pixel may be determined by performing one or more fixed point iterations to identify one or more input pixels within the input image. A value of the output pixel within the output image may be determined based on a value of a corresponding pixel within the input image.

Abstract: Multiple lookup tables (LUTs) storing different numbers of control point values are used to process pixels within different blocks of an image, such as after image processing using tone mapping and/or tone control, and/or to collect histogram information or implement 3D LUTs. First control point values stored within a first LUT are applied against pixels of a given block of an image to produce a distorted image block. Second control point values stored within a second lookup table are applied against a pixel of the distorted image block to produce a processed pixel. The second LUT is one of a plurality of second LUTs and stores fewer values than the first LUT. A processed image is produced using the processed pixel. The processed image is then output for further processing or display.

Abstract: Systems and method of identifying a horizon depicted in an image are presented herein. Information defining an image may be obtained. The image may include visual content comprising an array of pixels. The array may include pixel rows. Parameter values for a set of pixel parameters of individual pixels of the image may be determined. Individual average parameter values of the individual pixel parameters of the pixels in the individual pixel rows may be determined. Based on the average parameter values a pixel row may be identified as depicting a horizon in the image.