Abstract: Electronic information defining visual content within video frames may be accessed. Video frames may be ordered in a source sequence. Positions in the source sequence may be associated with playback directions. Video frames may be ordered in a playback sequence based on the playback directions. The playback sequence may characterize a playback order in which video frames are displayed during playback. Video frames in the playback sequence may be associated with playback speeds. The playback speeds may determine perceived speeds with which visual content is displayed during playback. Speed ramped video frames may be determined based on the playback sequence and the playback speeds. A speed ramped video may be generated based on the speed ramped video frames.

Abstract: An image capture device comprises a housing defining a cavity and a cover enclosing the cavity. The cover includes a user interface that receives a user input to the image capture device. The image capture device includes a support member extending into the cavity between the housing and the cover and a receiving member having a receptacle that receives a distal end of the support member. Contact between the support member and the receptacle prevents movement of the user interface beyond a predetermined threshold when the image capture device is under hydrostatic pressure.

Abstract: Systems and methods are disclosed for denoising chrominance channels of images. For example, methods may include receiving an image from one or more image sensors; determining a set of weights for the image based on a luminance channel of the image, wherein a weight in the set of weights corresponds to a subject pixel and a candidate pixel and is determined based on luminance values of one or more pixels of the image centered at the subject pixel and one or more pixels of the image centered at the candidate pixel; applying the set of weights to chrominance channels of the image to obtain a denoised image, wherein the subject pixel of the denoised image is determined based on the weight multiplied by the candidate pixel of the image; and storing, displaying, or transmitting an output image based on the denoised image.

Abstract: Apparatus and methods for projection conversion decoding for applications eco-systems are disclosed. In one embodiment, a decoder apparatus is utilized to read formatting information from an intermediate projection format; convert the intermediate projection format to a display projection format; apply a rotation operation to the display projection format in accordance with the reading of the formatting information; and transmit the display projection format for use by an application. In some implementations, the intermediate projection format has been stabilized prior to encoding in order to improve upon the encoding efficiency for the intermediate projection format. The application of the rotation operation may then be utilized to reverse the stabilized imaging data. Methods and computing systems are also disclosed.

Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.

Abstract: An image capture device may capture visual content using a capture setting. A machine-readable optical code conveying the capture setting may be generated. The machine-readable optical code may convey the capture setting such that an image capture device capturing an image including the machine-readable optical code: (1) identifies the machine-readable optical code within the image; (2) determines the capture setting conveyed by the machine-readable optical code; and (3) stores the capture setting for use in visual content capture. A graphical user interface may enable a user to associate the machine-readable optical code with the visual content. The association of the machine-readable optical code with the visual content may cause subsequent presentation of the visual content to include presentation of the machine-readable optical code.

Abstract: An image capture device may include an image sensor, a processor, and a memory. The image sensor may be configured to obtain an image. The processor may be configured to generate a grid on the image. The grid may include one or more vertices. The one or more vertices may be used to form tiles. The processor may be configured to determine a flare level of each vertex. The processor may be configured to assign a maximum flare level for each tile of the image. The processor may be configured to sort the tiles. The tiles may be sorted based on the maximum flare level of each tile. The processor may be configured to apply a flare compensation to a subset of the tiles to obtain a processed image. The processed image may have reduced flare artifacts or no flare artifacts. The processed image may be stored in the memory.

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

Abstract: A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise be required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load.

Abstract: Systems and methods are disclosed for image signal processing. For example, systems may include an image sensor and a processing apparatus. The image sensor captures image data using a plurality of selectable exposure times. The processing apparatus receives a first image from the image sensor captured with a first exposure time and receives a second image from the image sensor captured with a second exposure time that is less than the first exposure time. A high dynamic range image is determined based on the first image and the second image, wherein an image portion of the high dynamic range image is based on a corresponding image portion of the second image when a pixel of a corresponding image portion of the first image is saturated. An output image that is based on the high dynamic range image is stored, displayed, or transmitted.

Abstract: A remapping space may define correspondence between times within a video and times within a time-remapped video. Responsive to user selection of a moment within the video for initiation of time remapping using a selected playback speed, a start point and an end point may be inserted at the selected moment within the remapping space. Responsive to user selection of a segment within the video to apply the selected playback speed in the time remapping, the start point and/or the end point may be moved to change the correspondence between times within the video and times within the time-remapped video.

Abstract: An image capture device with dynamic wind noise compression tuning techniques is described. A technique includes detecting of the presence of wind noise by measuring coherence between at least two microphones. For a compressor, adjusting a default compression threshold and default compression parameters based on the coherence measurements. For each microphone, applying by the compressor the adjusted compression parameters when an audio signal is above the adjusted compression threshold and applying the default compression parameters when the audio signal is below the adjusted compression threshold.

Abstract: A highlight moment within a video, music to accompany a looping presentation of the video, and a looping effect for the video may be determined. A segment of the video to be used for the looping presentation of the video may be selected based on highlight moment, the music, and the looping effect. The looping presentation of the video may be generated to have the segment edited based on a style of the looping effect and to include accompaniment of the music.

Abstract: A video, such as a spherical video, may include motion due to motion of one or more image capture devices during capture of the video. Motion of the image capture devices during the capture of the video may cause the playback of the video to appear jerky/shaky. The video may be stabilized by using both a horizontal feature and a fixed feature captured within the video.

Abstract: A video may include a capture of a scene, such as a wide-field of view capture of the scene. Context of the video may be assessed and used to suggest framing of the video.

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include determining a sequence of orientation estimates based on sensor data from one or more motion sensors; based on the sequence of orientation estimates, invoking a mechanical stabilization system to reject motions of an image sensor occurring within a first operating bandwidth with an upper cutoff frequency; receiving an image from the image sensor; based on the sequence of orientation estimates, invoking an electronic image stabilization module to correct the image for rotations of the image sensor occurring within a second operating bandwidth with a lower cutoff frequency to obtain a stabilized image, wherein the lower cutoff frequency is greater than the upper cutoff frequency; and storing, displaying, or transmitting an output image based on the stabilized image.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.

Abstract: A camera housing includes four walls configured to enclose and secure a camera: a top wall, a bottom wall, a right wall, and a left wall. The bottom wall includes a first segment and a segment coupled by a latching mechanism. The latching mechanism comprises a tongue component coupled to the second segment and a groove component coupled to the first segment. The tongue and groove components are configured such that the tongue component securely couples the second segment to the first segment when the camera frame is in the closed configuration. In the open configuration, the first and second segment can decouple and the left wall and second segment rotates upwards relative to the top wall such that a camera can be inserted or removed from the camera system. The camera housing also includes a button interface, an input/output interface, and a mounting mechanism.

Abstract: Implementations of a mobile platform for image capture device control may use voice recognition. A user may use a mobile platform, such as a mobile application, on a mobile device to interpret and relay voice commands to an image capture device. Voice recognition services may be integrated into the mobile application, the mobile device operating system (OS), or both. The voice recognition services may be server-based.

Abstract: Auto exposure metering is adapted for spherical panoramic content. Using input image data, a first metering map is generated for a selected image sensor and a second metering map is generated for an unselected image sensor. Auto exposure level values for the selected image sensor and for the unselected image sensor are respectively metered using the first metering map and the second metering map, such as by adjusting luminance weights in certain locations of the respective image sensor panoramic image capture band. Hemispherical images are processed using the auto exposure metered level values and stitched together in a panoramic format to produce a spherical panoramic image. The metering maps are generated to account for areas of greatest image data importance relative to a primary orientation direction of the spherical panoramic image. This allows for effective auto exposure metering of such areas within the resulting spherical panoramic image.

Abstract: An aerial vehicle comprises one or more sensors to environmental data, a communication system to receive control inputs from a user, two or more actuators, with each actuator coupled to a rotary wing. The aerial vehicle also comprises a controller to determine a mode of the aerial vehicle based on the environmental data and the control inputs, each mode indicating a set of flight characteristics for the aerial vehicle, generate a gain value based on the mode, the gain value, when used to modify power signals transmitted to actuators of the aerial vehicle, causing the aerial vehicle to conform within the indicated flight characteristics of the determined mode, generate an output signal modified by the gain value based on the input signal, and transmit a power signal based on the output signal to each actuator of the aerial vehicle.

Abstract: A camera is configured with multiple microphones to reduce wind noise in audio data collected by the camera. The camera receives motion data, which may comprise data indicating acceleration of the camera, a plurality of video frames received by the camera, or a background level of noise associated with one or more microphones configured on the camera. The camera determines a motion vector from the motion data. The motion vector is parallel to the direction of motion of the camera. The camera selects a subset of one or more microphones in the direction of the motion vector. By recording audio data using the one or more selected microphones, the camera reduces wind noise in the audio data.

Abstract: This disclosure describes systems and methods for a multipoint cable cam (MPCC) of an aerial vehicle. A method includes operations of receiving user input associated with a predetermined path and correlating the received user input with stored global positioning satellite (GPS) data to generate one or more virtual waypoints along the predetermined path. The method includes processing the one or more virtual waypoints to generate a spline-based flight path. The method may include storing the spline-based flight path and transmitting the spline-based flight path to the aerial vehicle.

Abstract: Visual content is captured by an image capture device during a capture duration. The image capture devices experiences change in position during the capture duration. The trajectory of the image capture device is smoothed based on a look ahead of the trajectory. A punchout of the visual content is determined based on the smoothed trajectory. The punchout of the visual content is used to generate stabilized visual content.

Abstract: An image capture device may include a touchscreen display, which may be used to receive user input. The image capture device may determine whether it is under water based on analysis of visual content captured by the image capture device. Responsive to determination that it is under water, the image capture device may change operation with respect to the touchscreen display.

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

Abstract: A wearable imaging device is disclosed. The wearable imaging device includes a frame defining openings aligned to a user's field of view when in a wearable position and a pair of temple arms each extending from one end of the frame and moveable between the wearable position and a folded position. The wearable imaging device includes lenses within the openings of the frame, an imaging unit coupled to the frame and comprising an imaging lens that captures light through at least one of the lenses, an electronics unit coupled to the frame and in communication with the imaging unit, a power source coupled to the frame and providing power to the imaging unit and to the electronics unit, and an input/output module coupled to at least one of the imaging unit, the electronics unit, or the power source that includes a communications interface for communicating with external devices.

Abstract: Panoramic content may be characterized by a wide field of view and large image size. Panoramic image may be mapped to cube projection. When encoding/decoding cube-projected images, the disclosure exploits content continuity between cube facets. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained, for example, one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remained facets of the cube may be encoded using transformed versions within the augmented image. Boundary filtering may be applied to one or more edges of one or more facets.

Abstract: Images may be captured by a moving image capture device. A reference image and a background image may be selected from the images. The reference image may include depiction of an object, with the object blocking view of the background. The background image may include depiction of the background blocked by the object in the reference image. An object layer may be generated by segmenting the depiction of the object from the reference image. A background layer may be generated by combining the depiction of the background in the background image with the reference image. The background layer may be blurred and combined with the object layer to generate a panning image.

Abstract: An image capture device may provide framing recommendations for capture of visual content. Framing recommendation may include information on how one or more subjects are to be positioned with respect to the image capture device. Framing recommendation may guide a user in how the image capture device and/or the subject(s) are to be positioned. Framing recommendation may include suggestions on orientation of the image capture device with respect to the subject(s) to improve composition of the subject(s) within the visual content. The image capture device may provide these aforementioned framing recommendations visually, audibly, and/or through other means. For example, the image capture device may provide framing recommendations in form of visual overlays/directional graphs and/or audible instructions (e.g., directions on subject/image capture device positioning provided through a speaker of the image capture device). Framing recommendation may be static (not changing over time) or dynamic (changing over time).

Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.

Abstract: Methods and apparatus for blending unknown pixels in overlapping images. In one embodiment, an action camera captures two hyper-hemispherical fisheye images that are stitched to a 360° panorama. In order to remove exposure differences between the two cameras, the images are pre-processed prior to multiband blending. The pre-processing leverages image information from pixels to make informed guesses about pixels that were not captured. In particular, various pixels with different knowability (e.g., known, unknown, consistent, and conflicting) may be handled differently so as to emphasize/de-emphasize their importance in pre-processing.

Abstract: Visual content may be captured by an image capture device during a capture duration. The rotational positions of the image capture device may change during the capture duration. The rotational positions of the image capture device may be smoothed based on a look ahead of a rotation constraint. A punchout of the visual content may be determined based on the smoothed rotational positions. The punchout of the visual content may be used to generate stabilized visual content.

Abstract: A camera detects devices, such as other cameras, smart devices, and access points, with which the camera may communicate. The camera may alternate between operating as a wireless station and a wireless access point. The camera may connect to and receive credentials from a device for another device to which it is not connected. In one embodiment, the camera is configured to operate as a wireless access point, and is configured to receive credentials from a smart device operating as a wireless station. The camera may then transfer the credentials to additional cameras, each configured to operate as wireless stations. The camera and additional cameras may connect to a smart device directly or indirectly (for instance, through an access point), and the smart device may change the camera mode of the cameras. The initial modes of the cameras may be preserved and restored by the smart device upon disconnection.

Abstract: Multiple video clips may be selected for use in generating a video edit. A graphical user interface for editing the multiple video clips may include a combined progress length element. The combined progress length element may visually represent combined progress length of the multiple video clips.

Abstract: A graphical user interface for setting speed and direction of video playback may include a timeline representation of video duration. Playback speed and playback direction from a selected point of the video may be determined based on user interaction with the graphical user interface. A portion of the video to which the selected playback speed and selected playback direction is applied may be determined based on user movement of the timeline representation.

Abstract: A camera housing includes a main body having four sides that form a cavity to receive a camera, a door detachably coupled to the main body, and an exposed area in the main body allowing a user to manipulate a button on the camera or access an I/O or microphone interface of the camera. The camera housing includes an indicator window substantially aligning with a visible indicator on the camera, a latch detachably securing a first side of the door to a first side of the main body; and a hinge coupling a second side of the door to a second side of the main body. The camera housing includes securing protrusions that interlock with corresponding mounting protrusions extending from a camera mount. A front face and a rear face of the camera are exposed when the camera is secured by the door in the camera housing.

Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.

Abstract: Video information defining video content to be encoded may be obtained. Scene composition information for the video content may be obtained. The scene composition information may be determined by a convolutional neural network based on visuals represented within the video content. The video content may be encoded based on the scene composition information. The encoding of the video content may generate encoded video information defining the encoded video content.

Abstract: Automated camera mode selection using local motion vectors is described. An image capture device includes an image metric estimation unit to detect a presence or level of an image metric in a scene of an image to capture based on image metric inputs, a motion estimation unit to determine a level of movement within the scene using ratios of histograms based on local motion vectors, a mode selection unit to select a camera mode for capturing the image based on outputs of the image metric estimation unit and the motion estimation unit, and an image sensor to capture the image according to the selected camera mode. The motion estimation unit computes a norm for each local motion vector, generates a histogram from the computed norms, determines movement metrics based on the ratios of histograms associated with different norm thresholds, and identifies the level of movement based on the movement metrics.

Abstract: A method and apparatus for denoising a video are disclosed. The method includes obtaining multiple frames of the video. One or more frames of the video may be temporally precedent or temporally subsequent to a central frame. The method includes performing a first denoising of the multiple frames. The method includes concatenating the denoised frames into a concatenated input. The method includes performing a second denoising of the concatenated input. The method includes outputting a denoised frame based on the denoised concatenated input.

Abstract: An image capture device may include a microphone, a vibration sensor, and a processor. The microphone may obtain a microphone signal that includes an acoustic signal portion and a mechanical noise portion. The vibration sensor may obtain a vibration signal. The processor may upsample the vibration signal. The processor may determine a correlation value. The correlation value may be based on the microphone signal, the upsampled vibration signal, or both. The processor may determine filter coefficients. The filter coefficients may be determined on a condition that the correlation value is above a threshold. The filter coefficient may be based on the upsampled vibration signal. The processor may filter the vibration signal based on the filter coefficients to remove the mechanical noise portion and obtain a processed microphone signal. The processor may output the processed microphone signal.

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

Abstract: An image capture device includes a first component that is configured to provide thermal energy. A heatsink is spaced a distance apart from the first component, and a second component is positioned between the first component and the heatsink. A conductor contacts the first component and the heatsink, and the conductor extends from the first component along sides of the second component to the heatsink.

Abstract: A media summary is generated to include portions of media items. The portions of media items identified for inclusion in the media summary is determined based on the length of the media summary and classification of content depicted within the media items. Classification of content depicted within the media items includes number of smiles depicted within the media items.

Abstract: A user interface of an image capture device may provide options for a user to schedule future capture of visual content by the image capture device. The user may interact with the options to specify the start time and the capture duration for the future capture of visual content.