Introduction
To increase the area of coverage during image acquisition from a moving platform, multiple cameras with overlapping fields of
view may be used to capture the images. Images from different cameras can then be combined into larger mosaics that cover
areas equal to the union of areas covered by the individual cameras. A software developed by Image Registration and Fusion
System can combine simultaneously captured images from 1x2, 2x2, or 2x3 cameras with 25% or more overlaps to larger
mosaics automatically.
Image mosaicking steps
This image mosaicking software has two main steps:
Assuming the cameras are fixed within a rig and their parameters do not change during image acquisition, images captured by
the cameras will have a fixed geometric relation. This geometric relation is determined in the form of transformation functions that
relate overlapping images. Although one set of images is sufficient to determine the transformation parameters, the process is
repeated for a few to several image sets to increase the reliability of the systems and also to improve its accuracy. The
transformation parameters determined from the image set producing the minimum registration error is taken to register and
combine the images into mosaics. Registration error is taken to be the sum of absolute intensity differences between registered
images in the overlap areas.
The second step of the algorithm transforms the geometries of all images to the geometry of one of the images.
Strength
The strength of the software is in its ability to register images from all cameras automatically. The redundant search for the
registration parameters makes the method very reliable and also increase its accuracy by finding parameters that produce the
most accurate registrations. In addition to the automatic mode, the software provides an interactive mode, allowing the user to
make mosaics of images from any number of cameras, such as 1x3, 3x2, 3x3, 4x4, etc. Included are functions to blend
overlapping registered images to create seamless mosaics and cut rough edges of created mosaics, producing rectangular
mosaics.
Input/Output
To determine the transformation parameters, the user chooses a few to several sets of images from a file selection menu. The
software will then automatically register the images and save the best registration parameters. Having found the registration
parameters, the user then selects the first and the last images in a sequence to be registered into mosaics. The software will
register the images, create mosaics of the images, and save the mosaics into files.
Interaction
The interaction with the system is limited to input/output file selection. Everything else is automatic. For very large images,
interaction is provided for the user to scale and translate the created mosaic within the viewing window and examine the results.
Speed
The speed of the software is dependent on the size of individual images and the number of images to be combined into a
mosaic. For images of size 1Kx1K and using four cameras, determination of the transformation parameters from one set of
images takes about 10 minutes on a Windows PC with 3.2 GHz processor. After the transformation parameters are determined, a
set of four images is registered and made into a mosaic in about 30 seconds.
Accuracy
Although overlapping image are registered with subpixel accuracy, the mosaicking accuracy depends on the number of images
as well as the geometric integrity of each image. The software assumes that lens distortion is not present in the images, and
cameras have similar characteristics. If cameras produce different intensities in overlapping area or if lens distortion is present in
the images, mosaicked images will contain errors proportional to errors in individual images.
Reliability
The reliability of the system can be increased by choosing a larger number of image sets when determining the transformation
parameters.
Enquiries
For questions, please contact cs@imgfsr.com. Special orders to extend the functionality of the system to automatically register
and make mosaics of images from larger camera arrays, such as 5x5 or 4x6, will be considered.
To increase the area of coverage during image acquisition from a moving platform, multiple cameras with overlapping fields of
view may be used to capture the images. Images from different cameras can then be combined into larger mosaics that cover
areas equal to the union of areas covered by the individual cameras. A software developed by Image Registration and Fusion
System can combine simultaneously captured images from 1x2, 2x2, or 2x3 cameras with 25% or more overlaps to larger
mosaics automatically.
Image mosaicking steps
This image mosaicking software has two main steps:
- Determining the transformation parameters for registering overlapping images using a few to several sets of
simultaneously captured images. - Using the obtained transformation parameters to register and make mosaics of all images within captured sequences.
Assuming the cameras are fixed within a rig and their parameters do not change during image acquisition, images captured by
the cameras will have a fixed geometric relation. This geometric relation is determined in the form of transformation functions that
relate overlapping images. Although one set of images is sufficient to determine the transformation parameters, the process is
repeated for a few to several image sets to increase the reliability of the systems and also to improve its accuracy. The
transformation parameters determined from the image set producing the minimum registration error is taken to register and
combine the images into mosaics. Registration error is taken to be the sum of absolute intensity differences between registered
images in the overlap areas.
The second step of the algorithm transforms the geometries of all images to the geometry of one of the images.
Strength
The strength of the software is in its ability to register images from all cameras automatically. The redundant search for the
registration parameters makes the method very reliable and also increase its accuracy by finding parameters that produce the
most accurate registrations. In addition to the automatic mode, the software provides an interactive mode, allowing the user to
make mosaics of images from any number of cameras, such as 1x3, 3x2, 3x3, 4x4, etc. Included are functions to blend
overlapping registered images to create seamless mosaics and cut rough edges of created mosaics, producing rectangular
mosaics.
Input/Output
To determine the transformation parameters, the user chooses a few to several sets of images from a file selection menu. The
software will then automatically register the images and save the best registration parameters. Having found the registration
parameters, the user then selects the first and the last images in a sequence to be registered into mosaics. The software will
register the images, create mosaics of the images, and save the mosaics into files.
Interaction
The interaction with the system is limited to input/output file selection. Everything else is automatic. For very large images,
interaction is provided for the user to scale and translate the created mosaic within the viewing window and examine the results.
Speed
The speed of the software is dependent on the size of individual images and the number of images to be combined into a
mosaic. For images of size 1Kx1K and using four cameras, determination of the transformation parameters from one set of
images takes about 10 minutes on a Windows PC with 3.2 GHz processor. After the transformation parameters are determined, a
set of four images is registered and made into a mosaic in about 30 seconds.
Accuracy
Although overlapping image are registered with subpixel accuracy, the mosaicking accuracy depends on the number of images
as well as the geometric integrity of each image. The software assumes that lens distortion is not present in the images, and
cameras have similar characteristics. If cameras produce different intensities in overlapping area or if lens distortion is present in
the images, mosaicked images will contain errors proportional to errors in individual images.
Reliability
The reliability of the system can be increased by choosing a larger number of image sets when determining the transformation
parameters.
Enquiries
For questions, please contact cs@imgfsr.com. Special orders to extend the functionality of the system to automatically register
and make mosaics of images from larger camera arrays, such as 5x5 or 4x6, will be considered.
| Auto image mosaicking from 2, 4, or 6 cameras |
| Image Registration and Fusion Systems |
 | |  |
To obtain a license for this mosaicking software, please follow the link =>