* Introduction
- The solution shows panorama image from multi images. The panorama images is processing by real-time stitching algorithm.
- Each cameras has a limited field of view, but the solution can be monitoring large areas from merged into a panorama image.
- The performance is excellent with the following technical configuration.
. real time image processing using GPU.
. Accurate calculation of R, T, K (Rotation, Translation, Camera intrinsic) between each camera with nonlinear optimization
. Color calibration using the exposure blending
- The solution can be applied efficiently and easy in Military Region, tourist attractions, intersections, ports
* Real-time N to 1 stitching algorithm
- Existing stitching algorithm is modified to separate 2 parts of offline and online processing for more efficient realtime processing.
- The Off-Line processing part is calculated first time or if the matching inaccurate.
- On-Line processing part is a routine to create the panoramic image by warping (Warping) calculated by the matching, the blending value.
No ordered input images
- Feature extraction and to calculate the homography matrix between each image by evaluating (RANSAC), and set image position through matching rate.
- To get correct R, T using bundle adjustment
- Searching the overlap region, the blending coefficient is determined with respect to the non-overlapping region.
- Obtained R, T, K, and connected by warping the images and blending and complete the panorama finally
* Experiment
- 4 real-time video stitching speed of about 10~20 fps (Intel® core™ i5-3570 cpu 3.40GHz, NVIDIA Geforce GTX 650)
See the result on youtube
updating 42/06/2018
I have decided to sell source code ^^
If you have interest, go to here, you can buy source code
** 2021.06 updated **
realtime stitching SDK: