Real-time stitching multi-video to one screen

* Introduction

- The solution shows panorama image from multi images. The panorama images is processing by real-time stitching algorithm.

- Each cameras has a limited field of view, but the solution can be monitoring large areas from merged into a panorama image.

- The performance is excellent with the following technical configuration.
 . real time image processing using GPU.
 . Accurate calculation of R, T, K (Rotation, Translation, Camera intrinsic) between each camera with nonlinear optimization
 . Color calibration using the exposure blending

- The solution can be applied efficiently and easy in Military Region, tourist attractions, intersections, ports

* Real-time N to 1 stitching algorithm

- Existing stitching algorithm is modified to separate 2 parts of offline and online processing for more efficient realtime processing.

- The Off-Line processing part is calculated first time or if the matching inaccurate. 

- On-Line processing part is a routine to create the panoramic image by warping (Warping) calculated by the matching, the blending value.

No ordered input images

- Feature extraction and to calculate the homography matrix between each image by evaluating (RANSAC), and set image position through matching rate.
- To get correct R, T using bundle adjustment

- Searching the overlap region, the blending coefficient is determined with respect to the non-overlapping region.

- Obtained R, T, K, and connected by warping the images and blending and complete the panorama finally

* Experiment

- 4 real-time video stitching speed of about 10~20 fps (Intel® core™ i5-3570 cpu 3.40GHz, NVIDIA Geforce GTX 650)

See the result on youtube

updating 42/06/2018
I have decided to sell source code ^^
If you have interest, go to here, you can buy source code


Two 3DM-GX3 data acquisition

Some students asked me how to get the two 3dm-gx3 data.
And he wants to save the data to the txt file at the same time.
He has no c ++ coding experience so request me a favor.

Refer to this page, how to get data from 3dm-gx3.

And this link is for him.
The program can get data from two imu sensors.
github url : https://github.com/MareArts/Two-3DM-GX3-data-acquisition

When you open a comport, data acquisition and write to txt file.
And when you close your comfort, the record is completed in a txt file.

I hope you applied again to the desired shape in the program.
Note that the method of serial communication with MATLAB also.

Thank you.