CN109840017A - A kind of panoramic picture methods of exhibiting, system and storage medium - Google Patents
A kind of panoramic picture methods of exhibiting, system and storage medium Download PDFInfo
- Publication number
- CN109840017A CN109840017A CN201910027486.0A CN201910027486A CN109840017A CN 109840017 A CN109840017 A CN 109840017A CN 201910027486 A CN201910027486 A CN 201910027486A CN 109840017 A CN109840017 A CN 109840017A
- Authority
- CN
- China
- Prior art keywords
- panoramic picture
- gesture information
- bone
- initial pictures
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to a kind of panoramic picture methods of exhibiting, system and storage mediums, and this method comprises the following steps: obtaining multiple initial pictures；Multiple described initial pictures are synthesized, panoramic picture is obtained；Obtain the gesture information of user；The control instruction corresponding with the gesture information is determined in pre-stored multiple control instructions；The panoramic picture is controlled according to the control instruction to be shown.Technical solution of the present invention is controlled panoramic picture by the way of body feeling interaction and carries out comprehensive displaying, does not need to carry out contacting the control that can be achieved with to panoramic picture with input equipment, simple and convenient, practical and efficient.
Description
Technical field
The present invention relates to computer application technology more particularly to a kind of panoramic picture methods of exhibiting, system and storage
Medium.
Background technique
Panoramic picture can provide comprehensive visual angle, immersion viewing experience for user, be increasingly becoming virtual reality
Hot spot.The image of multiple directions is mainly shot by camera, then the image of multiple directions is obtained into panorama sketch by synthesis
Picture
Panoramic picture, since screen etc. shows that equipment can not completely show panoramic picture, needs to use in display
Family controls panoramic picture sliding as needed or rotates each region to show panoramic picture, currently, passing through sliding touching mostly
It touches screen or mobile mouse is shown to control panoramic picture, but these modes are not convenient enough, when user is inconvenient to operate mouse
When mark or sliding touch screen, optimal panoramic picture bandwagon effect can not be obtained, such as when user is carrying out room finish, need
When checking the panoramic design sketch after fitting up, due to being not easy to operation mouse or sliding touch screen, can not just it view complete
Panoramic design sketch.
Summary of the invention
The technical problem to be solved by the present invention is to solve the above shortcomings of the prior art and to provide a kind of displayings of panoramic picture
Method, system and storage medium.
The technical scheme to solve the above technical problems is that
In a first aspect, this method comprises the following steps the present invention provides a kind of panoramic picture methods of exhibiting:
Obtain multiple initial pictures.
Multiple described initial pictures are synthesized, panoramic picture is obtained.
Obtain the gesture information of user.
The control instruction corresponding with the gesture information is determined in pre-stored multiple control instructions.
The panoramic picture is controlled according to the control instruction to be shown.
Second aspect, the present invention provides a kind of panoramic picture display systems, comprising:
First obtains module, obtains multiple initial pictures.
Image synthesis module synthesizes multiple described initial pictures, obtains panoramic picture.
Second obtains module, obtains the gesture information of user.
Processing module determines that the control corresponding with the gesture information refers in pre-stored multiple control instructions
It enables.
Display module controls the panoramic picture according to the control instruction and is shown.
The third aspect, the present invention provides a kind of panoramic picture display systems, and the system comprises memories and processor.
The memory, for storing computer program.
The processor, for when loaded and executed, realizing panoramic picture methods of exhibiting as described above.
Fourth aspect is stored with calculating the present invention provides a kind of computer readable storage medium on the storage medium
Machine program realizes panoramic picture methods of exhibiting as described above when the computer program is executed by processor.
Panoramic image methods of exhibiting, system and storage medium beneficial effect of the invention is: obtaining first complete for synthesizing
Multiple initial pictures of scape image, multiple initial pictures are arranged in order and adjacent mutual overlapping region, to multiple initial graphs
Panoramic picture for display is obtained as carrying out synthesis, panoramic picture can be output to screen etc. and show that equipment is shown, obtained
The gesture information at family is taken, the depth image of user can be shot by Kinect camera to obtain the gesture information of user, root
Judge that the control of user is intended to according to gesture information, obtain control instruction, panoramic picture sliding or rotation are controlled according to control instruction
Deng, show panoramic picture in user want the region checked.Technical solution of the present invention is controlled entirely by the way of body feeling interaction
Scape image carries out comprehensive displaying, does not need to carry out contacting the control that can be achieved with to panoramic picture with input equipment, simply
It is convenient, it is practical and efficient.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of panoramic picture methods of exhibiting of the embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram of panoramic picture display systems of the embodiment of the present invention.
Specific embodiment
The principle and features of the present invention will be described below with reference to the accompanying drawings, and the given examples are served only to explain the present invention, and
It is non-to be used to limit the scope of the invention.
As shown in Figure 1, the method includes walking as follows the embodiment of the invention provides a kind of panoramic picture methods of exhibiting
It is rapid:
110, obtain multiple initial pictures.
120, multiple described initial pictures are synthesized, panoramic picture is obtained.
130, obtain the gesture information of user.
140, the control instruction corresponding with the gesture information is determined in pre-stored multiple control instructions.
150, the panoramic picture is controlled according to the control instruction and is shown.
In the present embodiment, multiple initial pictures for synthesizing panoramic picture are obtained first, multiple initial pictures are in order
Arrangement and adjacent mutual overlapping region carry out synthesis to multiple initial pictures and obtain panoramic picture for display, can will be complete
Scape image is output to screen etc. and shows that equipment is shown, obtains the gesture information of user, can be shot by Kinect camera
The depth image of user judges that the control of user is intended to obtain the gesture information of user, according to gesture information, obtains control and refers to
It enables, panoramic picture sliding or rotation etc. is controlled according to control instruction, show that user wants the region checked in panoramic picture.This hair
Bright technical solution is controlled panoramic picture by the way of body feeling interaction and carries out comprehensive displaying, do not need with input equipment into
Row contact can be achieved with the control to panoramic picture, simple and convenient, practical and efficient.
Preferably, multiple described initial pictures are that multiple are arranged in order and the image of adjacent mutual overlapping region.
Specifically, initial pictures can be the image of fish eye lens shooting, multiple images are arranged in order and adjacent mutual
Overlapping region, multiple images can finish up it is connected, cover 360 degree scenes, by synthesize can obtain 360 degree of panoramic pictures.
Preferably, described that multiple described initial pictures are synthesized, it obtains panoramic picture and specifically comprises the following steps:
Noise elimination and distortion reduction are carried out multiple described initial pictures, obtain multiple pretreatment images.
Specifically, fish eye lens, which takes the image come, can achieve the visual angle of 180 degree, but it is opposite be distorted that picture, which is imaged,
, there are geometric distortion, the geometric distortion of image is unfavorable for image registration, carries out noise filtering to image first, and can pass through
Change the radial distortion parameter of camera until the line in image is in line and in parallel, it is correcting distorted, it can be corrected by camera calibration
Radial distortion parameter.The correction position being mapped to by the original pixel after distortion correction is not necessarily required point, usually needs
The pixel value closest to correction position is acquired using the method for interpolation, arest neighbors interpolation method can be used in interpolation, bilinearity is inserted
Value method or bicubic convolution method.
Based on SURF feature extraction algorithm, multiple described pretreatment images are registrated, obtain multiple registration images.
Specifically, image registration is for Same Scene, to different sensors or different time, different angle, different positions
Multiple figures for setting acquisition carry out the process of best alignment.For the image of any two mutual overlapping regions, with an image
As matched benchmark, referred to as reference picture, another is used as deformation to realize registration, image referred to as subject to registration.It extracts first
The common characteristic point of two registration images establishes feature space, and feature space is constituted by participating in matched characteristics of image, these
Characteristics of image can be the gray feature of pixel, be also possible to some significant feature structures for being easy to detect, such as edge, wheel
Exterior feature, angle point etc..Characteristic matching is carried out according to the characteristic point in feature space, similarity calculation function can be based on, using based on most
The characteristic matching method of short distance ratio is matched, and obtains transformation model according to matching result, transformation model is a parametrization
Mapping function finally uses transformation model it to be mutually matched with benchmark image image deformation subject to registration.Wherein, SURF master
To include that feature extraction and feature describe two steps, relative to other feature extraction algorithms, repeat reading, unique and Shandong
There is better effect on stick, and adheres to there is apparent advantage with matching speed.
Energy-optimised algorithm is cut based on figure, multiple described registration images are spliced, the panoramic picture is obtained.
Specifically, (Graph-Cuts) energy optimizing method is cut using figure, to the data capacity item of overlapping area image, flat
Sliding energy term and energy term optimize, and optimization method includes α-expansion algorithm and alpha-beta-swap algorithm, and entire algorithm follows
Ring iterative is no longer reduced up to energy term minimum, is obtained optimal splicing line, is spliced according to optimal splicing line, can be obtained complete
Scape image, sawtooth can be reduced by cutting the panoramic picture that energy-optimised algorithm obtains using figure, will not there are segmentation trace.
Preferably, the specific implementation of the gesture information for obtaining user are as follows:
Obtain Kinect camera shooting multiple different bone images, the Kinect camera be used for user into
The tracking of row bone, determines the gesture information according to the relative position of bone in bone image described in multiple.
Specifically, the depth map that Kinect obtains user can be used, pass through the e.OpenSkeletonFrame in Kinect
() function opens Kinect skeleton data stream, passes through having for the TrackingState determined property camera of Skeleton object
Whether effect has skeleton in visual angle, is depicted as the bone tracked by Polyline CreateFigure () function
Multiple different bone images, compare the relative position of hand in multiple bone images, obtain gesture information.Such as: hand be determined as to
When moving left, panoramic picture slides to the left；When hand is judged to moving right, panoramic picture is slided to the right；Hand is determined as to moving up
When dynamic, panoramic picture upward sliding；When hand is judged to moving down, the sliding of panoramic picture countryside.
Preferably, described that the control corresponding with the gesture information is determined in pre-stored multiple control instructions
The specific implementation of instruction are as follows:
The gesture information is matched with the gesture template in database, includes multiple and different in the database
Gesture template and the control instruction is obtained according to matching result with the gesture template one-to-one control instruction.
Specifically, can be associated with mouse action instruction by control instruction, it can be instructed in gesture template and mouse action
Between establish one-to-one mapping relations, by identifying gesture information, so that it may by gesture complete it is corresponding with mouse
Operation, not only operation is precisely, and more convenient operation, quick.
As shown in Fig. 2, the embodiment of the invention provides a kind of panoramic picture display systems, comprising:
First obtains module, obtains multiple initial pictures.
Image synthesis module synthesizes multiple described initial pictures, obtains panoramic picture.
Second obtains module, obtains the gesture information of user.
Processing module determines that the control corresponding with the gesture information refers in pre-stored multiple control instructions
It enables.
Display module controls the panoramic picture according to the control instruction and is shown.
Preferably, described image synthesis module is specifically used for:
Noise elimination and distortion reduction are carried out multiple described initial pictures, obtain multiple pretreatment images.
Based on SURF feature extraction algorithm, multiple described pretreatment images are registrated, obtain multiple registration images.
Energy-optimised algorithm is cut based on figure, multiple described registration images are spliced, the panoramic picture is obtained.
Preferably, the second acquisition module is specifically used for:
Obtain Kinect camera shooting multiple different bone images, the Kinect camera be used for user into
The tracking of row bone, determines the gesture information according to the relative position of bone in bone image described in multiple.
Another embodiment of the present invention provides a kind of panoramic picture display systems, which is characterized in that the system comprises deposit
Reservoir and processor.
The memory, for storing computer program.
The processor, for when loaded and executed, realizing panoramic picture methods of exhibiting as described above.
Yet another embodiment of the invention provides a kind of computer readable storage medium, and calculating is stored on the storage medium
Machine program realizes panoramic picture methods of exhibiting as described above when the computer program is executed by processor.
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and
Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of panoramic picture methods of exhibiting, which is characterized in that described method includes following steps:
Obtain multiple initial pictures；
Multiple described initial pictures are synthesized, panoramic picture is obtained；
Obtain the gesture information of user；
The control instruction corresponding with the gesture information is determined in pre-stored multiple control instructions；
The panoramic picture is controlled according to the control instruction to be shown.
2. panoramic picture methods of exhibiting according to claim 1, which is characterized in that multiple described initial pictures are pressed for multiple
The image of sequence arrangement and adjacent mutual overlapping region.
3. panoramic picture methods of exhibiting according to claim 2, which is characterized in that it is described multiple described initial pictures into
Row synthesis obtains panoramic picture and specifically comprises the following steps:
Noise elimination and distortion reduction are carried out multiple described initial pictures, obtain multiple pretreatment images；
Based on SURF feature extraction algorithm, multiple described pretreatment images are registrated, obtain multiple registration images；
Energy-optimised algorithm is cut based on figure, multiple described registration images are spliced, the panoramic picture is obtained.
4. panoramic picture methods of exhibiting according to claim 1, which is characterized in that the gesture information for obtaining user
Specific implementation are as follows:
Multiple different bone images of Kinect camera shooting are obtained, the Kinect camera is used to carry out bone to user
Bone tracking, determines the gesture information according to the relative position of bone in bone image described in multiple.
5. panoramic picture methods of exhibiting according to any one of claims 1 to 4, which is characterized in that described to be stored in advance
Multiple control instructions in determine the specific implementation of corresponding with the gesture information control instruction are as follows:
The gesture information is matched with the gesture template in database, includes multiple and different gestures in the database
Template and the control instruction is obtained according to matching result with the gesture template one-to-one control instruction.
6. a kind of panoramic picture display systems characterized by comprising
First obtains module, obtains multiple initial pictures；
Image synthesis module synthesizes multiple described initial pictures, obtains panoramic picture；
Second obtains module, obtains the gesture information of user；
Processing module determines the control instruction corresponding with the gesture information in pre-stored multiple control instructions；
Display module controls the panoramic picture according to the control instruction and is shown.
7. panoramic picture display systems according to claim 6, which is characterized in that described image synthesis module is specifically used
In:
Noise elimination and distortion reduction are carried out multiple described initial pictures, obtain multiple pretreatment images；
Based on SURF feature extraction algorithm, multiple described pretreatment images are registrated, obtain multiple registration images；
Energy-optimised algorithm is cut based on figure, multiple described registration images are spliced, the panoramic picture is obtained.
8. panoramic picture display systems according to claim 7, which is characterized in that the second acquisition module is specifically used
In:
Multiple different bone images of Kinect camera shooting are obtained, the Kinect camera is used to carry out bone to user
Bone tracking, determines the gesture information according to the relative position of bone in bone image described in multiple.
9. a kind of panoramic picture display systems, which is characterized in that the system comprises memories and processor；
The memory, for storing computer program；
The processor, for when loaded and executed, realizing such as panorama described in any one of claim 1 to 5
Image presentation method.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer program on the storage medium, work as institute
When stating computer program and being executed by processor, such as panoramic picture methods of exhibiting described in any one of claim 1 to 5 is realized.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910027486.0A CN109840017A (en) | 2019-01-11 | 2019-01-11 | A kind of panoramic picture methods of exhibiting, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910027486.0A CN109840017A (en) | 2019-01-11 | 2019-01-11 | A kind of panoramic picture methods of exhibiting, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109840017A true CN109840017A (en) | 2019-06-04 |
Family
ID=66883802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910027486.0A Pending CN109840017A (en) | 2019-01-11 | 2019-01-11 | A kind of panoramic picture methods of exhibiting, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109840017A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111932593A (en) * | 2020-07-21 | 2020-11-13 | 湖南中联重科智能技术有限公司 | Image registration method, system and equipment based on touch screen gesture correction |
| CN113721829A (en) * | 2021-08-11 | 2021-11-30 | 上海卓越睿新数码科技股份有限公司 | Gesture operation-based panoramic courseware smooth rotation control method and system |
| CN114913276A (en) * | 2022-05-11 | 2022-08-16 | 北京有竹居网络技术有限公司 | Method, apparatus, device and storage medium for image processing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102201115A (en) * | 2011-04-07 | 2011-09-28 | 湖南天幕智能科技有限公司 | Real-time panoramic image stitching method of aerial videos shot by unmanned plane |
| US20150149960A1 (en) * | 2013-11-22 | 2015-05-28 | Samsung Electronics Co., Ltd. | Method of generating panorama image, computer-readable storage medium having recorded thereon the method, and panorama image generating device |
| CN105045279A (en) * | 2015-08-03 | 2015-11-11 | 余江 | System and method for automatically generating panorama photographs through aerial photography of unmanned aerial aircraft |
| CN108594999A (en) * | 2018-04-20 | 2018-09-28 | 北京京东金融科技控股有限公司 | Control method and device for panoramic picture display systems |
-
2019
- 2019-01-11 CN CN201910027486.0A patent/CN109840017A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102201115A (en) * | 2011-04-07 | 2011-09-28 | 湖南天幕智能科技有限公司 | Real-time panoramic image stitching method of aerial videos shot by unmanned plane |
| US20150149960A1 (en) * | 2013-11-22 | 2015-05-28 | Samsung Electronics Co., Ltd. | Method of generating panorama image, computer-readable storage medium having recorded thereon the method, and panorama image generating device |
| CN105045279A (en) * | 2015-08-03 | 2015-11-11 | 余江 | System and method for automatically generating panorama photographs through aerial photography of unmanned aerial aircraft |
| CN108594999A (en) * | 2018-04-20 | 2018-09-28 | 北京京东金融科技控股有限公司 | Control method and device for panoramic picture display systems |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111932593A (en) * | 2020-07-21 | 2020-11-13 | 湖南中联重科智能技术有限公司 | Image registration method, system and equipment based on touch screen gesture correction |
| CN111932593B (en) * | 2020-07-21 | 2024-04-09 | 湖南中联重科智能技术有限公司 | Image registration method, system and equipment based on touch screen gesture correction |
| CN113721829A (en) * | 2021-08-11 | 2021-11-30 | 上海卓越睿新数码科技股份有限公司 | Gesture operation-based panoramic courseware smooth rotation control method and system |
| CN113721829B (en) * | 2021-08-11 | 2023-07-18 | 上海卓越睿新数码科技股份有限公司 | Gesture operation-based panoramic courseware smooth rotation control method and gesture operation-based panoramic courseware smooth rotation control system |
| CN114913276A (en) * | 2022-05-11 | 2022-08-16 | 北京有竹居网络技术有限公司 | Method, apparatus, device and storage medium for image processing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12272085B2 (en) | Method and system for scene image modification | |
| CN111243093B (en) | Three-dimensional face grid generation method, device, equipment and storage medium | |
| US10410089B2 (en) | Training assistance using synthetic images | |
| US11620730B2 (en) | Method for merging multiple images and post-processing of panorama | |
| US9516214B2 (en) | Information processing device and information processing method | |
| CN109697688A (en) | A kind of method and apparatus for image procossing | |
| US10169891B2 (en) | Producing three-dimensional representation based on images of a person | |
| JP2014071850A (en) | Image processing apparatus, terminal device, image processing method, and program | |
| CN107563959B (en) | Panorama generation method and device | |
| CN114581986A (en) | Image processing method, device, electronic device and storage medium | |
| KR20210133472A (en) | Method of merging images and data processing device performing the same | |
| CN109840017A (en) | A kind of panoramic picture methods of exhibiting, system and storage medium | |
| JP5801209B2 (en) | Camera posture estimation device, program | |
| CN118379436B (en) | Method, device, equipment and storage medium for generating three-dimensional virtual scene | |
| CN112288878A (en) | Augmented reality preview method and preview device, electronic device and storage medium | |
| CN119850867B (en) | Three-dimensional reconstruction method, electronic device, and storage medium | |
| CN120014714B (en) | Hand gesture recognition method, head mounted display device and storage medium | |
| CN116243837A (en) | A screen display method, system, device, and computer-readable storage medium | |
| CN107093165A (en) | The fast display method and device of a kind of recursive image | |
| Bergmann et al. | Gravity alignment for single panorama depth inference | |
| JP6341540B2 (en) | Information terminal device, method and program | |
| Kim et al. | Real-time panorama canvas of natural images | |
| CN109166176B (en) | Three-dimensional face image generation method and device | |
| CN111311491A (en) | Image processing method and device, storage medium and electronic equipment | |
| WO2021190655A1 (en) | Method for merging multiple images and post-processing of panorama |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190604 |