CN106878698B - The method and system of mobile naked eye three-dimensional virtual reality based on optical path acquisition - Google Patents

Abstract

The present invention relates to a method and a system for mobile naked-eye three-dimensional virtual reality based on optical path acquisition according to the embodiments of the present invention. Wherein, the method may include: collecting images; obtaining a two-viewpoint composite map index map according to the collected images; obtaining a two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity; based on the image-based two-viewpoint composite map index map, The two viewpoint images are rendered into a composite image to obtain a 3D virtual reality display image. Preferably, the step of obtaining the two-viewpoint map may specifically include: determining the influence weight of the sub-pixel brightness on the image, and then using a least squares method with a bounding box to determine the composite map index map of the two viewpoints; according to the position information of the acceleration and the angular velocity Rotate the information, adjust the orientation of the acquired image, and obtain a two-viewpoint map. The embodiments of the present invention solve the technical problem of how to realize high-quality naked-eye three-dimensional virtual reality display by adopting the above technical solutions.

Description

Method and system for mobile naked-eye 3D virtual reality based on optical path acquisition

technical field

The invention relates to a three-dimensional display method, in particular to a method and system for mobile naked-eye three-dimensional virtual reality based on optical path acquisition.

Background technique

At present, virtual reality has set off a wave in the world, and three-dimensional virtual reality is a relatively new development direction. Virtual reality technology is a comprehensive achievement that integrates tracking system, haptic system, image generation and display system and visual display device, but there are still many problems to be solved in the road of practical commercialization. Virtual reality mostly integrates related technologies through wearable device helmets, but the size of the headband cannot be adjusted, the helmet is too heavy, the ventilation of the device when worn for a long time, and the heat dissipation is poor, these factors will reduce the comfort experience of the viewer; The actual equipment needs to be connected to the computer for signal transmission, which is often connected to a long cable as a communication guarantee. In the case of the viewer moving, focusing on the display device and ignoring the cables under the feet is at risk of tripping; relatively speaking, the price of virtual reality devices with average performance is generally high. As an entertainment tool, its display resources are very limited at present, but the price is beyond the affordability of the general public. Compared with traditional virtual reality, 3D virtual reality is closer to the actual perception of human beings, and can intuitively bring depth effects to the viewer. Among many 3D display technologies at home and abroad, holography is a recording and restoration technology that records and restores real object images through optical phenomena of interference and diffraction. However, the current holographic image devices use lasers to collect and display images, and the equipment cost Extremely expensive. The integrated imaging 3D display technology has problems in many aspects such as image viewpoint crosstalk and the number of viewpoints. The naked-eye stereoscopic 3D display has considerable commercial prospects. At present, the stereoscopic 3D display devices that have gone out of the laboratory stage are mostly complex and heavy in structure and require a variety of materials and equipment and self-designed control devices. They are not suitable for applications in relatively mobile applications. strong virtual reality technology.

Due to its portability and popularity, mobile terminals occupy an innate advantage in 3D virtual reality technology. Microlens array naked-eye 3D display technology is based on a microlens array overlaid on a 2D flat screen, which is relatively simple to implement and whose 3D image reconstruction quality is sufficient for many consumer electronic devices. Existing rendering methods for display technologies, such as Philips' modulo arithmetic or ray back-projection methods, require accurate calibrations that rely on device measurements to produce high-quality 3D displays.

In view of this, the present invention is proposed.

SUMMARY OF THE INVENTION

In order to solve the above problems in the prior art, that is, to solve the technical problem of how to realize high-quality naked-eye 3D virtual reality display, a method for mobile naked-eye 3D virtual reality based on optical path acquisition is proposed. In addition, a mobile naked-eye three-dimensional virtual reality system based on optical path acquisition is also provided.

In order to achieve the above object, according to one aspect of the present invention, the following technical solutions are provided:

A method for mobile naked-eye three-dimensional virtual reality based on optical path acquisition, the method includes:

collect images;

Obtain the index map of the two-view composite map according to the collected image;

According to the position information of the acceleration and the rotation information of the angular velocity, a two-view point graph is obtained;

Based on the two-viewpoint composite map index map of the image, a composite map is rendered for the two-viewpoint map to obtain a three-dimensional virtual reality display image.

Further, the obtaining of the two-view composite image index map based on the collected image specifically includes:

Determine the sub-pixel brightness influence weight on the image;

Based on the influence weights of sub-pixel brightness on the image, a least squares method with bounding boxes is used to determine the composite image index map of the two viewpoints.

Further, determining the sub-pixel brightness influence weight on the image may specifically include:

Determine the sub-pixel brightness influence weight on the image according to the following formula:

Among them, Image _c(t) (i, j, k) represents the sub-pixels on the image collected at the t-th viewpoint, t=0, 1, i=1～H, j=1～W; H represents The height of the image; W represents the width of the image; r represents the radius of the safe window; m, n represent the window coordinates with the center of the safe window as the origin; q=1～3; Image _m (i+m,j+n,q) represents subpixels on the image; Indicates that the sub-pixel (i+m, j+n, q) on the image is lit to the maximum brightness and affects the weight of the normalized brightness of the adjacent pixel (i, j, k).

Further, based on the influence weight of sub-pixel brightness on the image, the least squares method with bounding boxes is used to determine the composite image index map of the two viewpoints, which may specifically include:

Based on the influence weight of sub-pixel brightness on the image, the least squares method with bounding box is used to determine the composite image index map of the two viewpoints according to the following formula:

in, Represents the difference in the influence weights of sub-pixel luminances corresponding to the two viewpoints; I represents the composite image index map of the two viewpoints, and is limited to the bounding box B _I ={I∈Z ^1×H :L≤I≤U}, L=0 ×I _1×H and U=255×I _1×H , I _1×H represents a full 1-column vector of H dimension; Represents the difference between the images collected from the two viewpoints; H represents the height of the image.

Further, before the step of determining the sub-pixel brightness influence weight on the image, it may further include:

Perform anti-distortion and region-of-interest extraction operations on the image.

Further, according to the position information of the acceleration and the rotation information of the angular velocity, a two-viewpoint map is obtained, which may specifically include:

According to the position information of the acceleration and the rotation information of the angular velocity, the orientation of the acquired image is adjusted to obtain a two-view point map.

Based on the two-view composite map index map of the image, a composite map is rendered for the two-view map to obtain a three-dimensional virtual reality display image, which specifically includes:

The composite image is rendered according to the following formula, and the 3D virtual reality display image is obtained:

Syn=I ₀ ×view ₀ +I ₁ ×view ₁

Wherein, Syn represents the 3D virtual reality display image; I ₀ represents the composite image index map of the 0th viewpoint; I ₁ represents the composite map index map of the first viewpoint; view ₀ represents the 0th viewpoint map; view ₁ represents the first viewpoint map.

In order to achieve the above object, according to another aspect of the present invention, the following technical solutions are provided:

A mobile naked-eye three-dimensional virtual reality system based on optical path acquisition, the system may include:

an image acquisition unit for acquiring images and sending the images to the controller;

The mobile terminal includes a screen, and the screen is provided with a microlens array film, which is used to send the position information of the acceleration and the rotation information of the angular velocity to the controller, and display the three-dimensional virtual reality display image through the screen;

The controller is respectively connected to the image acquisition unit and the mobile terminal in communication; it is used to process the image to obtain an index map of a two-view composite map, and to obtain the two-view map according to the position information of the acceleration and the rotation information of the angular velocity, and based on the image The two-viewpoint composite map index map renders a composite map for the two-viewpoint map, obtains a three-dimensional virtual reality display image, and sends the three-dimensional virtual reality display image to the mobile terminal.

Further, the mobile terminal may also include

Accelerometer, used to obtain location information of acceleration;

Gyroscope, which is used to obtain rotational information of angular velocity.

Further, the image acquisition unit is a monocular camera or a binocular camera.

Further, the mobile terminal is a mobile phone or a personal digital assistant.

Further, the controller is a computer, a notebook computer, a server or an industrial computer.

The embodiments of the present invention provide a method and system for mobile naked-eye three-dimensional virtual reality based on optical path acquisition. Wherein, the method may include: collecting images; obtaining a two-viewpoint composite map index map based on the collected images, and obtaining a two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity; based on the image-based two-viewpoint composite map index map, for The two-viewpoint map is rendered into a composite image to obtain a three-dimensional virtual reality display image. The embodiments of the present invention combine the three-dimensional display technology with the virtual reality technology, and can present a high-quality three-dimensional display effect when the parameters of the microlens array and the screen of the mobile terminal are unknown. Compared with traditional virtual reality equipment, it reduces the weight of the helmet and the sense of restraint due to poor comfort, and at the same time increases the three-dimensional display effect of the device itself instead of just using binoculars to receive left and right different scene pictures to achieve three-dimensional effect.

Description of drawings

1 is a schematic structural diagram of a system for mobile naked-eye three-dimensional virtual reality based on optical path collection according to an embodiment of the present invention;

2 is a schematic structural diagram of a system for a mobile naked-eye three-dimensional virtual reality system based on optical path acquisition according to another embodiment of the present invention;

3 is a schematic diagram of a naked-eye 3D virtual reality display effect of a mobile phone at three different observation points by a user holding a mobile phone according to an embodiment of the present invention;

FIG. 4 is a schematic flowchart of a method for mobile naked-eye three-dimensional virtual reality based on optical path acquisition according to an embodiment of the present invention.

Detailed ways

Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principle of the present invention, and are not intended to limit the protection scope of the present invention.

The following uses an exemplary embodiment to describe the application platform of the embodiment of the present invention. Among them, two image acquisition units with a reference line of 60mm can be used to simulate human eyes, and they can be placed at a distance of about 300mm from the screen of the mobile terminal. A sealed experimental box is used to provide a closed environment isolated from external light for the optical path acquisition of the image acquisition unit, and a fan is arranged behind the image acquisition unit to dissipate heat. Preferably, in order to maximize the utilization of pixels on the captured image, the image acquisition unit may be equipped with a telephoto lens. The test atlas is generated on the computer, and is sequentially transmitted to the mobile terminal for display through the construction of the local area network.

The above image acquisition unit includes, but is not limited to, a monocular camera, a binocular camera, and an industrial camera. Among them, if a monocular camera is selected, in practical application, two monocular cameras are used.

The embodiment of the present invention provides a mobile naked-eye three-dimensional virtual reality system based on optical path collection. As shown in FIG. 1 , the system 10 includes: an image acquisition unit 12 , a mobile terminal 14 and a controller 16 . Wherein, the image acquisition unit 12 is used for collecting images and sending the images to the controller. The mobile terminal 14 includes a screen provided with a microlens array film for sending the position information of the acceleration and the rotation information of the angular velocity to the controller, and displaying a three-dimensional virtual reality display image through the screen. The controller 16 is respectively connected in communication with the image acquisition unit and the mobile terminal; it is used to process the image to obtain a two-viewpoint composite map index map, and obtain a two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity, and based on the image The two-viewpoint composite map index map is rendered, a composite map is rendered for the two-viewpoint map, a three-dimensional virtual reality display image is obtained, and the three-dimensional virtual reality display image is sent to the mobile terminal.

The mobile terminal includes but is not limited to a mobile phone and a personal digital assistant. In this preferred embodiment, the mobile three-dimensional display technology and the virtual reality technology are combined, and a mobile naked-eye three-dimensional virtual reality display can be realized by using a mobile terminal.

The above-mentioned image acquisition unit, as an optical path acquisition device, includes but is not limited to a monocular camera and a binocular camera. The image acquisition unit can perform pre-calibration and calibration with the mobile terminal, and then perform three-dimensional virtual reality display.

The above-mentioned controllers include but are not limited to computers, notebook computers, industrial computers, and servers. The server can also be a server cluster.

A micro-lens array film is covered on the screen of the mobile terminal, and the micro-lens array film is composed of thousands of convex lenses. In this way, sub-pixels located in different places under the convex lens are magnified to the viewer's eye when viewed in different directions.

In this embodiment, the manner in which the controller communicates with the image acquisition unit and the mobile terminal respectively includes, but is not limited to, WIFI network, Bluetooth, ZigBee, 2G, 3G, 4G, and 5G.

By adopting the above technical solutions, the embodiments of the present invention can realize mobile 3D virtual reality display with strong reproducibility, controllable cost and high resolution when the parameters of the microlens array and the liquid crystal screen of the mobile terminal are unknown.

In an optional embodiment, the mobile terminal may include a gyroscope and an accelerometer. Among them, the accelerometer is used to obtain the position information of the acceleration. Gyroscopes are used to obtain rotational information for angular velocity.

The working process of the mobile naked-eye three-dimensional virtual reality system based on optical path acquisition will be described in detail below with reference to FIG. 2 and FIG. 3 in the form of a preferred embodiment. The preferred embodiment is described in detail by taking a mobile phone, a camera, and a control computer as an example as a mobile terminal, an image acquisition unit, and a controller, respectively. Among them, two monocular industrial cameras are used. The mobile phone screen is covered with a microlens array film. The control computer realizes wireless communication with the mobile phone and industrial camera through the router.

In this preferred embodiment, the following distance settings are performed: measure the binocular distance of the viewing user, the distance between the screen and the eyes when holding the mobile phone 3, set the horizontal placement distance of the two cameras 6 to the binocular distance of the user 7, and set the distance between the mobile phone screen and the camera. The distance at 6 is the same as the distance at which the user 7 holds the mobile phone 3 .

In the optical path collection experiment box 4 , the industrial camera 6 is calibrated and calibrated through the mobile phone 3 via the light 5 . The calibration methods include, but are not limited to, active vision camera calibration methods and camera self-calibration methods.

Connect the industrial camera 6 to the control computer 1 and perform image acquisition to optimize two initial composite image index images, the effect of which is that the display effects of the two index images in the mobile phone 3 are complementary in black and white colors.

The displacement and rotation attitude of the viewer are collected through the mobile phone 3 , and the signal communication is performed with the control computer 1 through the WIFI network, and the displacement and rotation attitude of the viewer are sent to the control computer 1 .

The control computer 1 communicates with the mobile phone 3 and the industrial camera 6 through the router 2 respectively, controls the mobile phone to light up a single pixel, and controls the camera 6 to collect images at the same time; it also optimizes the images collected by the two industrial cameras 6 to generate two viewpoints And also receive the displacement of the viewer that the mobile phone 3 sends and the rotational attitude data, and according to the displacement of the viewer and the rotational attitude data, the two-viewpoint diagram to be displayed and the initial composite diagram index diagram interact to generate a virtual three-dimensional scene image ( three-dimensional virtual reality image), and the virtual three-dimensional scene image is fed back to the mobile phone 3 for naked-eye three-dimensional display. At this time, the viewer can watch the three-dimensional effect of the virtual scene without any other external auxiliary equipment.

FIG. 3 exemplarily shows a schematic diagram of a naked-eye three-dimensional virtual reality display effect of a mobile phone at three different observation points by a user holding a mobile phone.

This preferred embodiment constructs a system for naked-eye 3D virtual reality based on optical path acquisition with strong reproducibility, controllable cost, high resolution, and mobile, which incorporates virtual reality technology as an automatic calibration and crosstalk reduction based on optical path acquisition. The mobile 3D display solution can present a high-quality and delicate 3D display effect when the parameters of the microlens array and the LCD screen of the mobile phone are unknown. The virtual reality device reduces the weight of the helmet and the sense of restraint due to poor comfort, and at the same time increases the three-dimensional display effect of the device itself instead of only using binoculars to receive pictures of different scenes to achieve a three-dimensional effect.

In addition, an embodiment of the present invention provides a method for mobile naked-eye three-dimensional virtual reality based on optical path acquisition. The method can be applied to the above-mentioned mobile naked-eye three-dimensional virtual reality system based on optical path acquisition. As shown in Figure 4, the method may include:

S400: Capture an image.

S410: Obtain a composite image index map of two viewpoints based on the collected images.

Specifically, this step can be implemented through steps S414 to S418.

S414: Determine the sub-pixel brightness influence weight on the image.

In this step, for the value of each sub-pixel on the composite image index map of the two viewpoints, the influence of the surrounding sub-pixels on it is considered, and the weight value of the influence of different sub-pixels is obtained through the collected images.

For example, when any sub-pixel Image _m (i, j, q) in the Image _m (i, j) window is lit, it will affect the captured image, Image _c(t) (i, j ) each subpixel in the pixel.

Specifically, this step may further include: determining the sub-pixel brightness influence weight on the image according to the following formula:

Among them, Image _c(t) (i, j, k) represents the sub-pixels on the image collected at the t-th viewpoint, t=0, 1, i=1～H, j=1～W; H represents The height of the image; W represents the width of the image; r represents the radius of the safe window; m, n represent the window coordinates with the center of the safe window as the origin; q=1～3; Image _m (i+m,j+n,q) represents subpixels on the image; Indicates that the sub-pixel (i+m, j+n, q) on the image is lit to the maximum brightness and affects the weight of the normalized brightness of the adjacent pixel (i, j, k).

The sub-pixel luminance influence weight obtained according to this step can be indexed into a weight matrix for subsequent processing.

S416: Based on the sub-pixel luminance influence weight on the image, the least squares method with bounding boxes is used to determine the composite image index map of the two viewpoints.

Specifically, this step may further include: based on the sub-pixel brightness influence weight on the image, using a least squares method with a bounding box, and determining the composite image index map of the two viewpoints according to the following formula:

in, Represents the difference in the influence weights of sub-pixel luminances corresponding to the two viewpoints; I represents the composite image index map of the two viewpoints, and is limited to the bounding box B _I ={I∈Z ^1×H :L≤I≤U}, L=0 ×I _1×H and U=255×I _1×H , I _1×H represents a full 1-column vector of H dimension; Represents the difference between the images collected from the two viewpoints; H represents the height of the image.

As an example, the composite image index I ₀ of the 0th view is determined by:

Step 1: Confine I in bounding box B _I ={I∈Z ^1×H :L≤I≤U}, where L=0×I _1×H and U=255×I _1×H ,I _{1 ×H} represents an H-dimensional all-one-column vector.

Step 2: Least-squares processing with bounding boxes is performed according to the following formula:

in, Represents the difference between the 0 viewpoint and 1 viewpoint captured images, Indicates the difference in the influence weights of sub-pixel brightness corresponding to two viewpoints, which is a full-rank sparse matrix of size (H×W×3, H×W×3), H represents the height of the image, W represents the width of the image; I represents the viewpoint’s width Composite graph index graph.

In the same way, we can obtain the composite map index map of the first viewpoint.

In a preferred embodiment, before step S414, the embodiment of the present invention may further include:

S412: Perform anti-distortion and region-of-interest extraction operations on the image.

For example, considering that the brightness between two pixels with a distance of N (N is an integer) pixels on the screen of the mobile terminal will not affect each other, the screen of the mobile terminal can be divided into a number of N×N pixels. Safe window. Therefore, it can be implemented by transmitting N×N×3 test images image _m to the mobile terminal. Among them, the resolution of the test chart is H×W. Among them, H represents the height of the test chart; W represents the width of the test chart. In the specific implementation process, the image acquisition units located at the observation points of the two viewpoints are used to capture the captured images respectively, and the captured images are subjected to anti-distortion and interest region extraction operations, thereby obtaining an image _c(0 with a resolution of H×W. ₎ image and image _c(1) image of resolution H×W. Wherein, the image acquisition unit includes, but is not limited to, a monocular camera, a binocular camera, and an industrial camera.

S420: Obtain a two-viewpoint map according to the position information of the acceleration and the rotation information of the angular velocity.

Specifically, this step can be implemented in the following manner: according to the position information of the acceleration and the rotation information of the angular velocity, the orientation of the captured image is adjusted to obtain a two-viewpoint map.

Wherein, the position information of the acceleration can be obtained by collecting the accelerometer sensor of the mobile terminal. The rotation information of the angular velocity can be obtained by collecting the gyroscope sensor of the mobile terminal. Thereby, the displacement and rotation posture of the viewer can be collected, so that the display of the mobile naked-eye three-dimensional virtual reality can be realized by using the displacement and the rotation posture.

In practical applications, a platform constructed by a mobile phone, a camera and a computer can be used to adjust the pose of the virtual camera on the computer side through step S420 to obtain a two-viewpoint map.

S430 : Based on the two-viewpoint composite map index map of the image, a composite map is rendered for the two-viewpoint map to obtain a three-dimensional virtual reality display image.

For example, a composite image is rendered according to the following formula to obtain a 3D virtual reality display image:

Syn=I ₀ ×view ₀ +I ₁ ×view ₁ ;

Wherein, Syn represents the 3D virtual reality display image; I ₀ represents the composite image index map of the 0th viewpoint; I ₁ represents the composite map index map of the first viewpoint; view ₀ represents the 0th viewpoint map; view ₁ represents the first viewpoint map.

In a preferred embodiment, this step S430 can also be implemented by the following manner: synthesizing the two-viewpoint image with two predetermined composite image index images whose display effects are black and white complementary to obtain a three-dimensional virtual reality display image.

In the above-mentioned embodiment, although each step is described according to the above-mentioned order, those skilled in the art can understand that, in order to realize the effect of this embodiment, different steps need not be performed in this order, and it can be performed simultaneously ( parallel) or in reverse order, simple variations of these are within the scope of the present invention.

It should be noted that, in the process of describing the various embodiments of the present invention, for the sake of brevity, the same parts are omitted, and those skilled in the art should understand that the description of an embodiment will not be in conflict. It can also be applied to another embodiment.

It should also be noted that the language used in this specification is primarily for readability and teaching purposes, and is not intended to explain or limit the scope of the invention.

The foregoing detailed description of example embodiments of the present invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form described. Obviously, many modifications and changes will be apparent to those skilled in the art. The embodiments were chosen and described in order to best explain the principles of the invention and its practical application, to thereby enable others skilled in the art to understand the invention for various embodiments and with various modifications as are suited to the particular use contemplated. The embodiments of the present invention may omit some of the above technical features, and only solve some technical problems existing in the prior art. Furthermore, the described technical features can be combined arbitrarily. The protection scope of the present invention is defined by the appended claims and their equivalents. Others skilled in the art can make various modifications or substitutions and combinations of the technical solutions described in the appended claims. The technical solutions after these modifications or substitutions All will fall within the protection scope of the present invention.

Claims (11)

1. A method for mobile naked-eye three-dimensional virtual reality based on optical path collection, wherein the method comprises: collect images; Obtaining a two-view composite map index map based on the collected image; According to the position information of the viewer's acceleration and the rotation information of the angular velocity, a two-view point graph is obtained; Based on the two-viewpoint composite map index map of the image, a composite map is rendered for the two-viewpoint map to obtain a three-dimensional virtual reality display image; The obtaining of the two-view composite image index map based on the collected image specifically includes: determining the influence weight of the surrounding sub-pixels of each sub-pixel on the image on the brightness of each sub-pixel; Based on the luminance influence weight on the image, the composite image index map of the two viewpoints is determined using a least squares method with a bounding box. 2. The method for mobile naked-eye three-dimensional virtual reality based on optical path collection according to claim 1, wherein the determining the brightness influence weight specifically comprises: The luminance influence weight on the image is determined according to the following formula: Wherein, the Image _c(t) (i,j,k) represents the sub-pixels on the image Image _c collected at the t-th viewpoint, the t=0, 1, the i=1～H, The j=1～W, the k represents the color channel of the image Image _c and k=1～3; the H represents the height of the image; the W represents the width of the image; the r represents the security Window radius; the m, n represent the window coordinates with the center of the safe window as the origin; the q represents the image and q=1～3; the Image _m (i+m, j+n, q) represents the sub-pixels on the image; the Indicates that when the sub-pixel (i+m, j+n, q) on the image is lit to the maximum luminance, the normalized luminance influence weight of the adjacent pixel (i, j, k) is affected. 3 . The method for mobile naked-eye 3D virtual reality based on optical path acquisition according to claim 1 , wherein, based on the luminance influence weight on the image, the least squares method with a bounding box is used to determine the method 3 . The composite image index map of the two viewpoints specifically includes: Based on the luminance influence weight, using the least squares method with bounding boxes, the composite image index map of the two viewpoints is determined according to the following formula: Among them, the Represents the difference in the corresponding luminance influence weights of the two viewpoints; the I represents the composite image index map of the two viewpoints, and is limited to the bounding box B _I ={I∈Z ^1×H :L≤I≤U }, L=0×I _1×H and U=255×I _1×H , the I _1×H represents a full 1-column vector of H dimension; the Represents the difference between the images collected from two viewpoints; the H represents the height of the image, and the Z represents an integer. 4 . The method for mobile naked-eye three-dimensional virtual reality based on optical path collection according to claim 1 , wherein before the step of determining the brightness influence weight, the method further comprises: 5 . Perform anti-distortion and region-of-interest extraction operations on the image. 5. The method for mobile naked-eye three-dimensional virtual reality based on optical path collection according to claim 1, wherein, obtaining a two-view point diagram according to the position information of acceleration and the rotation information of angular velocity, specifically comprising: According to the position information of the acceleration and the rotation information of the angular velocity, the orientation of the collected image is adjusted to obtain the two-viewpoint map. 6 . The method for mobile naked-eye 3D virtual reality based on optical path acquisition according to claim 1 , wherein, based on the two-viewpoint composite image index map of the image, a composite image is rendered for the two-viewpoint map. 7 . Figure, to obtain a three-dimensional virtual reality display image, specifically including: The composite image is rendered according to the following formula to obtain the three-dimensional virtual reality display image: Syn=I ₀ ×view ₀ +I ₁ ×view ₁ ; Wherein, the Syn represents the 3D virtual reality display image; the I ₀ represents the composite image index map of the 0th viewpoint; the I ₁ represents the composite map index map of the 1st viewpoint; the view ₀ represents the 0th viewpoint figure; the view ₁ represents the first viewpoint figure. 7. A system for mobile naked-eye three-dimensional virtual reality based on optical path collection, wherein the system comprises: an image acquisition unit for acquiring an image and sending the image to the controller; a mobile terminal, including a screen, on which a microlens array film is arranged, for sending the position information of acceleration and the rotation information of angular velocity to the controller, and displaying a three-dimensional virtual reality display image through the screen; The controller is connected in communication with the image acquisition unit and the mobile terminal respectively; it is used for processing the image to obtain a two-viewpoint composite map index map, and according to the position information of the acceleration and the angular velocity Rotate the information to obtain a two-viewpoint map, and based on the two-viewpoint composite map index map of the image, render a composite map for the two-viewpoint map, obtain the three-dimensional virtual reality display image, and convert the three-dimensional virtual reality sending the displayed image to the mobile terminal; The controller is further configured to perform the following operations: determine the luminance influence weight of each subpixel surrounding each subpixel on the image; and based on the luminance influence weight on the image, use a bounding box with The least squares method is used to determine the composite image index map of the two viewpoints. 8. The system for mobile naked-eye three-dimensional virtual reality based on optical path collection according to claim 7, wherein the mobile terminal comprises: Accelerometer, used to obtain the position information of the viewer's acceleration; Gyroscope, which is used to obtain the rotation information of the angular velocity of the viewer. 9 . The system for mobile naked-eye three-dimensional virtual reality based on optical path acquisition according to claim 7 , wherein the image acquisition unit is a monocular camera or a binocular camera. 10 . 10 . The system for mobile naked-eye three-dimensional virtual reality based on optical path collection according to claim 7 , wherein the mobile terminal is a mobile phone or a personal digital assistant. 11 . 11 . The system for mobile naked-eye three-dimensional virtual reality based on optical path acquisition according to claim 7 , wherein the controller is a computer, a server or an industrial computer. 12 .