WO2021110041A1 - 多视点3d显示屏、多视点3d显示终端 - Google Patents

多视点3d显示屏、多视点3d显示终端 Download PDF

Info

Publication number
WO2021110041A1
WO2021110041A1 PCT/CN2020/133335 CN2020133335W WO2021110041A1 WO 2021110041 A1 WO2021110041 A1 WO 2021110041A1 CN 2020133335 W CN2020133335 W CN 2020133335W WO 2021110041 A1 WO2021110041 A1 WO 2021110041A1
Authority
WO
WIPO (PCT)
Prior art keywords
sub
pixel
pixels
composite
viewpoint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/133335
Other languages
English (en)
French (fr)
Inventor
刁鸿浩
黄玲溪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ivisual 3D Technology Co Ltd
Visiotech Ventures Pte Ltd
Original Assignee
Beijing Ivisual 3D Technology Co Ltd
Visiotech Ventures Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Ivisual 3D Technology Co Ltd, Visiotech Ventures Pte Ltd filed Critical Beijing Ivisual 3D Technology Co Ltd
Priority to US17/781,387 priority Critical patent/US20230125908A1/en
Priority to EP20895286.1A priority patent/EP4068767A4/en
Publication of WO2021110041A1 publication Critical patent/WO2021110041A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/305Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/122Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/139Format conversion, e.g. of frame-rate or size
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/317Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using slanted parallax optics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/324Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00Aspects of the constitution of display devices
    • G09G2300/04Structural and physical details of display devices
    • G09G2300/0439Pixel structures
    • G09G2300/0452Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user

Definitions

  • This application relates to the field of 3D imaging, for example, to a multi-viewpoint 3D display screen and a multi-viewpoint 3D display terminal.
  • the resolution will drop sharply, for example, the column resolution drops to 1/N of the original resolution. Due to the pixel arrangement of the multi-viewpoint display, this will also result in different reductions in resolution in the horizontal and vertical directions.
  • the embodiments of the present disclosure provide a multi-viewpoint 3D display screen and a multi-viewpoint 3D display terminal, which are intended to overcome or alleviate at least some of the above-mentioned problems.
  • a multi-viewpoint 3D display screen including: a display panel including a plurality of composite pixels, each of the plurality of composite pixels includes a plurality of composite sub-pixels, and the plurality of composite sub-pixels Each of the composite sub-pixels includes multiple sub-pixels corresponding to multiple viewpoints of the multi-viewpoint 3D display screen; and multiple gratings are arranged side by side on the multiple composite pixels, and each grating of the multiple gratings includes a first oblique edge And the second oblique side, each grating obliquely covers a plurality of composite pixels so that the first oblique side and the second oblique side intersect each composite sub-pixel to define an inclination angle; wherein, in each composite sub-pixel, and The sub-pixels intersecting or adjacent to the first oblique side constitute the first terminal pixel, and the sub-pixels intersecting or adjacent to the second oblique side constitute the second terminal pixel; the inclination angle
  • the inclination angle is set such that, along the extension direction of the second oblique side of each grating, at least part of the adjacent composite pixels have a different color from the second terminal pixel having the largest overlap area with each grating.
  • the first terminal pixel constitutes a sub-pixel corresponding to the starting viewpoint, wherein, when the area covered by the sub-pixel intersecting the first oblique side in each composite sub-pixel is greater than or equal to the area threshold, and The sub-pixels intersecting the first oblique side constitute the sub-pixel corresponding to the starting viewpoint; or when the area covered by the sub-pixel intersecting the first oblique side in each composite sub-pixel is less than the area threshold, intersecting the first oblique side The next sub-pixel adjacent to the sub-pixel constitutes the sub-pixel corresponding to the starting viewpoint.
  • the second terminal pixel constitutes a sub-pixel corresponding to the end viewpoint, wherein, when the area covered by the sub-pixel intersecting the second hypotenuse in each composite sub-pixel is greater than or equal to the area threshold, the same as the first
  • the sub-pixels that intersect the two oblique sides constitute the sub-pixels corresponding to the end viewpoint; or when the area covered by the sub-pixels that intersect the second oblique side in each composite sub-pixel is less than the area threshold, the sub-pixels that intersect the second oblique side
  • the previous sub-pixel adjacent to the pixel constitutes the sub-pixel corresponding to the end viewpoint.
  • the dimensions in the length and width directions of each composite pixel are the same.
  • the plurality of gratings includes a plurality of cylindrical prism gratings.
  • each composite sub-pixel includes a plurality of sub-pixels in a single row or array.
  • the plurality of composite sub-pixels include at least one of a red composite sub-pixel, a green composite sub-pixel, and a blue composite sub-pixel.
  • a multi-viewpoint 3D display terminal including the above-mentioned multi-viewpoint 3D display screen.
  • the multi-viewpoint 3D display terminal further includes a 3D processing device configured to render corresponding sub-pixels among the multiple composite sub-pixels in the multi-viewpoint 3D display screen based on the 3D signal.
  • the 3D processing device is further configured to perform shift rendering on the corresponding sub-pixels of the multiple composite sub-pixels according to the viewpoint corresponding to the currently rendered sub-pixel and the viewpoint corresponding to the sub-pixel to be rendered next.
  • the multi-viewpoint 3D display terminal further includes a memory configured to store the correspondence relationship between the sub-pixels and the viewpoint; wherein the 3D processing device is configured to obtain the correspondence relationship.
  • the 3D processing device is an FPGA or ASIC chip or chipset.
  • the multi-viewpoint 3D display terminal further includes an eye positioning data acquisition device configured to acquire the user's eye positioning data.
  • FIGS. 1A to 1C are schematic structural diagrams of a multi-view 3D display terminal according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of the hardware structure of a multi-view 3D display terminal according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram of the software structure of a multi-view 3D display terminal according to an embodiment of the present disclosure
  • FIGS. 4A to 4B are schematic diagrams of composite pixels according to embodiments of the present disclosure.
  • 5A to 5E are schematic diagrams of the format and content of images included in a video frame of a 3D video signal according to an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of setting at least two 3D processing devices according to an embodiment of the present disclosure.
  • FIGS. 7A to 7C are schematic diagrams of the hardware structure and composite pixels for a multi-view 3D display screen according to an embodiment of the present disclosure
  • FIGS. 8A and 8B are schematic diagrams illustrating the inclination angle of the raster bevel of a multi-viewpoint 3D display screen according to an embodiment of the present disclosure
  • FIG. 9 is a schematic diagram of a sub-pixel shift rendering process of a multi-view 3D display screen according to an embodiment of the present disclosure.
  • the present disclosure provides a multi-viewpoint 3D display screen (for example: a multi-viewpoint naked-eye 3D display screen), including:
  • the display panel includes a plurality of composite pixels, each of the plurality of composite pixels includes a plurality of composite sub-pixels, and each composite sub-pixel of the plurality of composite sub-pixels is composed of i sub-pixels of the same color corresponding to i viewpoints.
  • Composition where i ⁇ 3;
  • each grating of the plurality of gratings includes a first oblique side and a second oblique side, and each grating of the plurality of gratings obliquely covers the plurality of composite pixels so that the first A hypotenuse and a second hypotenuse intersect each composite sub-pixel of the composite pixel to define an inclination angle;
  • each composite sub-pixel of the plurality of composite pixels the sub-pixel that intersects or is adjacent to the first oblique side of the grating constitutes the first terminal pixel, and the sub-pixel that intersects or is adjacent to the second oblique side of the raster constitutes the second terminal pixel.
  • Terminal pixel the sub-pixel that intersects or is adjacent to the first oblique side of the grating constitutes the first terminal pixel, and the sub-pixel that intersects or is adjacent to the second oblique side of the raster constitutes the second terminal pixel.
  • the inclination angle of the grating is set such that along the extension direction of the first oblique side of the grating, the color of the first terminal pixel having the largest overlap area with the grating in at least part of the adjacent composite pixels is different.
  • a 3D display screen 100 including a display panel 110.
  • the display panel 110 includes m ⁇ n composite pixels CP and thus defines m ⁇ n display resolution;
  • the display screen 100 also includes a plurality of gratings 120 covering m ⁇ n composite pixels CP;
  • the composite pixel CP includes multiple rows of composite sub-pixels CSP, each composite sub-pixel corresponds to i viewpoints Is composed of i sub-pixels P of the same color, where i ⁇ 3;
  • the grating edge 121 of the grating 120 intersects each row of composite sub-pixels CSP in each composite pixel CP; in each composite pixel CP, adjacent to the grating edge 121
  • the sub-pixel P constitutes the starting viewpoint pixel BWP of the composite pixel or the ending viewpoint pixel EWP in the adjacent composite pixels CP;
  • the inclination angle ⁇ of the grating edge 121 is configured such that: along the
  • the adjacent grating edge 121 defines the grating 120, and the main color of the initial viewpoint pixel BWP is defined as the color of the sub-pixel P in the initial viewpoint pixel and the sub-pixel with the largest overlap area of the grating 120.
  • the grating edge 121 includes a first oblique side 1211 and a second oblique side 1212.
  • the first oblique side 1211 and the second oblique side 1212 obliquely cover a plurality of composite pixels CP, and the first oblique side 1211 and the second oblique side 1212 are in the composite
  • the projection on the plane where the pixel CP is intersected with each composite sub-pixel CSP defines an inclination angle. That is, the first oblique side 1211 and the second oblique side 1212 are not parallel to the extending direction of each composite sub-pixel CSP.
  • the sub-pixel P that intersects or is adjacent to the first oblique side 1211 of the grating 120 constitutes a first terminal pixel
  • the sub-pixel P that intersects or is adjacent to the second oblique side 1212 of the grating 120 constitutes the second terminal pixel; according to the above-mentioned embodiment, the first terminal pixel may be defined as the starting viewpoint pixel BWP, and the second terminal pixel may be defined as the ending viewpoint pixel EWP.
  • the meaning of "intersection" mentioned above does not only include intersections that are on the same plane spatially.
  • the "intersection" here means that the composite sub-pixel CSP and the composite sub-pixel CSP are not on the same plane.
  • the first oblique side 1211 or the second oblique side 1212 is not on the same plane, the first oblique side 1211 and the second oblique side 1212 are projected onto the plane where the composite sub-pixel CSP is located, and the projection is in the same plane as the composite sub-pixel CSP intersect.
  • the first oblique side 1211 and the second oblique side 1212 are arranged obliquely, the inclination angle is controlled by the inclination angle, and the reference side of the inclination angle is based on the lower edge of the display panel 110.
  • the inclination angle of the grating 120 is set such that along the extension direction of the first oblique side 1211 of the grating, the color of the first terminal pixel having the largest overlap area with the grating 120 in at least part of the adjacent composite pixels CP is different.
  • the composite pixel CP includes a plurality of viewpoint pixels WP corresponding to the viewpoint. According to the viewpoint to be lit, the viewpoint pixel WP corresponding to the viewpoint is selected accordingly.
  • the viewpoint pixel WP displays different colors, and thus displays different pictures under the overall visual effect
  • the viewpoint pixel WP includes a plurality of sub-pixels P, each sub-pixel P has a different display color (for example, red, green, blue) and different
  • the sub-pixels P are arranged in a row according to the same color, and the sub-pixels P of the same color in each row form a composite sub-pixel CSP, and multiple rows of sub-pixels of the same color P forms a composite pixel CP.
  • the viewpoints of the images received by the left and right eyes for example, the left eye is at 2 viewpoints, and the right eye is at 7 viewpoints.
  • the display screen there are m ⁇ n composite pixels.
  • the viewpoint pixels WP corresponding to 2 viewpoints in the CP respectively display the left-eye image
  • the viewpoint pixels WP corresponding to the 7 viewpoints in the m ⁇ n composite pixels CP respectively display the right-eye image, thereby realizing a 3D effect.
  • each composite sub-pixel CSP has a corresponding sub-pixel P corresponding to each viewpoint.
  • the color of the sub-pixel P is the same; because the distribution of viewpoints is arranged in the row direction, When the user's eyes are moving, the corresponding viewpoint is in the process of changing, so different sub-pixels P need to be changed and rendered.
  • the sub-pixels P of the same color are arranged in the same line, the cross-color problem caused by persistence of vision can be avoided; Due to the refraction of the grating, it is possible to see a part of the current display sub-pixel P at an adjacent viewpoint position, and by arranging in the same color and in the same line, even if a part of the current display sub-pixel P is seen, the problem of color mixing will not occur.
  • the adjacent grating edges 121 define the grating 120.
  • the grating 120 In order to improve the moiré problem, the grating 120 often needs to be arranged obliquely. Since the grating edge 121 of the grating 120 is arranged obliquely, the sub-pixel P is generally cut and is The cut sub-pixel P may be seen at the viewpoint position corresponding to the viewpoint pixel WP on the left side of the grating edge 121, or may be seen by the viewpoint position corresponding to the viewpoint pixel WP on the right side of the grating edge 121, but because of the separate viewpoint position, Only the part of the sub-pixel P that is cut can be seen.
  • the area of the multiple sub-pixels P (initial sub-pixels) corresponding to the initial viewpoint pixel BWP in the composite pixel CP is not consistent, and the display area of a certain sub-pixel will always appear (or it can be defined as what is seen at the viewing viewpoint.
  • the area occupies the largest proportion among the plurality of sub-pixels P.
  • the color appearance order of the largest sub-pixels in the starting viewpoint pixel BWP in each composite pixel CP can be adjusted.
  • the arrangement position and order of each sub-pixel P can also be adjusted. To adjust the order in which the color of the sub-pixel with the largest area (this color can be defined as the main color) appears.
  • the first terminal pixel in the adjacent composite pixel CP that has the largest overlap area with the grating 120, that is, the initial viewpoint pixel BWP with the largest overlap area is different.
  • adjacent gratings 120 are arranged side by side, leaving no gaps at the edges, and the second oblique side 1212 of the current grating 120 will coincide with the first oblique side 1211 of the adjacent grating 120. Similarly, the current grating 120 The first oblique side 1211 of 120 will overlap with the second oblique side 1212 of another adjacent grating 120.
  • the above-mentioned overlap may be that when adjacent gratings 120 are on the same plane, the edge space overlaps; of course; If the adjacent gratings 120 are not in the same plane, for example, on planes parallel to each other, the above-mentioned overlap refers to the projection of the edge when projecting to a plane where the grating 120 is located, or the projection of the edge coincides with the projection of the edge. The edges of the gratings on the projection plane coincide.
  • the inclination angle of the grating 120 may also be set such that: along the extension direction of the second oblique side 1212 of the grating 120, at least part of the adjacent composite pixels CP have the second terminal pixel having the largest overlap area with the grating 120 The colors are not the same.
  • the display panel 110 can be prepared using the technology of manufacturing LCD, or the technology of manufacturing Micro LED.
  • the positions of the sub-pixels P are often arranged regularly and repeatedly. In this way, the efficiency of the preparation is effectively improved and the preparation process is simplified.
  • the sub-pixels P in each composite sub-pixel CSP in the composite pixel CP can also be arranged regularly and repetitively, that is, the spacing between the sub-pixels P can be set to remain unchanged, for example, sub-pixels in the same group
  • the spacing between the pixels P remains the same, and the row spacing of the sub-pixels P in the column direction remains the same; the positions of the sub-pixels P between adjacent rows can be aligned or staggered for other considerations.
  • the main color of the starting viewpoint pixel BWP (composed of the diagonally filled sub-pixels P in FIG. 7) of each composite pixel CP alternates in sequence, so that the main color of the raster edge 121
  • the components alternate in turn. Since the relationship between the corresponding viewpoints of the viewpoint pixels near the edge of the grating 121 is roughly the same in theory (individual composite pixels CP may have installation errors and can be calibrated later), so it is necessary to lighten the edges of the grating when displaying the entire picture For the viewpoint pixels near 121, it is avoided that the display color area of each composite pixel CP at the edge of the grating is the same, resulting in a flushing (or other colors).
  • the area of the sub-pixels P of different colors is taken turns
  • the proportion is the largest.
  • the composite pixel CP intersecting with it is along the column direction (along the extension direction of the raster edge 121), and the main color of the initial viewpoint pixel BWP
  • the blue area of BWP in the first composite pixel CP is the largest
  • the red area of BWP in the second composite pixel CP is the largest
  • the green area of BWP in the third composite pixel CP is the largest.
  • the specific area is the largest
  • the blue area of the BWP in the fourth composite pixel CP is the largest, which alternately changes in turn, thereby avoiding the problem of flushing (or other colors) or bright lines of the same color.
  • the sub-pixels P are often arranged in an array.
  • multiple sub-pixels P in the same column or same line form a pixel point.
  • 3D display due to the existence of grating In order to avoid moiré, gratings often need to be arranged obliquely, and the multiple sub-pixels in the corresponding viewpoint pixels can hardly be arranged in the same row or the same column. Therefore, it is necessary to redefine the arrangement of sub-pixels in the viewpoint pixels.
  • the sub-pixel P corresponding to the viewpoint pixel BWP at the start of the composite pixel CP that is, define the relationship between the viewpoint pixel BWP in the entire CP and the sub-pixel P of the same color in the composite sub-pixel CSP, and the definition of the initial viewpoint pixel for:
  • the first sub-pixel P belongs to the initial viewpoint pixel BWP;
  • the intersecting sub-pixel P belongs to the initial viewpoint pixel BWP, otherwise The next sub-pixel P of the intersecting sub-pixel along the oblique direction of the grating edge 121 belongs to the initial viewpoint pixel BWP.
  • the grating edge 121 is inclined to the right, and the grating edge 121 intersects the three composite sub-pixels CSP.
  • the grating edge 121 since there is a black matrix of a certain width between the sub-pixels P, when the grating edge 121 intersects the composite sub-pixel CSP, it may Does not intersect the sub-pixel P; when it does not intersect, the first sub-pixel on the right of the grating edge 121 is divided into the initial composite pixel BWP in the composite pixel CP; when the grating edge 121 intersects the sub-pixel P, the sub-pixel In pixels, when the area on the right of the grating edge 121 occupies half of the area of the sub-pixel P or is above other thresholds, the intersecting sub-pixel belongs to the initial viewpoint pixel BWP in the composite pixel CP; when the grating edge 121 and the sub-pixel P When the pixels P intersect, in the sub-pixel P, when the area on the right of the grating edge 121 is less than half of the area of the sub-pixel P or other thresholds, the intersecting sub-pixel does not belong to the initial viewpoint pixel BWP
  • the second sub-pixel P to the right belongs to the starting viewpoint pixel BWP in the composite pixel CP, and the intersecting sub-pixel P belongs to the ending viewpoint pixel EWP in the adjacent composite pixel CP.
  • the above-mentioned proportion threshold can also be set to two-thirds or other values.
  • the ending viewpoint (sub) pixel is defined as:
  • viewpoint sub-pixels P adjacent to the grating edge 121 those that are not classified into the starting viewpoint (sub) pixel BWP belong to the ending viewpoint (sub) pixel EWP.
  • the dimensions in the length and width directions of the composite pixel CP are approximately the same. This can effectively reduce the moiré, and the manufacturing process is simple.
  • each composite pixel CP includes a plurality of composite sub-pixels, and each composite sub-pixel is composed of i sub-pixels of the same color corresponding to i viewpoints, i ⁇ 3.
  • i 6
  • i 6
  • the three composite sub-pixels respectively correspond to three colors, namely red (R), green (G) and blue (B). That is, the three composite sub-pixels of each composite pixel have 6 red, 6 green, or 6 blue sub-pixels respectively.
  • each composite sub-pixel 410, 420, 430 in the composite pixel 400 is arranged in parallel.
  • Each composite sub-pixel 410, 420, 430 includes sub-pixels 411, 421, 431 in a single row.
  • the composite sub-pixels in the composite pixel are arranged differently or the sub-pixels in the composite sub-pixel are arranged differently.
  • each composite sub-pixel 470, 480, 490 in the composite pixel 400 are arranged in an array.
  • each composite sub-pixel 470, 480, 490 includes sub-pixels 471, 481, 491 in the form of an array of 2 ⁇ 3.
  • the number of viewpoints is 6, and each composite pixel CP is provided with three rows of composite sub-pixels CSP, and each viewpoint pixel is composed of three rows of composite sub-pixels CSP. It consists of 3 sub-pixels P.
  • the lighted viewpoint pixel WP can be adjusted according to the viewpoint information associated with the position of the eye acquired by the eye positioning device. Because in each composite pixel, the viewpoint pixel WP is different from the viewpoint The relationship has been fixed in advance, that is, rendering can be performed by simple shifting in each composite pixel, without calculating which sub-pixel needs to be lit according to the eye position, thus increasing the amount of calculation. In some existing In the solution, the calculation process will also involve the rounding process, and the solution in this embodiment avoids this problem, and only needs to shift and does not need to calculate the rounding process, thereby increasing the efficiency of rendering.
  • the inclination angle ⁇ of the grating edge 121 will be further described.
  • the sub-pixels P in the composite pixel CP are arranged in an array, and the intervals between the sub-pixels P in adjacent rows are the same, and the intervals between the adjacent sub-pixels P in the same column are also the same.
  • the middle point between the four adjacent sub-pixels P is the corner point.
  • the starting point of the raster edge 121 is set at the upper left corner point of the composite pixel CP near the area of a certain composite pixel CP.
  • the dots include three colors. It is further assumed that the composite pixel CP in this embodiment has 3 rows of same-color composite sub-pixels CSP.
  • the raster edge 121 and the next row of sub-pixels P intersect, they also pass through the corner points, so that the raster edge can be guaranteed 121 passes through the corner points regularly, and sets the adjacent corner points passed by the grating edge 121 as PA and PB.
  • the intersection between PA and PB will appear regularly between the next adjacent corner points. If PB is exactly on the starting row of the next composite pixel CP, the situation where the raster edge 121 passes through the composite pixel CP will be repeated in each composite pixel CP. For example, after the raster edge 121 cuts the sub-pixel P, the right The remaining sub-pixels with the largest area on the side will always reappear.
  • the sub-pixels that are always red will have the largest proportion after being cut. In this way, when the above definition of the viewpoint pixel WP is used, it will appear. In the starting point of view pixel BWP, the sub-pixels of the same color always occupy the largest area, so that flushing (or other colors) will occur. Similarly, if PB is exactly on the starting row of the next T composite pixel CP (T is greater than 1), the above problem will also occur at intervals, so that the proportion of a certain color in the starting viewpoint pixel BWP is always It will be larger than the proportion of other colors, and it will also bring about the above-mentioned display problems.
  • the cutting rule between adjacent corner points is not repeated between the three composite sub-pixels CSP, nor is it repeated between multiple composite sub-pixels CSP.
  • the blue sub-pixel occupies the largest area after cutting
  • the red sub-pixel The area is the largest after cutting. Cycle in turn.
  • the multi-viewpoint 3D display screen is a Micro-LED display panel.
  • the corresponding relationship between the starting point of view pixel and the point of view in the composite pixel intersecting the same raster edge 121 is the same; and/or, the ending point of the composite pixel intersecting the same raster edge 121
  • the correspondence between viewpoint pixels and viewpoints is the same.
  • the starting viewpoint pixel BWP in the composite pixel CP intersecting with the same raster edge 121 corresponds to viewpoint 1
  • the viewpoint corresponding to the ending viewpoint pixel EWP in the composite pixel CP intersecting with the same raster edge 121 is all viewpoint 6.
  • the viewpoint relationship needs to be corrected.
  • the initial viewpoint pixel BWP in the individual composite pixel CP that intersects with the same raster edge 121 corresponds to the viewpoint 6, and the adjacent composite pixel CP terminates
  • the viewpoint pixel EWP corresponds to viewpoint 5.
  • the display screen 100 may also be provided with information storing the relationship between the viewpoint pixels and the viewpoint, so that the 3D rendering processor obtains the corresponding relationship in real time during the image rendering process, thereby rendering the sub-pixel P .
  • a multi-viewpoint 3D display terminal 1000 is also provided, including the above-mentioned 3D display screen 100. Make the multi-viewpoint 3D display terminal display 3D effects.
  • the above-mentioned multi-viewpoint 3D display terminal 1000 may be configured as a multi-viewpoint 3D display terminal or a multi-viewpoint 3D display device.
  • the multi-viewpoint 3D display terminal 1000 further includes at least one 3D processing device 130.
  • the 3D processing device 130 is configured to generate a plurality of images corresponding to all viewpoints or predetermined viewpoints based on the images of the 3D video signal, and according to all the viewpoints. The generated multiple images render the corresponding viewpoint sub-pixels in each composite pixel.
  • the 3D processing device 130 is further configured to compare the viewpoint sub-pixels in the composite pixel according to the viewpoint position corresponding to the viewpoint sub-pixel currently being rendered, and the next viewpoint position corresponding to the viewpoint sub-pixel to be rendered in the next frame. Pixels are shifted and rendered. Referring to FIG. 9, the view point V2 is currently rendered, and the view point V6 is rendered in the next frame. By shifting, the data signal is shifted by four signals, that is, the picture displayed by V2 can be displayed to the position corresponding to the view point V6.
  • At least one 3D processing device 130 is configured to render at least one sub-pixel in each composite sub-pixel based on one of the two images and to render at least another sub-pixel in each composite sub-pixel based on the other of the two images. Sub-pixels.
  • the at least one 3D processing device 130 is configured to render at least two sub-pixels in each composite sub-pixel based on the composite image.
  • FIG. 1A shows a schematic structural diagram of a multi-view 3D display terminal 1000 according to an embodiment of the present disclosure.
  • a multi-view 3D display terminal 1000 is provided, which may include a multi-view 3D display screen 100, at least one 3D processing device 130, and a video for receiving video frames of a 3D video signal.
  • Signal interface 140 may include a multi-view 3D display screen 100, at least one 3D processing device 130, and a video for receiving video frames of a 3D video signal.
  • the multi-view 3D display screen 100 includes m columns and n rows of composite pixels and thus defines a display resolution of m ⁇ n.
  • the multi-view 3D display terminal 1000 may be provided with a single 3D processing device 130.
  • the single 3D processing device 130 processes the rendering of each composite sub-pixel of each composite pixel of the 3D display screen 100 at the same time.
  • the multi-view 3D display terminal 1000 may be provided with at least two 3D processing devices 130, which process each composite of the 3D display screen 110 in parallel, serial or serial-parallel. The rendering of each composite sub-pixel of the pixel.
  • the at least one 3D processing device 130 may also optionally include a buffer 131 to buffer the received video frames.
  • the at least one 3D processing device is an FPGA or ASIC chip or FPGA or ASIC chipset.
  • the multi-view 3D display terminal 1000 may further include a processor 101 communicatively connected to at least one 3D processing device 130 through the video signal interface 140.
  • the processor 101 is included in a computer or a smart terminal, such as a mobile terminal, or as a processor unit thereof.
  • the processor 101 may be arranged outside the multi-view 3D display terminal.
  • the multi-view 3D display terminal may be a non-intelligent 3D TV with an external 3D processing device.
  • the following exemplary embodiment of the multi-view 3D display terminal 1000 includes a processor inside.
  • the video signal interface 140 is configured as an internal interface connecting the processor 101 and the 3D processing device 130.
  • the video signal interface 140 as the internal interface of the multi-view 3D display terminal 200 may be a MIPI, mini-MIPI, LVDS, min-LVDS, or DisplayPort interface.
  • the processor 101 of the multi-view 3D display terminal 1000 may further include a register 102.
  • the register 102 can be used to temporarily store instructions, data, and addresses.
  • the multi-viewpoint 3D display terminal 1000 may further include an eye positioning device or an eye positioning data interface for acquiring real-time eye positioning data, so that the 3D processing device 130 can render composite pixels based on the eye positioning data ( Composite sub-pixel) in the corresponding sub-pixel.
  • the multi-viewpoint 3D display terminal 1000 further includes an eye positioning device 150 communicatively connected to the 3D processing device 130, so that the 3D processing device 130 can directly receive eye positioning data.
  • an eye positioning device (not shown) may be directly connected to the processor 101, for example, and the 3D processing device 130 obtains eye positioning data from the processor 101 via the eye positioning data interface 151.
  • the eye positioning device can be connected to the processor and the 3D processing device at the same time.
  • the 3D processing device 130 can directly obtain eye positioning data from the eye positioning device, and on the other hand, it can make the eye positioning device The other information obtained can be processed by the processor.
  • the display screen 100 can define six viewpoints V1-V6, and the user's eyes can see each composite pixel in the display panel of the multi-viewpoint 3D display screen 100 at each viewpoint (spatial position).
  • the display of the corresponding sub-pixel in the composite sub-pixel form a parallax, and a 3D image is synthesized in the brain.
  • the 3D processing device 130 receives a video frame, for example, a decompressed 3D video signal, from the processor 101 through, for example, a video signal interface 140 as an internal interface.
  • a video frame may contain or consist of two images with m ⁇ n resolution or a composite image with 2m ⁇ n or m ⁇ 2n resolution.
  • the two images or the composite image may include different types of images and may be in each arrangement.
  • the video frame of the 3D video signal includes or consists of two images 501 and 502 with m ⁇ n resolution in a side-by-side format.
  • the two images may be a left-eye parallax image and a right-eye parallax image, respectively.
  • the two images may be a rendered color image and a depth image, respectively.
  • the video frame of the 3D video signal contains or consists of two images 503 and 504 with m ⁇ n resolution in a top and bottom format.
  • the two images may be a left-eye parallax image and a right-eye parallax image, respectively.
  • the two images may be a rendered color image and a depth image, respectively.
  • the video frame of the 3D video signal includes a composite image 505 with a resolution of 2m ⁇ n in a left-right interleaving format.
  • the composite image may be a left-eye and right-eye parallax composite image that is interleaved left and right, and a composite image of rendered color and depth of field that is interleaved left and right.
  • the video frame of the 3D video signal includes a composite image 506 with a resolution of m ⁇ 2n in a top and bottom interleaving format.
  • the composite image may be a left-eye and right-eye disparity composite image that is interleaved up and down.
  • the composite image may be a composite image of rendered colors and depth of field interleaved up and down.
  • the video frame of the 3D video signal contains a composite image 507 with a resolution of 2m ⁇ n in a checkerboard format.
  • the composite image may be a left-eye and right-eye parallax composite image in a checkerboard format.
  • the composite image may be a rendered color image and a depth image in a checkerboard format.
  • the resolution of m ⁇ n may be a resolution above Full High Definition (FHD), including but not limited to 1920 ⁇ 1080, 1920 ⁇ 1200, 2048 ⁇ 1280, 2560 ⁇ 1440, 3840 ⁇ 2160, etc.
  • FHD Full High Definition
  • At least one 3D processing device 130 after at least one 3D processing device 130 receives a video frame including two images, it renders at least one sub-pixel in each composite sub-pixel based on one of the two images and based on the other of the two images. Render at least another sub-pixel in each composite sub-pixel.
  • at least one 3D processing device after receiving a video frame including a composite image, at least one 3D processing device renders at least two sub-pixels in each composite sub-pixel based on the composite image. For example, at least one sub-pixel is rendered according to the first image (partial) in the composite image, and at least another sub-pixel is rendered according to the second image (partial).
  • this is, for example, dynamic rendering based on eye positioning data.
  • the 3D processing device 130 in the embodiment of the present disclosure receives two images in the video frame data received through, for example, the video signal interface 140 configured as an internal interface
  • the resolution of each image corresponds to composite pixels divided by viewpoints (which include composite sub-pixels divided by viewpoints).
  • viewpoint information has nothing to do with the transmission process
  • this can achieve a 3D display with a small amount of processing calculation and no loss of resolution
  • the composite pixel corresponds to the viewpoint setting
  • the rendering of the display screen can be It is implemented in a "point-to-point" manner, which greatly reduces the amount of calculation.
  • the transmission and display of images or videos on conventional 3D monitors are still based on 2D display panels, which not only has the problem of resolution reduction and dramatic increase in rendering calculations, but also multiple format adjustments and images or videos. Display adaptation problems.
  • the register 102 of the processor 101 may be used to receive information about the display requirements of the multi-view 3D display screen 100.
  • the information is typically independent of i viewpoints and related to the m ⁇ of the multi-view 3D display screen 100. n resolution-related information, so that the processor 101 sends to the multi-view 3D display screen 100 video frames of 3D video signals that meet its display requirements.
  • the information may be, for example, a data packet used to initially establish a video transmission transmission.
  • the processor 101 when transmitting the video frames of the 3D video signal, the processor 101 does not need to consider the information related to the i viewpoints of the multi-view 3D display screen 100 (i ⁇ 3). Instead, the processor 101 can send to the multi-view 3D display screen 100 video frames of 3D video signals that meet its requirements by relying on the information related to the m ⁇ n resolution of the multi-view 3D display screen 100 received by the register 102.
  • the multi-view 3D display terminal 1000 may further include a codec configured to decompress, encode and decode the compressed 3D video signal and send the decompressed 3D video signal to at least one 3D video signal via the video signal interface 140. ⁇ 130 ⁇ Processing device 130.
  • the processor 101 of the multi-view 3D display terminal 1000 reads from the memory or receives the video frames of the 3D video signal from outside the multi-view 3D display terminal 100, for example, through an external interface, and then reads it via the video signal interface 140.
  • the video frames of the acquired or received 3D video signal are transmitted to at least one 3D processing device 130.
  • the multi-view 3D display terminal 1000 further includes a format adjuster (not shown), which is, for example, integrated in the processor 101 and configured as a codec or as part of a GPU for preprocessing 3D video signals.
  • a format adjuster (not shown), which is, for example, integrated in the processor 101 and configured as a codec or as part of a GPU for preprocessing 3D video signals.
  • Video frame so that the two images contained in it have a resolution of m ⁇ n or the composite image contained in it has a resolution of 2m ⁇ n or m ⁇ 2n.
  • the multi-view 3D display terminal may be a multi-view 3D display terminal including a processor.
  • the multi-view 3D display terminal may be configured as a smart cell phone, tablet computer, smart TV, wearable device, in-vehicle device, notebook computer, ultra mobile personal computer (UMPC), netbook, personal digital assistant (PDA) Wait.
  • UMPC ultra mobile personal computer
  • PDA personal digital assistant
  • Some embodiments of the present disclosure also provide a 3D display system, including the above-mentioned multi-viewpoint 3D display terminal 1000, and further including a processor that communicates with the multi-viewpoint 3D display terminal 1000, and the 3D display system is configured as a smart TV with a processor unit;
  • the 3D display system is a smart cellular phone, tablet computer, personal computer or wearable device; or, the 3D display system includes a set-top box as a processor unit or a cellular phone or tablet that can be screened, and a set-top box, a cellular phone or a tablet.
  • a digital television with a computer wired or wireless connection as a multi-view 3D display terminal or, the 3D display system is constructed as a smart home system or a part thereof, wherein the processor unit includes the smart gateway or central controller of the smart home system, and the smart home system also It includes an eye positioning device for obtaining eye positioning data; or, the 3D display system is configured as an entertainment interactive system or a part thereof.
  • FIG. 2 shows a schematic diagram of the hardware structure of a multi-view 3D display terminal 200 implemented as a mobile terminal, such as a smart cellular phone or a tablet computer.
  • the multi-view 3D display terminal 200 may include a processor 201, an external storage interface 202, an (internal) memory 203, a universal serial bus (USB) interface 204, a charging management module 205, a power management module 206, a battery 207, and a mobile communication module 208, wireless communication module 210, antennas 209, 211, audio module 212, speaker 213, receiver 214, microphone 215, earphone interface 216, buttons 217, motor 218, indicator 219, subscriber identity module (SIM) card interface 220, and more
  • SIM subscriber identity module
  • the sensor module 230 may include proximity light sensor 2301, ambient light sensor 2302, pressure sensor 2303, air pressure sensor 2304, magnetic sensor 2305, gravity sensor 2306, gyroscope sensor 2307, acceleration sensor 2308, distance sensor 2309, temperature sensor 2310, fingerprint Sensor 2311, touch sensor 2312, bone conduction sensor 2313, etc.
  • the structure illustrated in the embodiment of the present disclosure does not constitute a specific limitation on the multi-view 3D display terminal 200.
  • the multi-view 3D display terminal 200 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 201 may include one or more processing units, for example: the processor 201 may include an application processor (AP), a modem processor, a baseband processor, a graphics processing unit (GPU) 223, an image signal processor (ISP) ), controller, memory, video codec 224, digital signal processor (DSP), baseband processor, neural network processor (NPU), etc. or a combination thereof.
  • the different processing units may be independent devices or integrated in one or more processors.
  • the processor 201 may also be provided with a high-speed cache for storing instructions or data that have just been used or recycled by the processor 201. If the processor 201 needs to use the instruction or data again, it can be directly called from the memory.
  • the processor 201 may include one or more interfaces.
  • Interfaces can include integrated circuit (I2C) interface, integrated circuit built-in audio (I2S) interface, pulse code modulation (PCM) interface, universal asynchronous receiver transmitter (UART) interface, mobile industry processor interface (MIPI), universal input and output (GPIO) interface, user identification module (SIM) interface, universal serial bus (USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous receiver transmitter
  • MIPI mobile industry processor interface
  • GPIO universal input and output
  • SIM user identification module
  • USB universal serial bus
  • the I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL).
  • the processor 201 may include multiple sets of I2C buses.
  • the processor 201 may communicate with the touch sensor 2312, the charger, the flash, the camera unit 221, the eye positioning device 150, etc., respectively, through different I2C bus interfaces.
  • Both I2S interface and PCM interface can be used for audio communication.
  • the UART interface is a universal serial data bus used for asynchronous communication.
  • the bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication.
  • the UART interface is used to connect the processor 201 and the wireless communication module 210.
  • the MIPI interface may be used to connect the processor 201 and the multi-view 3D display screen 100.
  • the MIPI interface can also be used to connect peripheral devices such as the camera unit 221 and the eye positioning device 150.
  • the GPIO interface can be configured through software.
  • the GPIO interface can be configured as a control signal or as a data signal.
  • the GPIO interface may be used to connect the processor 201 and the camera unit 221, the multi-view 3D display screen 100, the wireless communication module 210, the audio module 212, the sensor module 230, and so on.
  • the USB interface 204 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on.
  • the USB interface 204 can be used to connect a charger to charge the multi-view 3D display terminal 200, and can also be used to transfer data between the multi-view 3D display terminal 200 and peripheral devices. It can also be used to connect headphones and play audio through the headphones.
  • the wireless communication function of the multi-view 3D display terminal 200 can be realized by the antennas 209 and 211, the mobile communication module 208, the wireless communication module 210, the modem processor or the baseband processor.
  • the antennas 209 and 211 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the multi-view 3D display terminal 200 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the mobile communication module 208 can provide a solution for wireless communication including 2G/3G/4G/5G, etc., which is applied to the multi-view 3D display terminal 200.
  • the mobile communication module 208 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and so on.
  • the mobile communication module 208 can receive electromagnetic waves by the antenna 209, filter and amplify the received electromagnetic waves, and transmit them to the modem processor for demodulation.
  • the mobile communication module 208 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 209.
  • at least part of the functional modules of the mobile communication module 208 may be provided in the processor 201.
  • at least part of the functional modules of the mobile communication module 208 and at least part of the modules of the processor 201 may be provided in the same device.
  • the wireless communication module 210 can provide applications on the multi-view 3D display terminal 200 including wireless local area network (WLAN), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), short-range wireless communication technology (NFC), Infrared technology (IR) and other wireless communication solutions.
  • the wireless communication module 210 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 210 receives electromagnetic waves via the antenna 211, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 201.
  • the wireless communication module 210 may also receive a signal to be sent from the processor 201, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 211.
  • the antenna 209 of the multi-view 3D display terminal 200 is coupled with the mobile communication module 208, and the antenna 211 is coupled with the wireless communication module 210, so that the multi-view 3D display terminal 200 can communicate with the network and other devices through wireless communication technology.
  • Wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA) , Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc.
  • GNSS may include Global Positioning Satellite System (GPS), Global Navigation Satellite System (GLONASS), Beidou Satellite Navigation System (BDS), Quasi-Zenith Satellite System (QZSS) and/or Satellite-Based Augmentation System (SBAS).
  • GPS Global Positioning Satellite System
  • GLONASS Global Navigation Satellite System
  • BDS Beidou Satellite Navigation System
  • QZSS Quasi-Zenith Satellite System
  • SBAS Satellite-Based Augmentation System
  • the external interface for receiving 3D video signals may include a USB interface 204, a mobile communication module 208, a wireless communication module 209, or a combination thereof.
  • other feasible interfaces for receiving 3D video signals are also conceivable, such as the aforementioned interfaces.
  • the memory 203 may be used to store computer executable program code, and the executable program code includes instructions.
  • the processor 201 executes various functional applications and data processing of the multi-view 3D display terminal 200 by running instructions stored in the memory 203.
  • the memory 203 may include a program storage area and a data storage area.
  • the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the multi-view 3D display terminal 200.
  • the memory 203 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.
  • UFS universal flash memory
  • the external memory interface 202 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the multi-view 3D display terminal 200.
  • the external memory card communicates with the processor 201 through the external memory interface 202 to realize the data storage function.
  • the memory of the multi-view 3D display terminal may include (internal) memory 203, an external memory card connected to external memory interface 202, or a combination thereof.
  • the video signal interface may also adopt different internal interface connection modes or combinations of the above-mentioned embodiments.
  • the camera unit 221 may capture images or videos.
  • the multi-view 3D display terminal 200 implements a display function through the video signal interface 140, the 3D processing device 130, the multi-view 3D display screen 100, and an application processor.
  • the multi-view 3D display terminal 200 may include a GPU, for example, used in the processor 201 to process 3D video images, and may also process 2D video images.
  • the multi-view 3D display terminal 200 further includes a video codec 224 for compressing or decompressing digital video.
  • the video signal interface 140 is used to output the 3D video signal processed by the GPU or the codec 224 or both, such as video frames of the decompressed 3D video signal, to the 3D processing device 130.
  • the GPU or codec 224 is integrated with a format adjuster.
  • the multi-view 3D display screen 100 is used to display 3D (3D) images, videos, and the like.
  • the multi-view 3D display screen 100 includes a display panel.
  • the display panel can use liquid crystal display (LCD), organic light emitting diode (OLED), active matrix organic light emitting diode or active matrix organic light emitting diode (AMOLED), flexible light emitting diode (FLED), Mini-LED, Micro -LED, Micro-OLED, Quantum Dot Light Emitting Diode (QLED), etc.
  • LCD liquid crystal display
  • OLED organic light emitting diode
  • AMOLED active matrix organic light emitting diode
  • FLED flexible light emitting diode
  • Mini-LED Micro -LED
  • Micro-OLED Quantum Dot Light Emitting Diode
  • the eye positioning device 150 is communicatively connected to the 3D processing unit 130, so that the 3D processing unit 130 can render the corresponding sub-pixels in the composite pixel (composite sub-pixel) based on the eye positioning data.
  • the eye positioning device 150 may also be connected to the processor 201, for example, the processor 201 is bypassed.
  • the multi-view 3D display terminal 200 can implement audio functions through the audio module 212, the speaker 213, the receiver 214, the microphone 215, the earphone interface 216, and the application processor. For example, music playback, recording, etc.
  • the audio module 212 is used for converting digital audio information into an analog audio signal for output, and also for converting an analog audio input into a digital audio signal.
  • the audio module 212 can also be used to encode and decode audio signals.
  • the audio module 212 may be provided in the processor 201, or part of the functional modules of the audio module 212 may be provided in the processor 201.
  • the speaker 213 is used to convert audio electrical signals into sound signals.
  • the multi-view 3D display terminal 200 can listen to music through the speaker 213 or listen to a hands-free call.
  • the receiver 214 also called “earpiece” is used to convert audio electrical signals into sound signals.
  • the microphone 215 is used to convert sound signals into electrical signals.
  • the earphone interface 216 is used to connect wired earphones.
  • the earphone interface 216 may be a USB interface 204, or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, or the American Cellular Telecommunications Industry Association (CTIA) standard interface.
  • OMTP Open Mobile Terminal Platform
  • CTIA American Cellular Telecommunications Industry Association
  • the button 217 includes a power button, a volume button, and so on.
  • the button 217 may be a mechanical button. It can also be a touch button.
  • the multi-view 3D display terminal 200 may receive key input, and generate key signal inputs related to user settings and function control of the multi-view 3D display terminal 200.
  • the motor 218 can generate vibration prompts.
  • the motor 218 can be used for incoming call vibration notification, and can also be used for touch vibration feedback.
  • the SIM card interface 220 is used to connect to a SIM card.
  • the multi-view 3D display terminal 200 adopts eSIM, that is, an embedded SIM card.
  • the pressure sensor 2303 is used to sense the pressure signal and can convert the pressure signal into an electrical signal.
  • the pressure sensor 2303 may be provided on the multi-view 3D display screen 100, which falls within the scope of the present invention.
  • the air pressure sensor 2304 is used to measure air pressure.
  • the multi-viewpoint 3D display terminal 200 calculates the altitude based on the air pressure value measured by the air pressure sensor 2304 to assist positioning and navigation.
  • the magnetic sensor 2305 includes a Hall sensor.
  • the gravity sensor 2306 is a sensor that converts motion or gravity into electrical signals, and is mainly used to measure parameters such as tilt angle, inertial force, impact and vibration.
  • the gyro sensor 2307 may be used to determine the movement posture of the multi-view 3D display terminal 200.
  • the acceleration sensor 2308 can detect the magnitude of the acceleration of the multi-view 3D display terminal 200 in various directions (generally three axes).
  • Distance sensor 2309 can be used to measure distance
  • the temperature sensor 2310 can be used to detect temperature.
  • the fingerprint sensor 2311 is used to collect fingerprints.
  • the multi-view 3D display terminal 200 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, and so on.
  • the touch sensor 2312 may be disposed in the multi-viewpoint 3D display screen 100, and the touch screen is composed of the touch sensor 2312 and the multi-viewpoint 3D display screen 100, which is also called a “touch screen”.
  • the bone conduction sensor 2313 can acquire vibration signals.
  • the charging management module 205 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 205 may receive the charging input of the wired charger through the USB interface 204.
  • the charging management module 205 may receive the wireless charging input through the wireless charging coil of the multi-view 3D display terminal 200.
  • the power management module 206 is used to connect the battery 207, the charging management module 205 and the processor 201.
  • the power management module 206 receives input from the battery 207 and/or the charging management module 205, and supplies power to the processor 201, the memory 203, the external memory, the multi-view 3D display screen 100, the camera unit 221, and the wireless communication module 210.
  • the power management module 206 and the charging management module 205 may also be provided in the same device.
  • the software system of the multi-view 3D display terminal 200 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture.
  • the embodiment shown in the present disclosure exemplarily illustrates the software structure of the multi-view 3D display terminal 200 by taking an Android system with a layered architecture as an example.
  • Android system with a layered architecture as an example.
  • the embodiments of the present disclosure can be implemented in different software systems, such as operating systems.
  • FIG. 3 is a schematic diagram of the software structure of a multi-view 3D display terminal 200 according to an embodiment of the present disclosure.
  • the layered architecture divides the software into several layers. Communication between layers through software interface.
  • the Android system is divided into four layers, from top to bottom, the application layer 310, the framework layer 320, the core class library and runtime (Runtime) 330, and the kernel layer 340, respectively.
  • the application layer 310 may include a series of application packages. As shown in Figure 3, the application package can include applications such as Bluetooth, WLAN, navigation, music, camera, calendar, call, video, gallery, map, short message, etc.
  • the 3D video display method according to the embodiment of the present disclosure may be implemented in a video application program, for example.
  • the framework layer 320 provides an application programming interface (API) and a programming framework for applications in the application layer.
  • the framework layer includes some predefined functions. For example, in some embodiments of the present disclosure, the function or algorithm for recognizing the collected 3D video image and the algorithm for processing the image may be included in the framework layer.
  • the framework layer 320 may include a resource manager, a phone manager, a content manager, a notification manager, a window manager, a view system, an installation package manager, and the like.
  • Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the framework layer run in a virtual machine.
  • the virtual machine executes the java files of the application layer and the framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • the core class library can include multiple functional modules. For example: 3D graphics processing library (for example: OpenGL ES), surface manager, image processing library, media library, graphics engine (for example: SGL), etc.
  • 3D graphics processing library for example: OpenGL ES
  • surface manager for example: image processing library
  • media library for example: SGL
  • graphics engine for example: SGL
  • the kernel layer 340 is a layer between hardware and software.
  • the kernel layer includes at least camera driver, audio and video interface, call interface, Wifi interface, sensor driver, power management, GPS interface.
  • multi-viewpoint 3D display terminal as a mobile terminal with the structure shown in FIG. 2 and FIG. 3 as an example, an embodiment of 3D video transmission and display in the multi-viewpoint 3D display terminal is described; however, it is conceivable that Other embodiments may include more or fewer features or make changes to the features.
  • a multi-view 3D display terminal 200 such as a mobile terminal, such as a smart cell phone or a tablet computer, is connected from a network, such as a mobile communication module 208 and an antenna 209 or a wireless communication module 210 and an antenna 211 as an external interface.
  • a network such as a mobile communication module 208 and an antenna 209 or a wireless communication module 210 and an antenna 211 as an external interface.
  • Cellular networks, WLAN networks, and Bluetooth receive, for example, compressed 3D video signals.
  • the compressed 3D video signals are processed by GPU 223 for image processing, codec 224 is encoded, decoded, and decompressed, and then, for example, video signal interface 140, such as MIPI, is used as an internal interface.
  • the interface or mini-MIPI interface sends the decompressed 3D video signal to at least one 3D processing device 130, and the video frame of the decompressed 3D video signal includes two images or composite images of the embodiment of the present disclosure. Furthermore, the 3D processing device 130 renders the sub-pixels in the composite sub-pixels of the display screen accordingly, thereby realizing 3D video playback.
  • the multi-view 3D display terminal 200 reads the (internal) memory 203 or reads the compressed 3D video signal stored in an external memory card through the external memory interface 202, and performs corresponding processing, transmission, and rendering. Realize 3D video playback.
  • the above-mentioned 3D video playback is implemented in a video application in the Android system application layer 310.
  • a typical implementation entity is a computer or its processor or other components.
  • the computer may be, for example, a personal computer, a laptop computer, a vehicle-mounted human-computer interaction device, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, and a tablet.
  • the computer may include one or more processors (CPU), input/output interfaces, network interfaces, and memory.
  • the memory may include non-permanent memory in computer readable media, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM).
  • the methods, programs, equipment, devices, etc. in the embodiments of the present invention may be executed or implemented in a single or multiple networked computers, and may also be practiced in a distributed computing environment.
  • tasks are performed by remote processing devices connected through a communication network.
  • the components of the device are described in the form of functional modules/units. It is conceivable that multiple functional modules/units are implemented in one or more "combined" functional modules/units and/or one or more software and/or hardware. It is also conceivable that a single functional module/unit is implemented by multiple sub-functional modules or a combination of sub-units and/or multiple software and/or hardware. The division of functional modules/units may only be a logical function division. In a specific implementation manner, multiple modules/units may be combined or integrated into another system.
  • connections of modules, units, devices, systems and their components in this document include direct or indirect connections, including feasible electrical, mechanical, and communication connections, especially wired or wireless connections between each type of interface, including But not limited to HDMI, Thunderbolt, USB, WiFi, and cellular networks.
  • the technical features, flowcharts and/or block diagrams of the methods and programs can be applied to corresponding devices, equipment, systems and their modules, units, and components.
  • each embodiment and feature of the device, device, system and its modules, units, and components can be applied to the method and program according to the embodiment of the present invention.
  • computer program instructions can be loaded into the processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing equipment to produce a machine that has one process or multiple processes implemented in a flowchart and/or a block diagram. Corresponding functions or features in the box or multiple boxes.
  • the methods and programs according to the embodiments of the present invention may be stored in a computer-readable memory or medium that can guide a computer or other programmable data processing equipment to work in a specific manner in the form of computer program instructions or programs.
  • the embodiment of the present invention also relates to a readable memory or medium storing methods, programs, and instructions that can implement the embodiments of the present invention.
  • Storage media include permanent and non-permanent, removable and non-removable items that can be used to store information by any method or technology.
  • the information can be computer-readable instructions, data structures, program modules, or other data.
  • Examples of storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM) ), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical storage, magnetic cartridge Type magnetic tape, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by computing devices.
  • PRAM phase change memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • RAM random access memory
  • ROM read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • flash memory or other memory technologies

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)

Abstract

本申请涉及3D影像领域,公开多视点3D显示屏,包括:显示面板,包括多个复合像素,每个复合像素包括多个复合子像素,每个复合子像素包括对应多个视点的多个子像素;多个光栅,并列设置在多个复合像素上,光栅包括第一斜边和第二斜边并倾斜覆盖在多个复合像素上,使第一斜边和第二斜边与复合子像素相交以限定出倾角;复合子像素中与第一斜边相交或临近的子像素构成第一端子像素,与第二斜边相交或临近的子像素构成第二端子像素;倾角使得:沿第一斜边的延伸方向,至少部分相邻复合像素中与光栅具有最大重叠面积的第一端子像素的颜色不相同。本申请能去除3D显示的泛红晕或其他颜色的问题。本申请还公开一种多视点3D显示终端。

Description

多视点3D显示屏、多视点3D显示终端
本申请要求在2019年12月05日提交中国知识产权局、申请号为201911231427.1、发明名称为“多视点裸眼3D显示屏、多视点裸眼3D显示终端”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及3D影像领域,例如涉及多视点3D显示屏、多视点3D显示终端。
背景技术
在常规的3D显示器的构造中,仅仅是在2D显示面板一侧或两侧设置光栅来提供3D显示效果,所以关于像素和子像素以及分辨率的定义均沿用2D显示器的理念。这带来了分辨率下降和渲染计算量激增的两难问题。
由于2D显示面板的分辨率总数为定值,因此分辨率会急剧下降,例如列分辨率降为原分辨率的1/N。由于多视点显示器的像素排布,这还会导致水平与竖直方向分辨率降低倍数不同。
如果要维持高清晰度的显示,在提供高清晰度例如N倍于2D显示器件的N视点3D显示器件的情况下,需要占用的终端到显示器的传输带宽也以N倍倍增,导致信号传输量太大。而且,对于这种N倍的高分辨率图像的像素级渲染会严重占用终端或显示器自身的计算资源,造成性能大幅下降。
而且,由于3D图像或视频的传输和显示以2D显示面板为基础,还可能存在多次格式调整和图像或视频显示适配的问题。这一方面可能会造成渲染计算量的进一步增加,另一方面可能会影响3D图像或视频的显示效果。
本背景技术仅为了便于了解本领域的相关技术,并不视作对现有技术的承认。
发明内容
为了对披露的实施例的一些方面有基本的理解,下面给出了一些实施例的概述,其不是要确定关键/重要组成元素或描绘发明的保护范围,而是作为后面的详细说明的序言。
本公开实施例提供一种多视点3D显示屏、多视点3D显示终端,意图克服或缓解上文提到的至少一些问题。
在一些实施例中,提供了一种多视点3D显示屏,包括:显示面板,包括多个复合像 素,多个复合像素中的每个复合像素包括多个复合子像素,多个复合子像素中的每个复合子像素包括对应于多视点3D显示屏的多个视点的多个子像素;和多个光栅,并列设置在多个复合像素上,多个光栅中的每个光栅包括第一斜边和第二斜边,每个光栅倾斜覆盖在多个复合像素上以使第一斜边和第二斜边与每个复合子像素相交以限定出倾角;其中,每个复合子像素中,与第一斜边相交或临近的子像素构成第一端子像素,与第二斜边相交或临近的子像素构成第二端子像素;倾角被设置为使得:沿每个光栅的第一斜边的延伸方向,至少部分相邻复合像素中与每个光栅具有最大重叠面积的第一端子像素的颜色不相同。
在一些实施例中,倾角被设置为使得:沿每个光栅的第二斜边的延伸方向,至少部分相邻复合像素中与每个光栅具有最大重叠面积的第二端子像素的颜色不相同。
在一些实施例中,第一端子像素构成对应起始视点的子像素,其中,在每个复合子像素中的与第一斜边相交的子像素被覆盖的面积大于或等于面积阈值时,与第一斜边相交的子像素构成对应起始视点的子像素;或在每个复合子像素中的与第一斜边相交的子像素被覆盖的面积小于面积阈值时,与第一斜边相交的子像素相邻的下一个子像素构成对应起始视点的子像素。
在一些实施例中,第二端子像素构成对应终止视点的子像素,其中,在每个复合子像素中的与第二斜边相交的子像素被覆盖的面积大于或等于面积阈值时,与第二斜边相交的子像素构成对应终止视点的子像素;或在每个复合子像素中的与第二斜边相交的子像素被覆盖的面积小于面积阈值时,与第二斜边相交的子像素相邻的上一个子像素构成对应终止视点的子像素。
在一些实施例中,每个复合像素的长宽方向上的尺寸相同。
在一些实施例中,多个光栅包括多个柱状棱镜光栅。
在一些实施例中,每个复合子像素包括呈单行或阵列形式的多个子像素。
在一些实施例中,多个复合子像素包括红色复合子像素、绿色复合子像素和蓝色复合子像素中至少之一。
在一些实施例中,倾角θ满足:tan(θ)=±3/(i×k),其中k不被3整除,i为视点的个数;或tan(θ)=±1\8。
在一些实施例中,提供了一种多视点3D显示终端,包括如上所述的多视点3D显示屏。
在一些实施例中,多视点3D显示终端还包括3D处理装置,被配置为基于3D信号渲染多视点3D显示屏中的多个复合子像素中的相应子像素。
在一些实施例中,3D处理装置还被配置为根据当前渲染的子像素对应的视点,和接下 来渲染的子像素对应的视点,对多个复合子像素中的相应子像素进行移位渲染。
在一些实施例中,多视点3D显示终端还包括存储器,被配置为存储子像素与视点的对应关系;其中,3D处理装置被配置为获取对应关系。
在一些实施例中,3D处理装置为FPGA或ASIC芯片或芯片组。
在一些实施例中,多视点3D显示终端还包括眼部定位数据获取装置,被配置为获取用户的眼部定位数据。
以上的总体描述和下文中的描述仅是示例性和解释性的,不用于限制本申请。
附图说明
一个或多个实施例通过与之对应的附图进行示例性说明,这些示例性说明和附图并不构成对实施例的限定,附图中具有相同参考数字标号的元件示为类似的元件,附图不构成比例限制,并且其中:
图1A至图1C是根据本公开实施例的多视点3D显示终端的结构示意图;
图2是根据本公开实施例的多视点3D显示终端的硬件结构示意图;
图3是根据本公开实施例的多视点3D显示终端的软件结构示意图;
图4A至图4B是根据本公开实施例的复合像素的示意图;
图5A至图5E是根据本公开实施例的3D视频信号的视频帧所包含图像的格式及内容的示意图;
图6是本公开实施例提供的设置至少两个3D处理装置的示意图;
图7A至图7C是根据本公开实施例的用于多视点3D显示屏硬件结构及复合像素的示意图;
图8A和图8B是根据本公开实施例的用于多视点3D显示屏的光栅斜边倾角的说明示意图;
图9是根据本公开实施例的多视点3D显示屏子像素移位渲染过程的示意图。
附图标记:
100:3D显示屏;101:处理器;102:寄存器;110:显示面板;120:光栅;CP:复合像素;CSP:复合子像素;P:子像素;121:光栅边缘;BWP:起始的视点像素;EWP:终止的视点像素;θ:倾角;1211:第一斜边;1212:第二斜边;1000:多视点3D显示终端;130:3D处理装置;131:缓存器;140:视频信号接口;150:眼部定位装置;200:多视点3D显示终端;201:处理器;202:外部存储接口;203:存储器;204:通用串行总线接口;205:充电管理模块;206:电源管理模块;207:电池;208:移动通信模块;210: 无线通信模块;209、211:天线;212:音频模块;213:扬声器;214:受话器;215:麦克风;216:耳机接口;217:按键;218:马达;219:指示器;220:用户标识模块卡接口;221:摄像单元;230:传感器模块;2301:接近光传感器;2302:环境光传感器;2303:压力传感器;2304:气压传感器;2305:磁传感器;2306:重力传感器;2307:陀螺仪传感器;2308:加速度传感器;2309:距离传感器;2310:温度传感器;2311:指纹传感器;2312:触摸传感器;2313:骨传导传感器;224:视频编解码器;触摸传感器2312;摄像单元221;310:应用程序层;320:框架层;330:核心类库和运行时;340:内核层;400:复合像素;410、420、430、470、480、490:复合子像素;411、421、431、471、481、491:子像素;501、502、503、504:图像;505、506:复合图像。
具体实施方式
为了能够更加详尽地了解本公开实施例的特点与技术内容,下面结合附图对本公开实施例的实现进行详细阐述,所附附图仅供参考说明之用,并非用来限定本公开实施例。
在本公开的一些实施例中,本公开提供了一种多视点3D显示屏(例如:多视点裸眼3D显示屏),包括:
显示面板,包括多个复合像素,多个复合像素中的每个复合像素包括多个复合子像素,多个复合子像素中的每个复合子像素由对应于i个视点的i个同色子像素构成,其中i≥3;和
并列设置在多个复合像素上的多个光栅,多个光栅中的每个光栅包括第一斜边和第二斜边,多个光栅的每个光栅倾斜覆盖在多个复合像素上以使第一斜边和第二斜边与复合像素的每个复合子像素相交以限定出倾角;
其中,多个复合像素中的每个复合子像素中,与光栅的第一斜边相交或临近的子像素构成第一端子像素,与光栅的第二斜边相交或临近的子像素构成第二端子像素;
光栅的倾角被设置为使得:沿光栅的第一斜边的延伸方向,至少部分相邻复合像素中与光栅具有最大重叠面积的第一端子像素的颜色不相同。
参照图1A、图7A至图7C,在本公开的一些实施例中,提供了一种3D显示屏100,包括显示面板110,显示面板110上包括m×n个复合像素CP并因此限定出m×n的显示分辨率;显示屏100还包括覆盖在m×n个复合像素CP上的多个光栅120;复合像素CP包括多行复合子像素CSP,每个复合子像素由对应于i个视点的i个同色的子像素P构成,其中i≥3;光栅120的光栅边缘121与每个复合像素CP中的每个行复合子像素CSP相交;每个复合像素CP中,临近光栅边缘121的子像素P组成复合像素的起始的视点像素 BWP或相邻的复合像素CP中的终止的视点像素EWP;光栅边缘121的倾角θ被配置为使得:沿光栅边缘121的延伸方向,复合像素CP中起始的视点像素的主颜色按照每个复合子像素CSP的颜色依次交替。
其中,相邻的光栅边缘121限定出光栅120,起始的视点像素BWP的主颜色定义为:起始的视点像素中的子像素P与光栅120重叠面积最大的子像素的颜色。
光栅边缘121包括第一斜边1211和第二斜边1212,第一斜边1211和第二斜边1212倾斜覆盖在多个复合像素CP上,第一斜边1211和第二斜边1212在复合像素CP所在平面上的投影与每个复合子像素CSP相交限定出倾角。即,第一斜边1211和第二斜边1212与每个复合子像素CSP的延伸方向不平行。在多个复合像素CP中的每个复合子像素CSP中,与光栅120的第一斜边1211相交或临近的子像素P构成第一端子像素,与光栅的第二斜边1212相交或临近的子像素P构成第二端子像素;根据上述的实施方式,第一端子像素可以定义为起始的视点像素BWP,第二端子像素可以定义为终止的视点像素EWP。上述的“相交”的含义并非仅仅包括空间上同处于一个平面上的相交,由于光栅边缘121与复合子像素CSP常常不处于同一个平面上,这里的“相交”是指,复合子像素CSP与第一斜边1211或者第二斜边1212不在一个平面上,将第一斜边1211和第二斜边1212投影到复合子像素CSP所在的平面上,投影与复合子像素CSP在同一个平面内相交。
第一斜边1211和第二斜边1212倾斜设置,倾斜的角度通过倾角来控制,倾角的参考边以显示面板110的下边缘为准。
光栅120的倾角被设置为使得:沿光栅的第一斜边1211的延伸方向,至少部分相邻复合像素CP中与光栅120具有最大重叠面积的第一端子像素的颜色不相同。
如图所示,光栅120下具有复合像素CP,复合像素CP中包括多个对应视点的视点像素WP,根据需要点亮的视点,相应选择和视点对应的视点像素WP,在本实施例中,为了实现视点像素WP显示不同的颜色,从而在整体视觉效果下显示不同的画面,视点像素WP包括多个子像素P,各个子像素P具有不同的显示颜色(例如红色、绿色、蓝色)和不同的显示亮度(通过电路控制驱动电压或者驱动电流进行控制),在本实施例中,子像素P按照同色进行同行排列,每行同色的子像素P形成复合子像素CSP,多行同色的子像素P形成复合像素CP。为了实现3D效果,根据用户眼部所在的位置,获取左右眼接收到图像的视点,例如,左眼在2视点,右眼在7视点,对应的,在显示屏中,m×n个复合像素CP中对应2视点的视点像素WP,各自对应显示左眼图像,m×n个复合像素CP中对应7视点的视点像素WP,各自对应显示右眼图像,从而实现3D效果。
在本实施例中,每个复合子像素CSP中,对应每个视点,具有相应的子像素P,行方 向上,子像素P的颜色相同;由于视点的分布是按照行方向上排布的,这样,在用户的眼部移动时,对应视点在变化过程中,从而需要变化渲染不同的子像素P,由于同色的子像素P同行排列,所以能够避免由于视觉暂留带来的串色问题;还有,由于光栅的折射,有可能会在相邻的视点位置看见当前显示子像素P的一部分,而通过同色、同行排列,即使当前显示子像素P的一部分被看见,也不会出现混色的问题。
在本实施例中,相邻的光栅边缘121限定出光栅120,出于改善摩尔纹的问题,光栅120常常需要倾斜设置,由于光栅120的光栅边缘121倾斜设置,一般会切割子像素P,被切割的子像素P即可能在光栅边缘121左面的视点像素WP对应的视点位置被看见,也可能被光栅边缘121右面的视点像素WP对应的视点位置被看见,但是由于在单独的视点位置上,仅能看见被切割的子像素P的部分。即,在复合像素CP中起始的视点像素BWP对应的多个子像素P(起始的子像素)的面积不一致,总会出现某个子像素的显示面积(或者可定义为在观看视点被看见的面积)在多个子像素P中占比最大。通过调整光栅边缘121的倾斜角度,可以调整各个复合像素CP中起始的视点像素BWP中的占比面积最大子像素的颜色出现的顺序,当然也可调整各个子像素P的排布位置与顺序来调整占比面积最大的子像素的颜色(此颜色可定义为主颜色)出现的顺序,当然,这种调整子像素P的排布位置与顺序的方需要较大的更改现有的制备显示面板的工艺步骤。一般地,可以采用,调整光栅边缘121的倾角的方式来调整各个复合像素CP中起始的视点像素BWP中的占比面积最大子像素的颜色出现的顺序,即,调整光栅边缘121的倾角的方式来调整各个复合像素CP中第一端子像素中与光栅120具有最大重叠面积子像素的颜色出现的顺序。发明人在实施方案中发现,如果复合像素CP中起始的视点像素BWP中的占比面积最大子像素的颜色总是较大概率连续出现,或者占比出现概率较大,则会影响初始的视点像素BWP的显示效果,例如,当总是连续红色占比最大,或者总体红色占比最大,则会出现泛红晕的情况,当然对于其他颜色也是如此。
在上述的实施例中,沿着第一斜边1211的延伸方向,相邻的复合像素CP中与光栅120具有最大重叠面积的第一端子像素,即具有最大重叠面积的初始的视点像素BWP不相同,或者按照颜色顺序交替出现,其中,颜色顺序例如可以按照R(红色)-G(绿色)-B(蓝色)的顺序。从而,在第一斜边1211附近观看到最大重叠面积的子像素,不会出现总是同样的色彩,出现泛红晕的情况。
在一些实施例中,相邻的光栅120并列设置,边缘不留间隙,当前的光栅120的第二斜边1212会和相邻的光栅120的第一斜边1211重合,类似地,当前的光栅120的第一斜边1211会和另一个相邻的光栅120的第二斜边1212重合,需要说明的是上述的重合可以 是相邻的光栅120同处一个平面时,边缘的空间重合;当然,如果相邻的光栅120不处于同一个平面,例如处于相互平行的平面上时,上述的重合指代的是投影到某一个光栅120所在平面时,边缘的投影重合,或者边缘的投影与处于投影平面上的光栅的边缘重合。
在一些实施例中,光栅120的倾角还可被设置为使得:沿光栅120的第二斜边1212的延伸方向,至少部分相邻复合像素CP中与光栅120具有最大重叠面积的第二端子像素的颜色不相同。
在本实施例中,显示面板110可以采用制备LCD的技术进行制备,也可采用制备Micro Led的技术进行制备,一般地,为了简化制备工艺,子像素P的位置常常会规律性的重复排列,这样,有效提高了制备的效率简化了制备的过程。在本实施例中,也可将复合像素CP中每个复合子像素CSP中的子像素P进行规律重复性的排列,即,可设置子像素P之间的间距保持不变,例如同行的子像素P之间的间距保持一致,列方向上子像素P的行距保持一致;相邻行的之间子像素P的位置可以对齐,也可出于其他的考虑相互位置错开。在本实施例中,可以选择将相邻行的之间的子像素P的位置对齐,可以有效简化制备工艺,同时为设置光栅边缘121的倾角设置提供了稳定条件。
在本实施例中,沿着光栅边缘121,每个复合像素CP的起始的视点像素BWP(图7中斜纹填充的子像素P组成)的主颜色依次交替,使得在光栅边缘121的主颜色分量依次交替,由于在光栅边缘121附近的视点像素的对应视点的关系理论上大致相同(个别复合像素CP有可能有安装误差,后期可校准),所以在显示整幅画面,需要点亮光栅边缘121附近的视点像素时,避免了光栅边缘的每个复合像素CP中的显示颜色面积占比相同,从而出现泛红晕(或者其他颜色),而是,轮流让不同颜色的子像素P的面积占比为最大,例如,对应行方向上第一条光栅边缘121,与之相交的复合像素CP沿着列方向上(沿着光栅边缘121的延伸方向上),起始的视点像素BWP的主颜色依次变化,例如,第一个复合像素CP中的BWP的蓝色占比面积最大,第二个复合像素CP中的BWP的红色占比面积最大,第三个复合像素CP中的BWP的绿色占比面积最大,第四个复合像素CP中的BWP的蓝色占比面积最大,依次交替变化,从而避免了泛红晕(或者其他颜色)或者同色亮线的问题。
为了便于显示面板上Color Filter的制作,子像素P,常常是阵列排布的,在2D显示中,同列或者同行的多个子像素P,组成一个像素点,而在3D显示中,由于光栅的存在,为了避免摩尔纹,光栅常常需要倾斜设置,对应的视点像素中的多个子像素,几乎不能按照同行、或者同列的方式进行排布,所以需要重新定义视点像素中子像素的排布关系,通过限定复合像素CP起始的视点像素BWP所对应的子像素P,即能限定整个CP中视点像 素BWP与复合子像素CSP中的同色的子像素P之间的关系,起始的视点像素的定义为:
如果光栅边缘121未与子像素P相交,沿着光栅边缘121的倾斜方向,第一个子像素P属于起始的视点像素BWP;
如果光栅边缘121与子像素P相交,相交的子像素P中,沿着光栅边缘121的倾斜方向剩下的面积大于或等于阈值时,则相交的子像素P属于起始的视点像素BWP,否则相交的子像素沿着光栅边缘121的倾斜方向的下一个子像素P属于起始的视点像素BWP。参考图7C,光栅边缘121向右倾斜,光栅边缘121与三个复合子像素CSP相交,其中,由于子像素P之间存在一定宽度的黑矩阵,光栅边缘121与复合子像素CSP相交时,可能不会与子像素P相交;当不相交时,光栅边缘121右边的第一个子像素划分到复合像素CP中的起始的复合像素BWP中;当光栅边缘121与子像素P相交时,子像素中,光栅边缘121右面的面积占到子像素P的面积的一半或者是其他阈值以上时,则相交的子像素属于复合像素CP中的起始的视点像素BWP中;当光栅边缘121与子像素P相交时,子像素P中,光栅边缘121右面的面积小于子像素P的面积的一半或者是其他阈值时,则相交的子像素不属于复合像素CP中的起始的视点像素BWP中,而是往右第二个子像素P属于复合像素CP中的起始的视点像素BWP,而相交的子像素P属于相邻的复合像素CP中的终止的视点像素EWP。上述的占比阈值还可设置成三分之二或者其他值。
终止的视点(子)像素的定义为:
在临近光栅边缘121的视点子像素P中,没有被归入起始的视点(子)像素BWP的,属于终止的视点(子)像素EWP。
在本实施例的一些方案中,复合像素CP的长宽方向上的尺寸大致相等。这样能够有效减少摩尔纹,并且制作工艺简单。
在一些实施例中,每个复合像素CP包括多个复合子像素,每个复合子像素由对应于i个视点的i个同色子像素构成,i≥3。在图1A所示的实施例中,i=6,但可以想到i为其他数值。在所示的实施例中,多视点3D显示屏可相应地具有i(i=6)个视点(V1-V6),但可以想到可以相应地具有更多或更少个视点。
结合参考图1A和图4A,在所示的实施例中,每个复合像素包括三个复合子像素,并且每个复合子像素由对应于6视点(i=6)的6个同色子像素构成。三个复合子像素分别对应于三种颜色,即红(R)、绿(G)和蓝(B)。也就是说,每个复合像素的三个复合子像素分别具有6个红色、6个绿色或6个蓝色的子像素。
在图1A和图4A所示的实施例中,复合像素400中的复合子像素410、420、430平行布置。每个复合子像素410、420、430包括呈单行形式的子像素411、421、431。但可以 想到,复合像素中的复合子像素不同排布方式或复合子像素中的子像素的不同排布形式。
在图4B所示的实施例中,复合像素400中的复合子像素470、480、490阵列布置。例如,每个复合子像素470、480、490包括呈阵列2×3形式的子像素471、481、491。
如图1A所示,本实施例的一些方案中,视点数量为6个,每个复合像素CP中,设有三行复合子像素CSP,每个视点像素由分别来自三行复合子像素CSP中的3个子像素P组成。
在本实施例中的一些方案中,光栅边缘121的倾角θ满足如下公式,tan(θ)=±3/(i×k),其中k不被3整除,i为视点的个数。其中,θ逆时针偏转为正,顺时针偏转为负。
本实施例中的显示屏中,能够根据眼部定位装置获取到的眼部所在位置相关联的视点信息,调整点亮的视点像素WP,由于在每个复合像素中,视点像素WP与视点之间的关系已经预先固定,即在每个复合像素中通过简单的移位即可进行渲染,而不需根据眼部位置计算哪个子像素需要点亮,从而增加了计算量,在一些现有的方案中,计算的过程还会涉及取整的过程,而本实施例中的方案避免了这个问题,仅需移位,不需要计算取整的过程,从而增加了渲染的效率。
在本实施例中的一些方案中,光栅边缘的倾角θ满足tan(θ)=±1\8。
参考图8A、图8B,进一步对光栅边缘121的倾角θ进行说明。复合像素CP中的子像素P阵列排布,相邻的同行的子像素P间隔相同,相邻的同列的子像素P的间隔也相同。相邻的四个子像素P之间的中间点为角点,为了直观说明问题,某个复合像素CP区域附近,设定光栅边缘121的起始点位于复合像素CP最左上的角点,由于常规像素点包括三种颜色,进一步设定本实施例中的复合像素CP具有3行同色复合子像素CSP,光栅边缘121与下一行子像素P相交时,正好也穿过角点,则可保证光栅边缘121规律性的穿过角点,设置相邻被光栅边缘121穿过的角点为PA、PB,PA与PB之间的相交情况将要,规律性的在下一个相邻的角点之间出现,如果PB正好位于下一个复合像素CP的起始行上,则光栅边缘121穿过复合像素CP的情况则会在每个复合像素CP中重复出现,例如,光栅边缘121切割子像素P后,右侧剩下的面积最大的子像素,总是会重复出现,例如,会出现总是红色的子像素被切割后占比最大,这样,在沿用上述的视点像素WP的定义时,则会出现,在起始的视点像素BWP中,总是同色的子像素的占比面积最大,这样就会出现泛红晕(或者其他颜色)的情况。同样的,如果PB正好位于下T个复合像素CP的起始行上(T大于1),也会间隔性地出现上述的问题,让起始的视点像素BWP中某个颜色的占比总是会大于其他颜色的占比,同样会带来上述的显示问题。
由此,本实施例设定相邻的角点之间的切割规律不在3个复合子像素CSP之间重复, 也不再3的倍数个复合子像素CSP之间重复。
为了更加直观的表达上述的设定,参照图8A、图8B,进行公示推导如下:
具有i个视点像素WP的复合像素的宽尺寸为W=i×(w1+w2),w1为子像素P宽尺寸,w2为子像素P行方向上的间距;
高尺寸为H=3×(h1+h2),h1为子像素P高尺寸,h2为子像素列方向上的间距;
由于具有i个视点像素WP的复合像素的宽尺寸与高尺寸一致,则有:W=i×(w1+w2)=H=3×(h1+h2);
相邻的角点PA、PB之间,具有k行复合子像素CSP,k不被3整除;则光栅边缘的倾角θ满足:tan(θ)=(w1+w2)/k×(h1+h2)/;根据上述宽尺寸与高尺寸一致的关系,上式可简化为,tan(θ)=(3×(h1+h2)/i)/k×(h1+h2)=3/(i×k);
综上,光栅边缘121的倾角θ满足:tan(θ)=3/(i×k),i为视点的个数,k为不被3整除的整数,如图8A所示,k=4,i=6,则tan(θ)=3/24=1/8,第一个复合像素CP中,蓝色的子像素切割后占比面积最大,第二个复合像素CP中,红色的子像素切割后占比面积最大。依次循环下去。
如图8B所示,k=5,i=6,则tan(θ)=1/10。
在本实施例中的一些方案中,多视点3D显示屏为Micro-LED显示面板。
在本实施例中的一些方案中,与同一光栅边缘121相交的复合像素中的起始的视点像素与视点的对应关系相同;和\或,与同一光栅边缘121相交的复合像素中的终止的视点像素与视点的对应关系相同。例如,与同一光栅边缘121相交的复合像素CP中起始的视点像素BWP对应的视点都为视点1,与同一光栅边缘121相交的复合像素CP中终止的视点像素EWP对应的视点都为视点6,当然,实际使用中,由于实际尺寸关系,需要经过校正视点关系,与同一光栅边缘121相交的个别复合像素CP中的起始的视点像素BWP对应视点6,相邻的复合像素CP的终止的视点像素EWP对应视点5。本公开中,还可为显示屏100,设置有存储有视点像素与视点之间关系的信息,从而在3D渲染处理器在图像渲染过程中,实时的获取对应关系,从而对子像素P进行渲染。
在本公开的另外的实施例中,还提供了一种多视点3D显示终端1000,包括了上述的3D显示屏100。使得多视点3D显示终端显示3D效果。上述的多视点3D显示终端1000可被构造为多视点3D显示终端或者多视点3D显示装置。
在一些实施例中,多视点3D显示终端1000,还包括至少一个3D处理装置130,3D处理装置130配置为基于3D视频信号的图像生成对应于全部视点或预定的视点的多个图像并依据所生成的多个图像渲染每个复合像素中对应的视点子像素。
在一些实施例中,3D处理装置130还配置为根据当前被渲染的视点子像素对应的视点位置,和下一帧被渲染的视点子像素对应的下一视点位置,对复合像素中的视点子像素进行移位渲染。参考图9所示,当前渲染视点V2,下一帧渲染视点V6,通过移位,将数据信号移位四个信号,即能将V2显示的画面显示到视点V6对应的位置。
在一些实施例中,至少一个3D处理装置130配置为基于两幅图像之一渲染每个复合子像素中至少一个子像素并基于两幅图像中另一幅渲染每个复合子像素中至少另一个子像素。
在另外的一些实施例中,至少一个3D处理装置130配置为基于复合图像渲染每个复合子像素中至少两个子像素。
图1A示出了本公开一个实施例提供的多视点3D显示终端1000的结构示意图。参考图1A,在本公开一个实施例中提供了一种多视点3D显示终端1000,其可包括多视点3D显示屏100、至少一个3D处理装置130和用于接收3D视频信号的视频帧的视频信号接口140。
如图1A所示,多视点3D显示屏100包括m列n行个复合像素并因此限定出m×n的显示分辨率。
在一些实施例中,例如图1A-1C所示,多视点3D显示终端1000可设置有单个3D处理装置130。该单个3D处理装置130同时处理对3D显示屏100的每个复合像素的每个复合子像素的渲染。
在另一些实施例中,例如图6所示,多视点3D显示终端1000可设置有至少两个3D处理装置130,它们并行、串行或串并行结合地处理对3D显示屏110的每个复合像素的每个复合子像素的渲染。
本领域技术人员将明白,上述至少两个3D处理装置可以有其他的方式分配且并行处理3D显示屏100的多行多列复合像素或复合子像素,这落入本发明的范围内。
在一些实施例中,至少一个3D处理装置130还可以选择性地包括缓存器131,以便缓存所接收到的视频帧。
在一些实施例中,至少一个3D处理装置为FPGA或ASIC芯片或FPGA或ASIC芯片组。
继续参考图1A,多视点3D显示终端1000还可包括通过视频信号接口140通讯连接至至少一个3D处理装置130的处理器101。在本文所示的一些实施例中,处理器101被包括在计算机或智能终端、如移动终端中或作为其处理器单元。但是可以想到,在一些实施例中,处理器101可以设置在多视点3D显示终端的外部,例如该多视点3D显示终端可 以为外接3D处理装置的非智能的3D电视。
为简单起见,下文中的多视点3D显示终端1000的示例性实施例内部包括处理器。进而,视频信号接口140构造为连接处理器101和3D处理装置130的内部接口,参考图2和图3所示的以移动终端方式实施的多视点3D显示终端200可更明确该结构。在本发明的一些实施例中,作为多视点3D显示终端200的内部接口的视频信号接口140可以为MIPI、mini-MIPI接口、LVDS接口、min-LVDS接口或Display Port接口。在一些实施例中,如图1A所示,多视点3D显示终端1000的处理器101还可包括寄存器102。寄存器102可用与暂存指令、数据和地址。
在一些实施例中,多视点3D显示终端1000还可包括用于获取实时眼部定位数据的眼部定位装置或眼部定位数据接口,从而3D处理装置130可以基于眼部定位数据渲染复合像素(复合子像素)中的相应子像素。例如图1B所示的实施例中,多视点3D显示终端1000还包括通讯连接至3D处理装置130的眼部定位装置150,由此3D处理装置130可以直接接收眼部定位数据。在图1C所示的实施例中,眼部定位装置(未示出)例如可以直接连接处理器101,而3D处理装置130经由眼部定位数据接口151从处理器101获得眼部定位数据。在另一些实施例中,眼部定位装置可同时连接处理器和3D处理装置,这一方面3D处理装置130可以直接从眼部定位装置获取眼部定位数据,另一方面可以使得眼部定位装置获取的其他信息可以被处理器处理。
结合参考图1A-C和图5A-E,描述本公开一些实施例的多视点3D显示终端内的3D视频信号传输和显示。在所示的实施例中,该显示屏100可以限定出6个视点V1-V6,用户的眼睛在每个视点(空间位置)可看到多视点3D显示屏100的显示面板中每个复合像素的复合子像素中相应的子像素的显示。用户的双眼在不同的视点看到的两个不同画面形成视差,在大脑中合成3D的画面。
在本公开的一些实施例中,3D处理装置130通过例如作为内部接口的视频信号接口140从处理器101接收例如为解压缩的3D视频信号的视频帧。每个视频帧可包含具有m×n分辨率的两幅图像或者包含具有2m×n或m×2n分辨率的复合图像,或者由其构成。
在一些实施例中,两幅图像或复合图像可以包括不同类型的图像以及可以呈每个种排布形式。
如图5A所示,3D视频信号的视频帧包含并列格式的具有m×n分辨率的两幅图像501、502或由其构成。在一些实施例中,两幅图像可以分别为左眼视差图像和右眼视差图像。在一些实施例中,两幅图像可以分别为渲染色彩图像和景深图像。
如图5B所示,3D视频信号的视频帧包含上下格式的具有m×n分辨率的两幅图像 503、504或由其构成。在一些实施例中,两幅图像可以分别为左眼视差图像和右眼视差图像。在一些实施例中,两幅图像可以分别为渲染色彩图像和景深图像。
如图5C所示,3D视频信号的视频帧包含左右交织格式的具有2m×n分辨率的复合图像505。在一些实施例中,复合图像可以为左右交织的左眼和右眼视差复合图像、左右交织的渲染色彩和景深复合图像。
如图5D所示,3D视频信号的视频帧包含上下交织格式的具有m×2n分辨率的复合图像506。在一些实施例中,复合图像可以为上下交织的左眼和右眼视差复合图像。在一些实施例中,复合图像可以为上下交织的渲染色彩和景深的复合图像。
如图5E所示,3D视频信号的视频帧包含棋盘格式的具有2m×n分辨率的复合图像507。在一些实施例中,复合图像可以为棋盘格式的左眼和右眼视差复合图像。在一些实施例中,复合图像可以为棋盘格式的渲染色彩图像和景深图像。
本领域技术人员将明白,附图所示的实施例仅是示意性的,3D视频信号的视频帧所包含的两幅图像或复合图像可以包括其他类型的图像以及可以呈其他排布形式,这落入本发明的范围内。
在一些实施例中,m×n的分辨率可以为全高清(FHD)以上的分辨率,包括但不限于,1920×1080、1920×1200、2048×1280、2560×1440、3840×2160等。
在一些实施例中,至少一个3D处理装置130在接收到包括两幅图像的视频帧后,基于两幅图像之一渲染每个复合子像素中至少一个子像素并基于两幅图像中另一幅渲染每个复合子像素中至少另一个子像素。类似地,在一些实施例中,至少一个3D处理装置在接收到包括复合图像的视频帧后,基于复合图像渲染每个复合子像素中至少两个子像素。例如,根据复合图像中的第一图像(部分)渲染至少一个子像素,根据第二图像(部分)渲染至少另一个子像素。
在一些实施例中,这例如是基于眼部定位数据来动态渲染。
作为解释而非限制地,由于在本公开实施例中的3D处理装置130通过例如构造为内部接口的视频信号接口140接收到的视频帧数据包含的两幅图像,每个图像的分辨率(或复合图像分辨率的一半)与按照视点划分的复合像素(其包括按照视点划分的复合子像素)相对应。一方面,由于视点信息与传输过程无关,这能够实现处理计算量小且分辨率不受损失的3D显示;另一方面,由于复合像素(复合子像素)对应于视点设置,显示屏的渲染能够以“点对点”的方式实现,大大降低了计算量。相比之下,常规的3D显示器的图像或视频的传输和显示仍以2D显示面板为基础,不仅存在分辨率下降和渲染计算量剧增的问题,还可能存在多次格式调整和图像或视频显示适配的问题。
在一些实施例中,处理器101的寄存器102可用于接收有关多视点3D显示屏100的显示要求的信息,该信息典型地为与i个视点无关地且与多视点3D显示屏100的m×n分辨率相关的信息,以便处理器101向多视点3D显示屏100发送符合其显示要求的3D视频信号的视频帧。该信息例如可以为用于初始建立视频传输发送的数据包。
因此,在传输3D视频信号的视频帧时,处理器101无需考虑与多视点3D显示屏100的i个视点相关的信息(i≥3)。而是,处理器101凭借寄存器102接收到的与多视点3D显示屏100的m×n分辨率相关的信息就能够向多视点3D显示屏100发送符合其要求的3D视频信号的视频帧。
在一些实施例中,多视点3D显示终端1000还可以包括编解码器,配置为对压缩的3D视频信号解压缩和编解码并将解压缩的3D视频信号经视频信号接口140发送至至少一个3D处理装置130。
在一些实施例中,多视点3D显示终端1000的处理器101从存储器读取或从多视点3D显示终端100以外、例如通过外部接口接收3D视频信号的视频帧,然后经由视频信号接口140将读取到的或接收到的3D视频信号的视频帧传输到至少一个3D处理装置130。
在一些实施例中,多视点3D显示终端1000还包括格式调整器(未示出),其例如集成在处理器101中,构造为编解码器或者作为GPU的一部分,用于预处理3D视频信号的视频帧,以使其包含的两幅图像具有m×n的分辨率或者使其包含的复合图像具有2m×n或m×2n的分辨率。
如前,本公开一些实施例提供的多视点3D显示终端可以是包含处理器的多视点3D显示终端。在一些实施例中,多视点3D显示终端可构造为智能蜂窝电话、平板电脑、智能电视、可穿戴设备、车载设备、笔记本电脑、超级移动个人计算机(UMPC)、上网本、个人数字助理(PDA)等。
本公开一些实施例还提供了一种3D显示系统,包括上述多视点3D显示终端1000,还包括与多视点3D显示终端1000通讯连接处理器,3D显示系统构造为具有处理器单元的智能电视;或者,3D显示系统为智能蜂窝电话、平板电脑、个人计算机或可穿戴设备;或者,3D显示系统包括作为处理器单元的机顶盒或可投屏的蜂窝电话或平板电脑和与机顶盒、蜂窝电话或平板电脑有线或无线连接的作为多视点3D显示终端的数字电视;或者,3D显示系统构造为智能家居系统或其一部分,其中处理器单元包括智能家居系统的智能网关或中央控制器,智能家居系统还包括用于获取眼部定位数据的眼部定位装置;或者,3D显示系统构造为娱乐互动系统或其一部分。
示例性的,图2示出了实施为移动终端、如智能蜂窝电话或平板电脑的多视点3D显 示终端200的硬件结构示意图。该多视点3D显示终端200可以包括处理器201,外部存储接口202,(内部)存储器203,通用串行总线(USB)接口204,充电管理模块205,电源管理模块206,电池207,移动通信模块208,无线通信模块210,天线209、211,音频模块212,扬声器213,受话器214,麦克风215,耳机接口216,按键217,马达218,指示器219,用户标识模块(SIM)卡接口220,多视点3D显示屏100,3D处理装置130,视频信号接口140,摄像单元221,眼部定位装置150,以及传感器模块230等。其中传感器模块230可以包括接近光传感器2301,环境光传感器2302,压力传感器2303,气压传感器2304,磁传感器2305,重力传感器2306,陀螺仪传感器2307,加速度传感器2308,距离传感器2309,温度传感器2310,指纹传感器2311,触摸传感器2312,骨传导传感器2313等。
可以理解的是,本公开实施例示意的结构并不构成对多视点3D显示终端200的具体限定。在本公开另一些实施例中,多视点3D显示终端200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器201可以包括一个或多个处理单元,例如:处理器201可以包括应用处理器(AP),调制解调处理器,基带处理器,图形处理器(GPU)223,图像信号处理器(ISP),控制器,存储器,视频编解码器224,数字信号处理器(DSP),基带处理器、神经网络处理器(NPU)等或它们的组合。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
处理器201中还可以设置有高速缓存器,用于保存处理器201刚用过或循环使用的指令或数据。如果处理器201需要再次使用该指令或数据,可从存储器中直接调用。
在一些实施例中,处理器201可以包括一个或多个接口。接口可以包括集成电路(I2C)接口、集成电路内置音频(I2S)接口、脉冲编码调制(PCM)接口、通用异步收发传输器(UART)接口、移动产业处理器接口(MIPI)、通用输入输出(GPIO)接口、用户标识模块(SIM)接口、通用串行总线(USB)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(SDA)和一根串行时钟线(SCL)。在一些实施例中,处理器201可以包含多组I2C总线。处理器201可以通过不同的I2C总线接口分别通讯连接触摸传感器2312,充电器,闪光灯,摄像单元221、眼部定位装置150等。
I2S接口和PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口被用于 连接处理器201与无线通信模块210。
在图2所示的实施例中,MIPI接口可以被用于连接处理器201与多视点3D显示屏100。此外,MIPI接口还可被用于连接如摄像单元221、眼部定位装置150等外围器件。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器201与摄像单元221,多视点3D显示屏100,无线通信模块210,音频模块212,传感器模块230等。
USB接口204是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口204可以用于连接充电器为多视点3D显示终端200充电,也可以用于多视点3D显示终端200与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。
可以理解的是,本公开实施例示意的每个模块间的接口连接关系,只是示意性说明,并不构成对多视点3D显示终端200的结构限定。
多视点3D显示终端200的无线通信功能可以通过天线209、211,移动通信模块208,无线通信模块210,调制解调处理器或基带处理器等实现。
天线209、211用于发射和接收电磁波信号。多视点3D显示终端200中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。
移动通信模块208可以提供应用在多视点3D显示终端200上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块208可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(LNA)等。移动通信模块208可以由天线209接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块208还可以对经调制解调处理器调制后的信号放大,经天线209转为电磁波辐射出去。在一些实施例中,移动通信模块208的至少部分功能模块可以被设置于处理器201中。在一些实施例中,移动通信模块208的至少部分功能模块可以与处理器201的至少部分模块被设置在同一个器件中。
无线通信模块210可以提供应用在多视点3D显示终端200上的包括无线局域网(WLAN),蓝牙(BT),全球导航卫星系统(GNSS),调频(FM),近距离无线通信技术(NFC),红外技术(IR)等无线通信的解决方案。无线通信模块210可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块210经由天线211接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器201。无线通信模块210还可以从处理器201接收待发送的信号,对其进行调频,放大,经天线211转为电磁波辐射出去。
在一些实施例中,多视点3D显示终端200的天线209和移动通信模块208耦合,天 线211和无线通信模块210耦合,使得多视点3D显示终端200可以通过无线通信技术与网络以及其他设备通信。无线通信技术可以包括全球移动通讯系统(GSM),通用分组无线服务(GPRS),码分多址接入(CDMA),宽带码分多址(WCDMA),时分码分多址(TD-SCDMA),长期演进(LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。GNSS可以包括全球卫星定位系统(GPS),全球导航卫星系统(GLONASS),北斗卫星导航系统(BDS),准天顶卫星系统(QZSS)和/或星基增强系统(SBAS)。
在一些实施例中,用于接收3D视频信号的外部接口可以包括USB接口204、移动通信模块208、无线通信模块209或其组合。此外,还可以想到其他可行的用于接收3D视频信号的接口,例如上述的接口。
存储器203可以用于存储计算机可执行程序代码,可执行程序代码包括指令。处理器201通过运行存储在存储器203的指令,从而执行多视点3D显示终端200的每个种功能应用以及数据处理。存储器203可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储多视点3D显示终端200使用过程中所创建的数据(比如音频数据,电话本等)等。此外,存储器203可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(UFS)等。
外部存储器接口202可以用于连接外部存储卡,例如Micro SD卡,实现扩展多视点3D显示终端200的存储能力。外部存储卡通过外部存储器接口202与处理器201通信,实现数据存储功能。
在一些实施例中,多视点3D显示终端的存储器可以包括(内部)存储器203、外部存储器接口202连接的外部存储卡或其组合。在本公开另一些实施例中,视频信号接口也可以采用上述实施例中不同的内部接口连接方式或其组合。
在本公开的实施例中,摄像单元221可以采集图像或视频。
在一些实施例中,多视点3D显示终端200通过视频信号接口140、3D处理装置130、多视点3D显示屏100,以及应用处理器等实现显示功能。
在一些实施例中,多视点3D显示终端200可包括GPU,例如在处理器201内用于对3D视频图像进行处理,也可以对2D视频图像进行处理。
在一些实施例中,多视点3D显示终端200还包括视频编解码器224,用于对数字视频压缩或解压缩。
在一些实施例中,视频信号接口140用于将经GPU或编解码器224或两者处理的3D视频信号、例如解压缩的3D视频信号的视频帧输出至3D处理装置130。
在一些实施例中,GPU或编解码器224集成有格式调整器。
多视点3D显示屏100用于显示3D(3D)图像或视频等。多视点3D显示屏100包括显示面板。显示面板可以采用液晶显示屏(LCD),有机发光二极管(OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(AMOLED),柔性发光二极管(FLED),Mini-LED,Micro-LED,Micro-OLED,量子点发光二极管(QLED)等。
在一些实施例中,眼部定位装置150通讯连接至3D处理单元130,从而3D处理单元130可以基于眼部定位数据渲染复合像素(复合子像素)中的相应子像素。在一些实施例中,眼部定位装置150还可连接处理器201,例如旁路连接处理器201。
多视点3D显示终端200可以通过音频模块212,扬声器213,受话器214,麦克风215,耳机接口216,以及应用处理器等实现音频功能。例如音乐播放,录音等。音频模块212用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块212还可以用于对音频信号编码和解码。在一些实施例中,音频模块212可以设置于处理器201中,或将音频模块212的部分功能模块设置于处理器201中。扬声器213用于将音频电信号转换为声音信号。多视点3D显示终端200可以通过扬声器213收听音乐,或收听免提通话。受话器214,也称“听筒”,用于将音频电信号转换成声音信号。当多视点3D显示终端200接听电话或语音信息时,可以通过将受话器214靠近耳部接听语音。麦克风215用于将声音信号转换为电信号。耳机接口216用于连接有线耳机。耳机接口216可以是USB接口204,也可以是3.5mm的开放移动终端平台(OMTP)标准接口,美国蜂窝电信工业协会(CTIA)标准接口。
按键217包括开机键,音量键等。按键217可以是机械按键。也可以是触摸式按键。多视点3D显示终端200可以接收按键输入,产生与多视点3D显示终端200的用户设置以及功能控制有关的键信号输入。
马达218可以产生振动提示。马达218可以用于来电振动提示,也可以用于触摸振动反馈。
SIM卡接口220用于连接SIM卡。在一些实施例中,多视点3D显示终端200采用eSIM,即:嵌入式SIM卡。
压力传感器2303用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器2303可以设置于多视点3D显示屏100,这落入本发明的范围内。
气压传感器2304用于测量气压。在一些实施例中,多视点3D显示终端200通过气压传感器2304测得的气压值计算海拔高度,辅助定位和导航。
磁传感器2305包括霍尔传感器。
重力传感器2306是将运动或重力转换为电信号的传感器,主要用于倾斜角、惯性力、冲击及震动等参数的测量。
陀螺仪传感器2307可以用于确定多视点3D显示终端200的运动姿态。
加速度传感器2308可检测多视点3D显示终端200在各个方向上(一般为三轴)加速度的大小。
距离传感器2309可用于测量距离
温度传感器2310可用于检测温度。
指纹传感器2311用于采集指纹。多视点3D显示终端200可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。
触摸传感器2312可以设置于多视点3D显示屏100中,由触摸传感器2312与多视点3D显示屏100组成触摸屏,也称“触控屏”。
骨传导传感器2313可以获取振动信号。
充电管理模块205用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块205可以通过USB接口204接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块205可以通过多视点3D显示终端200的无线充电线圈接收无线充电输入。
电源管理模块206用于连接电池207,充电管理模块205与处理器201。电源管理模块206接收电池207和/或充电管理模块205的输入,为处理器201,存储器203,外部存储器,多视点3D显示屏100,摄像单元221,和无线通信模块210等供电。在另一些实施例中,电源管理模块206和充电管理模块205也可以设置于同一个器件中。
多视点3D显示终端200的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本公开所示的实施例以分层架构的安卓系统为例,示例性说明多视点3D显示终端200的软件结构。但可以想到,本公开的实施例可以在不同的软件系统、如操作系统中实施。
图3是本公开实施例的多视点3D显示终端200的软件结构示意图。分层架构将软件分成若干个层。层与层之间通过软件接口通信。在一些实施例中,将安卓系统分为四层,从上至下分别为应用程序层310,框架层320,核心类库和运行时(Runtime)330,以及内核层340。
应用程序层310可以包括一系列应用程序包。如图3所示,应用程序包可以包括蓝牙,WLAN,导航,音乐,相机,日历,通话,视频,图库,地图,短信息等应用程序。根据本公开实施例的3D视频显示方法,例如可以在视频应用程序中实施。
框架层320为应用程序层的应用程序提供应用编程接口(API)和编程框架。框架层包括一些预先定义的函数。例如,在本公开的一些实施例中,对所采集的3D视频图像进行识别的函数或者算法以及处理图像的算法等可以包括在框架层。
如图3所示,框架层320可以包括资源管理器、电话管理器、内容管理器、通知管理器、窗口管理器,视图系统,安装包管理器等。
安卓Runtime(运行时)包括核心库和虚拟机。安卓Runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和框架层运行在虚拟机中。虚拟机将应用程序层和框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
核心类库可以包括多个功能模块。例如:3D图形处理库(例如:OpenGL ES),表面管理器,图像处理库,媒体库,图形引擎(例如:SGL)等。
内核层340是硬件和软件之间的层。内核层至少包含摄像头驱动,音视频接口,通话接口,Wifi接口,传感器驱动,电源管理,GPS接口。
在此,以具有图2和图3所示结构的作为移动终端的多视点3D显示终端为例,描述该多视点3D显示终端中的3D视频传输和显示的实施例;但是,可以想到,在另一些实施例中可以包括更多或更少的特征或对其中的特征进行改变。
在一些实施例中,例如为移动终端、如智能蜂窝电话或平板电脑的多视点3D显示终端200例如借助作为外部接口的移动通信模块208及天线209或者无线通信模块210及天线211从网络、如蜂窝网络、WLAN网络、蓝牙接收例如压缩的3D视频信号,压缩的3D视频信号例如经GPU223进行图像处理、编解码器224编解码和解压缩,然后例如经作为内部接口的视频信号接口140、如MIPI接口或mini-MIPI接口将解压缩的3D视频信号发送至至少一个3D处理装置130,解压缩的3D视频信号的视频帧包括本公开实施例的两幅图像或复合图像。进而,3D处理装置130相应地渲染显示屏的复合子像素中的子像素,由此实现3D视频播放。
在另一些实施例中,多视点3D显示终端200读取(内部)存储器203或通过外部存储器接口202读取外部存储卡中存储的压缩的3D视频信号,并经相应的处理、传输和渲染来实现3D视频播放。
在一些实施例中,上述3D视频的播放是在安卓系统应用程序层310中的视频应用程 序中实施的。
上述实施例阐明的设备、装置、模块或单元,可以由每个种可能的实体来实现。一种典型的实现实体为计算机或其处理器或其他部件。具体的,计算机例如可以为个人计算机、膝上型计算机、车载人机交互设备、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、电子邮件设备、游戏控制台、平板电脑、可穿戴设备、智能电视、物联网系统、智能家居、工业计算机、单片机系统或者这些设备中的组合。在一个典型的配置中,计算机可包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。
在本发明的实施例的方法、程序、设备、装置等,可以在单个或多个连网的计算机中执行或实现,也可以在分布式计算环境中实践。在本说明书实施例中,在这些分布式计算环境中,由通过通信网络而被连接的远程处理设备来执行任务。
本领域技术人员应明白,本说明书的实施例可提供为方法、设备或计算机程序产品。因此,本说明书实施例可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。
本领域技术人员可想到,上述实施例阐明的功能模块/单元或控制器以及相关方法步骤的实现,可以用软件、硬件和软/硬件结合的方式实现。例如,可以以纯计算机可读程序代码方式实现,也可以部分或全部通过将方法步骤进行逻辑编程来使得控制器以硬件来实现相同功能,包括但不限于逻辑门、开关、专用集成电路、可编程逻辑控制器(如FPGA)和嵌入微控制器。
在本发明的一些实施例中,以功能模块/单元的形式来描述装置的部件。可以想到,多个功能模块/单元一个或多个“组合”功能模块/单元和/或一个或多个软件和/或硬件中实现。也可以想到,单个功能模块/单元由多个子功能模块或子单元的组合和/或多个软件和/或硬件实现。功能模块/单元的划分,可以仅为一种逻辑功能划分,在具体的实现方式中,多个模块/单元可以结合或者可以集成到另一个系统。此外,本文的模块、单元、装置、系统及其部件的连接包括直接或间接的连接,涵盖可行的电的、机械的、通信的连接,尤其包括每个种接口间的有线或无线连接,包括但不限于HDMI、雷电、USB、WiFi、蜂窝网络。
在本发明的实施例中,方法、程序的技术特征、流程图和/或方框图可以应用到相应的装置、设备、系统及其模块、单元、部件中。反过来,装置、设备、系统及其模块、单元、部件的每个实施例和特征可以应用至根据本发明实施例的方法、程序中。例如,计算机程序指令可装载到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处 理器以产生一个机器,其具有实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中相应的功能或特征。
根据本发明实施例的方法、程序可以以计算机程序指令或程序的方式存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读的存储器或介质中。本发明实施例也涉及存储有可实施本发明实施例的方法、程序、指令的可读存储器或介质。
存储介质包括永久性和非永久性、可移动和非可移动的可以由任何方法或技术来实现信息存储的物品。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。
除非明确指出,根据本发明实施例记载的方法、程序的动作或步骤并不必须按照特定的顺序来执行并且仍然可以实现期望的结果。在某些实施方式中,多任务处理和并行处理也是可以的或者可能是有利的。
在本文中,针对本发明的多个实施例进行了描述,但为简明起见,每个实施例的描述并不是详尽的,各个实施例之间相同相似的特征或部分可能会被省略。在本文中,“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”意指适用于根据本发明的至少一个实施例或示例中,而非所有实施例。且上述术语并不必然意味着指代相同的实施例或示例。而且,每个实施例的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
在本文中,术语“包括”、“包含”或者其变体意在涵盖式,而非穷尽式,从而包括一系列要素的过程、方法、产品或者设备可包括这些要素,而不排除还可包括没有明确列出的其他要素。为了公开的目的且除非有它特别说明,“一”意味着“一个或多个”。就在本说明书和权利要求书中所使用的术语“包括”或“包括的”来说,它将是非遍举的,这一定程度上类似于“包含”,因为那些术语在用作过渡连接词时是解释性的。此外,就所用的术语“或”来说(例如A或B),它将意味着“A或B或这两者”。当申请人打算表明“仅A或B但非这两者”时,将会使用“仅A或B但非这两者”。因此,术语“或”的使用是包含的而非排他的。
已参考上述实施例具体示出并描述了本发明的示例性系统及方法,其仅为实施本系统 及方法的最佳模式的示例。本领域的技术人员可以理解的是可以在实施本系统及/或方法时对这里描述的系统及方法的实施例做每个种改变而不脱离界定在所附权利要求中的本发明的精神及范围。所附权利要求意在界定本系统及方法的范围,故落入这些权利要求中及与其等同的系统及方法可被涵盖。对本系统及方法的以上描述应被理解为包括这里描述的全部的新的及非显而易见的元素的结合,而本申请或后续申请中可存在涉及任何新的及非显而易见的元素的结合的权利要求。此外,上述实施例是示例性的,对于在本申请或后续申请中可以要求保护的全部可能组合中,没有一个单一特征或元素是必不可少的。

Claims (15)

  1. 一种多视点3D显示屏,包括:
    显示面板,包括多个复合像素,所述多个复合像素中的每个复合像素包括多个复合子像素,所述多个复合子像素中的每个复合子像素包括对应于所述多视点3D显示屏的多个视点的多个子像素;和
    多个光栅,并列设置在所述多个复合像素上,所述多个光栅中的每个光栅包括第一斜边和第二斜边,所述每个光栅倾斜覆盖在所述多个复合像素上以使所述第一斜边和所述第二斜边与所述每个复合子像素相交以限定出倾角;
    其中,所述每个复合子像素中,与所述第一斜边相交或临近的子像素构成第一端子像素,与所述第二斜边相交或临近的子像素构成第二端子像素;
    所述倾角被设置为使得:沿所述每个光栅的所述第一斜边的延伸方向,至少部分相邻复合像素中与所述每个光栅具有最大重叠面积的第一端子像素的颜色不相同。
  2. 根据权利要求1所述的多视点3D显示屏,其中,所述倾角被设置为使得:沿所述每个光栅的第二斜边的延伸方向,至少部分相邻复合像素中与所述每个光栅具有最大重叠面积的第二端子像素的颜色不相同。
  3. 根据权利要求1所述的多视点3D显示屏,其中,所述第一端子像素构成对应起始视点的子像素,其中,
    在每个复合子像素中的与所述第一斜边相交的子像素被覆盖的面积大于或等于面积阈值时,与所述第一斜边相交的子像素构成所述对应起始视点的子像素;或
    在每个复合子像素中的与所述第一斜边相交的子像素被覆盖的面积小于面积阈值时,与所述第一斜边相交的子像素相邻的下一个子像素构成所述对应起始视点的子像素。
  4. 根据权利要求1所述的多视点3D显示屏,其中,所述第二端子像素构成对应终止视点的子像素,其中,
    在每个复合子像素中的与所述第二斜边相交的子像素被覆盖的面积大于或等于面积阈值时,与所述第二斜边相交的子像素构成所述对应终止视点的子像素;或
    在每个复合子像素中的与所述第二斜边相交的子像素被覆盖的面积小于面积阈值时,与所述第二斜边相交的子像素相邻的上一个子像素构成所述对应终止视点的子像素。
  5. 根据权利要求1至4任一项所述的多视点3D显示屏,其中,所述每个复合像素的长宽方向上的尺寸相同。
  6. 根据权利要求1至4任一项所述的多视点3D显示屏,其中,所述多个光栅包括多个柱状棱镜光栅。
  7. 根据权利要求1至4任一项所述的多视点3D显示屏,其中,所述每个复合子像素包括呈单行或阵列形式的多个子像素。
  8. 根据权利要求1至4任一项所述的多视点3D显示屏,其中,所述多个复合子像素包括红色复合子像素、绿色复合子像素和蓝色复合子像素中至少之一。
  9. 根据权利要求1至4任一项所述的多视点3D显示屏,其中,所述倾角θ满足:
    tan(θ)=±3/(i×k),其中k不被3整除,i为视点的个数;或
    tan(θ)=±1\8。
  10. 一种多视点3D显示终端,包括如权利要求1至9任一项所述的多视点3D显示屏。
  11. 根据权利要求10所述的多视点3D显示终端,还包括3D处理装置,被配置为基于3D信号渲染所述多视点3D显示屏中的所述多个复合子像素中的相应子像素。
  12. 根据权利要求11所述的多视点3D显示终端,其中,所述3D处理装置还被配置为根据当前渲染的子像素对应的视点,和接下来渲染的子像素对应的视点,对所述多个复合子像素中的相应子像素进行移位渲染。
  13. 根据权利要求11所述的多视点3D显示终端,还包括存储器,被配置为存储子像素与视点的对应关系;
    其中,所述3D处理装置被配置为获取所述对应关系。
  14. 根据权利要求11所述的多视点3D显示终端,其中,所述3D处理装置为FPGA或ASIC芯片或芯片组。
  15. 根据权利要求10至14任一项所述的多视点3D显示终端,还包括眼部定位数据获取装置,被配置为获取用户的眼部定位数据。
PCT/CN2020/133335 2019-12-05 2020-12-02 多视点3d显示屏、多视点3d显示终端 Ceased WO2021110041A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/781,387 US20230125908A1 (en) 2019-12-05 2020-12-02 Multi-viewpoint 3d display screen and multi-viewpoint 3d display terminal
EP20895286.1A EP4068767A4 (en) 2019-12-05 2020-12-02 MULTI-VIEWPOINT 3D DISPLAY SCREEN AND MULTI-VIEWPOINT 3D DISPLAY TERMINAL

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911231427.1A CN112929649B (zh) 2019-12-05 2019-12-05 多视点裸眼3d显示屏、多视点裸眼3d显示终端
CN201911231427.1 2019-12-05

Publications (1)

Publication Number Publication Date
WO2021110041A1 true WO2021110041A1 (zh) 2021-06-10

Family

ID=76160833

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/133335 Ceased WO2021110041A1 (zh) 2019-12-05 2020-12-02 多视点3d显示屏、多视点3d显示终端

Country Status (5)

Country Link
US (1) US20230125908A1 (zh)
EP (1) EP4068767A4 (zh)
CN (1) CN112929649B (zh)
TW (1) TWI746302B (zh)
WO (1) WO2021110041A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023143220A1 (zh) * 2022-01-27 2023-08-03 北京芯海视界三维科技有限公司 图像显示处理方法及图像显示处理装置
WO2024036638A1 (zh) * 2022-08-19 2024-02-22 京东方科技集团股份有限公司 显示面板以及显示装置

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113689551A (zh) * 2021-08-20 2021-11-23 纵深视觉科技(南京)有限责任公司 一种三维内容的展示方法、装置、介质及电子设备
CN115047645B (zh) * 2022-05-20 2024-04-19 北京芯海视界三维科技有限公司 显示屏及显示装置
CN115047646A (zh) * 2022-05-20 2022-09-13 北京芯海视界三维科技有限公司 显示屏及显示装置
CN116758825B (zh) * 2023-08-18 2023-12-12 长春希达电子技术有限公司 一种小间距球形显示屏模块处理方法及显示装置

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6064424A (en) * 1996-02-23 2000-05-16 U.S. Philips Corporation Autostereoscopic display apparatus
US20040263968A1 (en) * 2003-04-21 2004-12-30 Masanori Kobayashi Method and apparatus for displaying three-dimensional stereo image using light deflector
CN102857783A (zh) * 2012-09-18 2013-01-02 上海易维视科技有限公司 一种多视点自动立体显示装置
CN102932646A (zh) * 2011-08-10 2013-02-13 上海易维视科技有限公司 二维图像的多视点显示方法及系统
CN105572886A (zh) * 2016-01-26 2016-05-11 京东方科技集团股份有限公司 一种三维显示装置
CN106959522A (zh) * 2016-01-11 2017-07-18 擎中科技(上海)有限公司 一种立体显示器件
CN110234002A (zh) * 2019-06-11 2019-09-13 深圳奇屏科技有限公司 一种像素与光栅均倾斜的裸眼3d显示器
CN211128026U (zh) * 2019-12-05 2020-07-28 北京芯海视界三维科技有限公司 多视点裸眼3d显示屏、多视点裸眼3d显示终端

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008228199A (ja) * 2007-03-15 2008-09-25 Toshiba Corp 立体画像表示装置及び立体画像表示方法並びに立体画像用データの構造
JP5321575B2 (ja) * 2010-12-17 2013-10-23 株式会社Jvcケンウッド 裸眼立体ディスプレイ装置
JP2012194257A (ja) * 2011-03-15 2012-10-11 Japan Display West Co Ltd 表示装置および光バリア素子
CA2925289A1 (en) * 2013-09-30 2015-04-02 Koninklijke Philips N.V. Autostereoscopic display device
CN108463787B (zh) * 2016-01-05 2021-11-30 瑞尔D斯帕克有限责任公司 多视角图像的注视校正
CN107018402B (zh) * 2016-01-27 2020-02-28 北京三星通信技术研究有限公司 裸眼三维显示器的图像误差修正方法及装置
KR101835060B1 (ko) * 2016-06-30 2018-03-07 엘지디스플레이 주식회사 무안경 입체 영상 표시장치
CN107655660A (zh) * 2017-10-31 2018-02-02 江苏中升立体显示科技有限公司 裸眼3d显示设备的柱镜光栅参数测量方法
US10778962B2 (en) * 2017-11-10 2020-09-15 Misapplied Sciences, Inc. Precision multi-view display

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6064424A (en) * 1996-02-23 2000-05-16 U.S. Philips Corporation Autostereoscopic display apparatus
US20040263968A1 (en) * 2003-04-21 2004-12-30 Masanori Kobayashi Method and apparatus for displaying three-dimensional stereo image using light deflector
CN102932646A (zh) * 2011-08-10 2013-02-13 上海易维视科技有限公司 二维图像的多视点显示方法及系统
CN102857783A (zh) * 2012-09-18 2013-01-02 上海易维视科技有限公司 一种多视点自动立体显示装置
CN106959522A (zh) * 2016-01-11 2017-07-18 擎中科技(上海)有限公司 一种立体显示器件
CN105572886A (zh) * 2016-01-26 2016-05-11 京东方科技集团股份有限公司 一种三维显示装置
CN110234002A (zh) * 2019-06-11 2019-09-13 深圳奇屏科技有限公司 一种像素与光栅均倾斜的裸眼3d显示器
CN211128026U (zh) * 2019-12-05 2020-07-28 北京芯海视界三维科技有限公司 多视点裸眼3d显示屏、多视点裸眼3d显示终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4068767A4

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023143220A1 (zh) * 2022-01-27 2023-08-03 北京芯海视界三维科技有限公司 图像显示处理方法及图像显示处理装置
WO2024036638A1 (zh) * 2022-08-19 2024-02-22 京东方科技集团股份有限公司 显示面板以及显示装置
US12313929B2 (en) 2022-08-19 2025-05-27 Beijing Boe Display Technology Co., Ltd. Display panel and display apparatus

Also Published As

Publication number Publication date
CN112929649B (zh) 2025-07-22
EP4068767A1 (en) 2022-10-05
US20230125908A1 (en) 2023-04-27
TW202122872A (zh) 2021-06-16
TWI746302B (zh) 2021-11-11
EP4068767A4 (en) 2023-09-06
CN112929649A (zh) 2021-06-08

Similar Documents

Publication Publication Date Title
TWI746302B (zh) 多視點3d顯示屏、多視點3d顯示終端
CN211128026U (zh) 多视点裸眼3d显示屏、多视点裸眼3d显示终端
CN112584125B (zh) 三维图像显示设备及其显示方法
CN112929647A (zh) 3d显示设备、方法和终端
TW202123692A (zh) 眼部定位裝置、方法及3d顯示裝置、方法
CN211528831U (zh) 多视点裸眼3d显示屏、裸眼3d显示终端
TWI782361B (zh) 3d顯示裝置、方法及終端
CN211791828U (zh) 3d显示设备
CN211791829U (zh) 3d显示设备
TWI800774B (zh) 多視點3d顯示屏及3d顯示終端
US11924398B2 (en) Method for implementing 3D image display and 3D display device
CN112929645A (zh) 3d显示设备、系统和方法及3d视频数据通信方法
EP4068780A1 (en) Method for realizing 3d image display, and 3d display device
CN211930763U (zh) 3d显示设备
CN112929641B (zh) 3d图像显示方法、3d显示设备
TWI840636B (zh) 實現3d圖像顯示的方法、3d顯示設備

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20895286

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020895286

Country of ref document: EP

Effective date: 20220628