CN117611720A - Three-dimensional model texture processing method and device, electronic equipment and storage medium - Google Patents
Three-dimensional model texture processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117611720A CN117611720A CN202311558331.2A CN202311558331A CN117611720A CN 117611720 A CN117611720 A CN 117611720A CN 202311558331 A CN202311558331 A CN 202311558331A CN 117611720 A CN117611720 A CN 117611720A
- Authority
- CN
- China
- Prior art keywords
- texture
- initial
- patch
- plane
- patches
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Image Generation (AREA)
Abstract
The application provides a three-dimensional model texture processing method, a three-dimensional model texture processing device, electronic equipment and a storage medium, wherein the three-dimensional model texture processing method comprises the following steps: acquiring a plurality of initial patches in a three-dimensional model and texture maps corresponding to the initial patches; determining at least one target continuous plane according to the comprehensive plane index of each initial patch, wherein the target continuous plane comprises at least one initial patch; merging texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane; repairing the gaps in the initial texture map to obtain a target texture map, and rendering the target texture map onto the target continuous plane in the three-dimensional model. The planar structure features based on the three-dimensional model are used as the constraint of texture map merging, so that the merging of fragments of adjacent texture maps is realized, the problem of texture fragmentation of the three-dimensional model is effectively improved, and the deformation degree of textures can be effectively reduced.
Description
Technical Field
The application relates to the technical field of live-action three-dimension, in particular to a three-dimension model texture optimization method, a three-dimension model texture optimization device, electronic equipment and a storage medium.
Background
With the continuous development of multi-view three-dimensional reconstruction technology (Multi View Stereo, MVS), live-action three-dimensional model production and application based on oblique photogrammetry are becoming wider and wider. However, since the texture generated by the photogrammetry technique is scattered, the fragmentation effect is presented, and a large number of texture seams are caused, so that the rendering performance of the three-dimensional model is poor.
In the prior art, a parameterization method is used for reconstructing textures, the method segments the surface of a three-dimensional model under a certain rule, the mapping relation between the three-dimensional model and a texture map is obtained to calculate the texture coordinates of each triangular surface on the three-dimensional model, and the length of cutting and the loss degree of texture information are balanced in the process. However, oblique photography three-dimensional models often have inconsistencies such as pinholes, topological noise, or lack of manifold, and it is difficult to obtain satisfactory parameterized results. .
Disclosure of Invention
The present application aims to provide a three-dimensional model texture processing method, device, electronic equipment and storage medium, which are used for solving the defects in the prior art, and effectively solving the problem of three-dimensional model texture fragmentation.
In order to achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:
in a first aspect, an embodiment of the present application provides a three-dimensional model texture processing method, where the method includes:
acquiring a plurality of initial patches in a three-dimensional model and texture maps corresponding to the initial patches, wherein the texture maps comprise at least one texture seam;
determining at least one target continuous plane according to the comprehensive plane index of each initial patch, wherein the target continuous plane comprises at least one initial patch, and the comprehensive plane index is used for representing the planeness and the long and narrow degree of a point set in the initial patch;
merging texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane;
repairing the gaps in the initial texture map to obtain a target texture map, and rendering the target texture map onto the target continuous plane in the three-dimensional model.
Optionally, the determining at least one target continuous plane according to the comprehensive plane index of each initial patch includes:
determining a reference patch from the plurality of initial patches according to the comprehensive plane index of each initial patch;
And sequentially determining the surface patches to be combined according to the comprehensive plane index of the reference surface patch and the comprehensive plane indexes of a plurality of residual surface patches except the reference surface patch in the plurality of initial surface patches, and sequentially combining the surface patches to be combined to obtain the target continuous plane.
Optionally, the determining the to-be-combined surface piece sequentially according to the comprehensive plane index of the reference surface piece and the comprehensive plane indexes of the plurality of remaining surface pieces except the reference surface piece in the plurality of initial surface pieces, and combining the to-be-combined surface pieces sequentially to obtain the target continuous plane sequentially includes:
A. taking the reference surface piece as a current continuous plane;
B. determining a combined plane index after the first point set is combined to the second point set according to the first point set of the current residual surface and the second point set of the current continuous plane;
C. if the combined plane index is greater than a preset threshold, combining the current residual patches to the current continuous plane to obtain a new current continuous plane, and taking the next residual patch of the current residual patches as a new current residual patch; if the combined plane index is smaller than or equal to a preset threshold value, taking the next remaining patch of the current remaining patches as a new current remaining patch;
And C, repeating the steps B-C until all the rest patches are traversed, and taking the current continuous plane as the target continuous plane.
Optionally, the determining, according to the first point set of the current remaining patches and the second point set of the current continuous plane, a merged plane index after the first point set is merged into the second point set includes:
merging the first point set to the second point set to obtain a merged point set;
determining a covariance matrix of the combined point set, and carrying out feature decomposition on the covariance matrix to obtain a plurality of feature values;
and determining the combined plane index according to each characteristic value.
Optionally, the merging the texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane includes:
acquiring a first texture map corresponding to a first initial surface patch to be combined and a second texture map corresponding to a second initial surface patch to be combined in the target continuous plane, wherein the first initial surface patch to be combined and the second initial surface patch to be combined are any two adjacent planes in the target continuous plane in a three-dimensional model, the first texture map comprises a first texture joint and each vertex on the first texture joint, and the second texture map comprises a second texture joint and each vertex on the second texture joint;
Combining the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a combined texture map;
and obtaining an initial texture map of the target continuous plane according to each combined texture map.
Optionally, the merging the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a merged texture map includes:
determining conversion parameters according to the texture coordinates of each vertex on the first joint and the texture coordinates of each vertex on the second joint;
rigidly transforming the texture map to be transformed according to the transformation parameters to obtain a transformed texture map and each vertex on a transformed texture joint, wherein the texture map to be transformed is a texture map with the smallest area in the first texture map and the second texture map;
and aligning and combining each vertex on the texture joint after transformation with each vertex on the texture joint of the texture graph except the texture graph to be transformed to obtain a combined texture graph.
Optionally, before the obtaining the first texture map corresponding to the first initial patch to be combined and the second texture map corresponding to the second initial patch to be combined in the target continuous plane, the method includes:
calculating the merging cost value of each texture joint in the target continuous plane, and determining the merging sequence of each texture joint according to the merging cost value;
and merging the texture seams according to the merging sequence of the texture seams.
In a second aspect, an embodiment of the present application further provides a three-dimensional model texture processing apparatus, where the apparatus includes:
the acquisition module is used for acquiring a plurality of initial patches in the three-dimensional model and texture maps corresponding to the initial patches, wherein the texture maps comprise at least one texture seam;
a determining module, configured to determine at least one target continuous plane according to a comprehensive plane index of each initial patch, where the target continuous plane includes at least one initial patch, and the comprehensive plane index is used to characterize the flatness and the long and narrow degree of a point set in the initial patch;
the merging module is used for merging texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane;
And the repairing module is used for repairing the gaps in the initial texture map to obtain a target texture map, and rendering the target texture map onto the target continuous plane in the three-dimensional model.
Optionally, the determining module is specifically configured to:
determining a reference patch from the plurality of initial patches according to the comprehensive plane index of each initial patch;
and sequentially determining the surface patches to be combined according to the comprehensive plane index of the reference surface patch and the comprehensive plane indexes of a plurality of residual surface patches except the reference surface patch in the plurality of initial surface patches, and sequentially combining the surface patches to be combined to obtain the target continuous plane.
Optionally, the determining module is specifically configured to:
A. taking the reference surface piece as a current continuous plane;
B. determining a combined plane index after the first point set is combined to the second point set according to the first point set of the current residual surface and the second point set of the current continuous plane;
C. if the combined plane index is greater than a preset threshold, combining the current residual patches to the current continuous plane to obtain a new current continuous plane, and taking the next residual patch of the current residual patches as a new current residual patch; if the combined plane index is smaller than or equal to a preset threshold value, taking the next remaining patch of the current remaining patches as a new current remaining patch;
And C, repeating the steps B-C until all the rest patches are traversed, and taking the current continuous plane as the target continuous plane.
Optionally, the determining module is specifically configured to:
merging the first point set to the second point set to obtain a merged point set;
determining a covariance matrix of the combined point set, and carrying out feature decomposition on the covariance matrix to obtain a plurality of feature values;
and determining the combined plane index according to each characteristic value.
Optionally, the merging module is specifically configured to:
acquiring a first texture map corresponding to a first initial surface patch to be combined and a second texture map corresponding to a second initial surface patch to be combined in the target continuous plane, wherein the first initial surface patch to be combined and the second initial surface patch to be combined are any two adjacent planes in the target continuous plane in a three-dimensional model, the first texture map comprises a first texture joint and each vertex on the first texture joint, and the second texture map comprises a second texture joint and each vertex on the second texture joint;
combining the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a combined texture map;
And obtaining an initial texture map of the target continuous plane according to each combined texture map.
Optionally, the merging module is specifically configured to:
determining conversion parameters according to the texture coordinates of each vertex on the first joint and the texture coordinates of each vertex on the second joint;
rigidly transforming the texture map to be transformed according to the transformation parameters to obtain a transformed texture map and each vertex on a transformed texture joint, wherein the texture map to be transformed is a texture map with the smallest area in the first texture map and the second texture map;
and aligning and combining each vertex on the texture joint after transformation with each vertex on the texture joint of the texture graph except the texture graph to be transformed to obtain a combined texture graph.
Optionally, the merging module is specifically configured to:
calculating the merging cost value of each texture joint in the target continuous plane, and determining the merging sequence of each texture joint according to the merging cost value;
and merging the texture seams according to the merging sequence of the texture seams.
In a third aspect, an embodiment of the present application further provides an electronic device, including: the three-dimensional model texture processing method comprises a processor, a storage medium and a bus, wherein the storage medium stores program instructions executable by the processor, when an application program runs, the processor and the storage medium are communicated through the bus, and the processor executes the program instructions to execute the steps of the three-dimensional model texture processing method according to the first aspect.
In a fourth aspect, embodiments of the present application further provide a computer readable storage medium, where a computer program is stored, where the computer program is read and executed to perform the steps of the three-dimensional model texture processing method described in the first aspect.
The beneficial effects of this application are:
according to the texture processing method, the texture processing device, the electronic equipment and the storage medium for the three-dimensional model, at least one target continuous plane is determined according to the comprehensive plane index of each initial surface patch, so that the three-dimensional model can be divided into a plurality of continuous plane areas based on the plane characteristics of the surface of the three-dimensional model, then texture graphs corresponding to all initial planes in the target continuous plane are combined, an initial texture graph of the target continuous plane is generated, a gap in the initial texture graph is repaired, and the obtained target texture graph is rendered on the target continuous plane of the three-dimensional model. By combining all adjacent texture maps in the target continuous plane to obtain an initial texture map of the target continuous plane, the planar structure characteristics based on the three-dimensional model are used as the constraint of texture map combination, so that the combination of fragments of the adjacent texture maps is realized, the problem of texture fragmentation of the three-dimensional model is effectively improved under the condition that the continuity and consistency of the texture maps are ensured, and the deformation degree of textures can be effectively reduced.
In addition, the deformation problem in the initial texture map is repaired, so that the deformation degree of the texture can be effectively controlled, and a high-quality texture map can be obtained.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered limiting the scope, and that other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a three-dimensional model texture processing method according to an embodiment of the present application;
FIG. 2 is a flow chart of another texture processing method for a three-dimensional model according to an embodiment of the present application;
FIG. 3 is a flow chart of another three-dimensional model texture processing method according to an embodiment of the present disclosure;
FIG. 4 is a flowchart illustrating another three-dimensional model texture processing method according to an embodiment of the present disclosure;
FIG. 5 is a flowchart illustrating a method for generating an initial texture map of a target continuous plane according to an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a merged texture map according to an embodiment of the present disclosure;
FIG. 7 is a flowchart illustrating a method for generating a merged texture map according to an embodiment of the present disclosure;
FIG. 8 is a schematic diagram of a texture map after repair and merger according to an embodiment of the present application;
FIG. 9 is a flowchart of a method for determining a merge sequence according to an embodiment of the present disclosure;
FIG. 10 is a schematic diagram of a device for a texture processing method for a three-dimensional model according to an embodiment of the present application;
fig. 11 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it should be understood that the accompanying drawings in the present application are only for the purpose of illustration and description, and are not intended to limit the protection scope of the present application. In addition, it should be understood that the schematic drawings are not drawn to scale. A flowchart, as used in this application, illustrates operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be implemented out of order and that steps without logical context may be performed in reverse order or concurrently. Moreover, one or more other operations may be added to the flow diagrams and one or more operations may be removed from the flow diagrams as directed by those skilled in the art.
In addition, the described embodiments are only some, but not all, of the embodiments of the present application. The components of the embodiments of the present application, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, as provided in the accompanying drawings, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, are intended to be within the scope of the present application.
It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the presence of the features stated hereinafter, but not to exclude the addition of other features.
Optionally, the three-dimensional model texture processing method provided in the embodiment of the present application is applied to an electronic device, where the electronic device may be, for example, a mobile phone, a tablet computer, a notebook computer, a palm computer, a desktop computer, or other terminal devices with computing processing capability and display function, or may also be a server. The method can be applied to application programs in terminal equipment, such as: APP (application) of a mobile phone, an application system on a computer, and the like.
The following specifically explains the implementation procedure of the three-dimensional model texture processing provided in the embodiment of the present application.
Fig. 1 is a flow chart of a three-dimensional model texture processing method according to an embodiment of the present application, where an execution body of the method is as described in the foregoing electronic device. As shown in fig. 1, the method includes:
s101, acquiring texture maps corresponding to a plurality of initial patches in the three-dimensional model.
Wherein each texture map may include at least one texture seam.
Alternatively, the three-dimensional model may refer to a city-level live-action three-dimensional model, for example, may be a three-dimensional model of a building, where a plurality of triangular mesh surfaces patch may be included on the three-dimensional model, and then the triangular mesh surfaces patch is an initial patch. Each triangular mesh surface may include multiple sub-triangular surfaces, that is, each triangular mesh surface may be composed of multiple sub-triangular surfaces, and if the sub-triangular surfaces are denoted by f, then the patch i ＝{f t ,f t+1 ,…f T T= (1, 2,3 … n), i= (1, 2,3 … n). Each triangular mesh surface can be mapped to a two-dimensional texture space in a one-to-one correspondence manner, and texture seams may exist between the texture map corresponding to a certain surface patch and the texture maps corresponding to other initial surface patches adjacent to the surface patch on the three-dimensional model, for example, on the three-dimensional model, the initial surface patch 1 and the initial surface patch 2 are two adjacent surface patches, and texture seams may exist between the texture map corresponding to the initial surface patch 1 and the texture map corresponding to the initial surface patch 2. Thus, at least one texture seam may be included in the texture map for each initial patch.
S102, determining at least one target continuous plane according to the comprehensive plane index of each initial patch.
Wherein the target continuous plane may include at least one initial patch, the integrated plane index may be used to characterize the planarity and the narrow length of the set of points in the initial patch.
Optionally, each initial surface patch can calculate and obtain the comprehensive plane index of the initial surface patch according to the planeness and the long and narrow degree of the point set on each initial surface patch, and then the plane structure of the three-dimensional model is detected according to the comprehensive plane index of each initial surface patch, so that the plane structure characteristics in the texture of the three-dimensional model can be maintained, and the mapping relation between the original initial surface patches and the texture patterns of the initial surface patches can not be damaged. Then, the three-dimensional model can be divided into a plurality of planar areas which are continuous in blocks based on the planar structural characteristics of the three-dimensional modelThe domain, i.e. a plurality of target continuous planes, each of which may be R, for example, if the three-dimensional model is M 1 、R 2 、…R n E.m. Each target continuous plane R n May include at least one patch i 。
S103, merging texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane.
Optionally, since each target continuous plane includes at least one initial patch, texture maps corresponding to each initial patch are combined in a two-dimensional texture space, and each combined texture map is an initial texture map of the target continuous plane.
Exemplary, if the target is a continuous plane R 1 The method comprises an initial surface patch 1 and an initial surface patch 2, wherein the initial surface patch 1 and the initial surface patch 2 are two adjacent surface patches, the texture map corresponding to the initial surface patch 1 and the texture map corresponding to the initial surface patch 2 are combined, specifically, the texture seam between the texture map corresponding to the initial surface patch 1 and the texture map corresponding to the initial surface patch 2 can be combined, the combined texture map is shown as a middle map in fig. 8, and the combined texture map is taken as a target continuous plane R 1 Is used for the initial texture map of (1).
S104, repairing the gaps in the initial texture map to obtain a target texture map, and rendering the target texture map to a target continuous plane in the three-dimensional model.
Alternatively, since it is generally necessary to change the texture coordinates of the vertices at the texture seams when the initial texture map is merged in S103, so as to cause deformation in the obtained texture map, in order to alleviate the deformation caused by the merging operation, it is necessary to repair the deformation caused by the displacement of the vertices at the texture seams for a part of the triangle, so as to obtain the target texture map, specifically, if the initial texture map is an intermediate map as shown in fig. 8, the deformation between the seams is repaired, and the obtained target texture map is a rightmost map as shown in fig. 8. And rendering the obtained target texture map onto a target continuous plane of the three-dimensional model.
In this embodiment, at least one target continuous plane is determined according to the comprehensive plane index of each initial patch, so that the three-dimensional model can be divided into a plurality of continuous plane areas based on the plane characteristics of the surface of the three-dimensional model, then texture maps corresponding to each initial plane in the target continuous planes are combined to generate an initial texture map of the target continuous plane, and a gap in the initial texture map is repaired, so that the obtained target texture map is rendered on the target continuous plane of the three-dimensional model. By combining all adjacent texture maps in the target continuous plane to obtain an initial texture map of the target continuous plane, the planar structure characteristics based on the three-dimensional model are used as the constraint of texture map combination, so that the combination of fragments of the adjacent texture maps is realized, the problem of texture fragmentation of the three-dimensional model is effectively improved under the condition that the continuity and consistency of the texture maps are ensured, and the deformation degree of textures can be effectively reduced.
In addition, the deformation problem in the initial texture map is repaired, so that the deformation degree of the texture can be effectively controlled, and a high-quality texture map can be obtained.
Fig. 2 is a flow chart of another three-dimensional model texture processing method according to the embodiment of the present application, as shown in fig. 2, where determining at least one target continuous plane according to the integrated plane index of each initial patch in S102 may include:
S201, determining a reference surface patch from a plurality of initial surface patches according to the comprehensive plane index of each initial surface patch.
Specifically, the initial patch having the highest integrated plane index may be selected as the reference patch.
S202, determining the surface patches to be combined in sequence according to the comprehensive plane index of the reference surface patch and the comprehensive plane indexes of a plurality of residual surface patches except the reference surface patch in the plurality of initial surface patches, and combining the surface patches to be combined in sequence to obtain a target continuous plane.
For example, if the reference patch is the initial patch 1, the remaining patches may include the initial patch 2, the initial patch 3, and the initial patch 4 …, the patches to be combined may be sequentially determined according to the comprehensive plane index of the initial patch 1 and the comprehensive plane index of the comprehensive patch of each remaining patch, and if the patches to be combined which are sequentially determined are the initial patch 2, the initial patch 3, and the initial patch 4, the initial patch 2, the initial patch 3, and the initial patch 4 are sequentially combined into the initial patch 1, so as to obtain the target continuous plane.
In this embodiment, the three-dimensional model is merged from a plurality of initial planes to a plurality of target continuous planes based on the planar structural features of the three-dimensional model, so that the planar structural features of the resulting target continuous planes are similar.
Fig. 3 is a flow chart of another three-dimensional model texture processing method provided in the embodiment of the present application, as shown in fig. 3, in S202, determining, in sequence, a to-be-combined patch according to a comprehensive plane index of a reference patch and a comprehensive plane index of a plurality of remaining patches except the reference patch in a plurality of initial patches, and sequentially combining the to-be-combined patches to obtain a target continuous plane, which may include:
s301, taking the reference plane as a current continuous plane.
Illustratively, continuing to take the above reference patch as initial patch 1 as an example, the current continuous plane is initial patch 1.
S302, determining a combined plane index after the first point set and the second point set are combined according to the first point set of the current residual patches and the second point set of the current continuous plane.
Wherein, when traversing the remaining patches for the first time, the current remaining patch may refer to any one of a plurality of remaining patches other than the reference patch among the plurality of initial patches; for each traversal of a remaining patch, the remaining patch may be marked, which may indicate that the remaining patch has been traversed, so that, in a subsequent iteration of the traversal, the current remaining patch refers to any of the remaining patches other than the mark.
Illustratively, if the current remaining patch is the initial patch 2, determining a combined plane index after the first point set and the second point set are combined according to the first point set of the initial patch 2 and the second point set of the initial patch 1.
S303, determining whether the plane index after combination is larger than a preset threshold value.
If yes, the following S304 is executed; if not, the following S305 is executed.
The preset threshold value can be set according to actual conditions.
And S304, if the combined plane index is larger than a preset threshold value, combining the current rest of the patches to the current continuous plane to obtain a new current continuous plane.
Optionally, if the combined plane index is greater than the preset threshold, the current remaining patches are combined to the current continuous plane to obtain a new current continuous plane, and the current remaining patches may be marked as successfully traversed patches, where the successfully traversed patches indicate that the initial patches are successfully combined to the current continuous plane, so that the traversing of the patches is not repeated when the current target continuous plane is generated.
For example, if the combined plane index obtained by combining the first point set of the initial patch 2 and the second point set of the initial patch 1 is greater than the preset threshold, the initial patch 2 is combined into the initial patch 1, and the new current continuous plane is the plane formed by the initial patch 2 and the initial patch 1 together. The initial patch 2 may also be marked as a successfully traversed patch and the next remaining patch of the initial patch 2 may be taken as the new current remaining patch.
S305, judging whether residual patches exist.
If yes, the following step S306 is executed, and if no, step S309 is executed.
And S306, if yes, taking the next remaining dough piece of the current remaining dough piece as a new current remaining dough piece, and executing step S302.
S307, if the combined plane index is smaller than or equal to a preset threshold value, judging whether residual patches exist.
Optionally, if yes, the following S308 is executed; if not, step S309 is performed.
Optionally, if the merged plane index is less than or equal to the preset threshold, the current remaining patches may be marked as patches with failed traversal, where the patches with failed traversal indicate initial patches that are not merged into the current continuous plane, so that the patches are not repeatedly traversed when the current target continuous plane is generated.
For example, if the combined plane index obtained by combining the first point set of the initial patch 2 and the second point set of the initial patch 1 is less than or equal to the preset threshold, the initial patch 2 may be marked as a patch with failed traversal.
And S308, taking the next remaining patch of the current remaining patch as a new current remaining patch, and executing step S302.
S309, taking the current continuous plane as a target continuous plane, and ending.
Optionally, when all the remaining patches are traversed, taking the current continuous plane obtained by the traversing as a target continuous plane, and if the traversing is completed, taking the target continuous plane as a reference plane when the comprehensive plane index of each remaining patch and the reference patch is smaller than or equal to a preset threshold value; if the surface patch with the comprehensive plane index of the reference surface patch is larger than the preset threshold value, the target continuous plane is a plane area formed by the reference surface patch and each remaining surface patch meeting the condition.
Optionally, after the target continuous plane is obtained, selecting, for a plurality of initial patches with failed mark traversal, an initial plane with the highest comprehensive plane index from the plurality of initial patches with failed mark traversal as a new reference patch according to the comprehensive plane index of each initial patch, and executing S301 to S305 again to obtain a target continuous plane corresponding to the new reference patch. When all the initial patches are traversed, each target continuous plane in the three-dimensional model can be obtained.
In the embodiment of the application, a region growing method is used to obtain each target continuous plane in the three-dimensional model.
Fig. 4 is a flowchart of another three-dimensional model texture processing method provided in the embodiment of the present application, as shown in fig. 4, S302, determining, according to a first point set of a current remaining patch and a second point set of a current continuous plane, a merged plane index after the first point set is merged to the second point set, may include:
s401, merging the first point set into the second point set to obtain a merged point set.
Wherein the first point set refers to a point set extracted from the current remaining patch, the second point set refers to a point set extracted from the current continuous plane, and the second point set may be a reference point set.
S402, determining a covariance matrix of the combined point set, and performing feature analysis on the covariance matrix to obtain a plurality of feature values.
Alternatively, the covariance matrix of the combined point set may be represented by using, for example, C, and the covariance matrix C may be subjected to feature decomposition by using an SVD feature value decomposition method to obtain a plurality of feature values, the plurality of feature values may be respectively sorted according to the sizes, a preset number of feature values may be selected, for example, feature values sorted in the first three may be selected, for example, the selected feature value is σ 1 <σ 2 <σ 3 。
S403, determining the plane index after combination according to the characteristic values.
Alternatively, the flatness of the combined planes may be determined from the eigenvalues, e.g. flatness δ=σ 2 /σ 1 Where δ may represent the approximate level of the set of points after merging; the degree of the longitudinal extent of the combined planes can be determined from the eigenvalues, e.g. the narrow length ζ=σ 3 /σ 2 ζ may represent the degree of elongation of the merged set of points. The combined plane index ρ=δ/ζ may then be determined from the determined flatness and the slit.
Optionally, if it is determined that the combined plane index is greater than the preset threshold, taking the combined point set as a new second point set; and if the plane index after the combination is determined to be smaller than or equal to the preset threshold value, restoring the point set after the combination to a second point set before the combination.
Fig. 5 is a flowchart of a method for generating an initial texture map of a target continuous plane according to an embodiment of the present application, as shown in fig. 5, where in S103, the step of merging texture maps corresponding to initial patches in the target continuous plane to generate an initial texture map of the target continuous plane may include:
s501, a first texture map corresponding to a first initial patch to be combined and a second texture map corresponding to a second initial patch to be combined in a target continuous plane are obtained.
The first initial surface to be combined and the second initial surface to be combined are two adjacent surface patches in any of the target continuous planes in the three-dimensional model, for example, the target continuous planes obtained in the three-dimensional model include the initial surface patch 1 and the initial surface patch 2, and the initial surface patch 1 and the initial surface patch 2 are adjacent, and then the first texture map corresponding to the initial surface patch 1 and the second texture map corresponding to the initial surface patch 2 are combined, and because the initial surface patch 1 and the initial surface patch 2 are adjacent on the target continuous planes, there is a surface patch seam, and therefore, the corresponding texture seam needs to be combined.
Exemplary, as shown in FIG. 6 below, the left side of FIG. 6 may be, for example, a first texture map, and the right side of FIG. 6 may be, for example, a second texture map, the first texture map including a first texture seam and vertices on the first texture seam, the vertices on the first texture seam being, for example, p in the left side of FIG. 6 1 、p 2 、p 3 、p 4 The second texture map includes a second texture seam and vertices on the second texture seam, such as q in the right-hand diagram of FIG. 6 1 、q 2 、q 3 、q 4 . Wherein each vertex on the first joint corresponds one-to-one with each vertex on the second joint, e.g. p 1 And q 1 Is a vertex pair, p 2 And q 2 Is a vertex pair, p 3 And q 3 Is a vertex pair, p 4 And q 4 Is a vertex pair.
S502, merging the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a merged texture map.
Optionally, in order to remove texture seams between texture maps corresponding to the first to-be-merged surface sheet and the second to-be-merged surface sheet, respectively, corresponding vertex pairs at the texture seams must be aligned in texture space. Therefore, each vertex on the first texture seam is aligned and combined with each corresponding vertex on the second texture seam, so that the first texture map and the second texture map are combined, and the combined texture map is obtained.
S503, obtaining an initial texture map of the target continuous plane according to each combined texture map.
Alternatively, the combined texture map corresponding to each adjacent initial patch in the target continuous plane may be obtained through S501 to S502, so that the combined texture maps may be combined to form the initial texture map of the target continuous plane.
Fig. 7 is a flowchart of a method for generating a merged texture map according to an embodiment of the present application, as shown in fig. 7, in S502, merging the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a merged texture map may include:
S601, determining conversion parameters according to the texture coordinates of each vertex on the first joint and the texture coordinates of each vertex on the second joint.
Specifically, the following formula (one) may be used to obtain a conversion parameter, where the conversion parameter is a rotation matrix R and a translation vector t.
Wherein p is i Refers to each vertex on the first seam in the first texture map, q i Refer to each vertex on the second seam in the second texture map, p i And q i Substituting the above formula (one) yields m= (R, t).
S602, performing rigid transformation on the texture map to be transformed according to the transformation parameters to obtain a transformed texture map and each vertex on the transformed texture seam.
The texture map to be transformed refers to a texture map with the smallest area in the first texture map and the second texture map. Specifically, the second texture map in fig. 6 described below is the texture map to be transformed. The second texture map is subjected to rigid transformation using the transformation parameters obtained in S601, and the transformed texture map is shown in the middle diagram of fig. 6.
And S603, aligning and combining each vertex on the texture joint after transformation with each vertex on the texture joint of the texture graph except the texture graph to be transformed, and obtaining a combined texture graph.
Specifically, as shown in fig. 6, each vertex on the transformed texture seam is aligned and combined with each vertex on the first seam in the first texture map to obtain a combined texture map, the obtained combined texture map is shown in an intermediate map shown in fig. 8, and there is a distortion problem for the combined texture map shown in the intermediate map of fig. 8, so that optimization processing is performed on the combined texture map, specifically, optimization may be performed by using an As-rgid-As-Possible (ARAP) parameterization method with equidistant distortion As a target, and the optimized combined texture map is shown in the rightmost map in fig. 8.
Fig. 9 is a flowchart of a method for determining a merging order according to an embodiment of the present application, as shown in fig. 9, where in S501, obtaining a first texture map corresponding to a first initial patch to be merged and a second texture map corresponding to a second initial patch to be merged in a target continuous plane may include:
s701, calculating the merging cost value of each texture seam in the target continuous plane, and determining the merging sequence of each texture seam according to each merging cost value.
The merging cost value of the texture seam S refers to the merging cost value of a first texture seam in a first texture map corresponding to a first initial panel to be merged and a second texture seam in a second texture map corresponding to a second initial panel to be merged. That is, the texture seam S refers to a texture seam in which a first texture seam and a second texture seam to be combined are combined.
The combined Cost value Cost of each texture seam S can be calculated using the following formula (two).
Wherein p, q is the vertex corresponding to the joint to be merged, such as each vertex p on the first texture joint i Each vertex q on the second texture seam i ，N S For the number of vertices after fusion, M is a rigid transformation in alignment, which can be calculated by the above formula (one).
Optionally, the texture seams are sorted according to the reverse order of the merging cost value, and the sorted texture seams are the merging order of the texture seams.
S702, merging all texture joints according to the merging sequence of all texture joints.
For example, if the texture seams are texture seam a, texture seam C, texture seam D, and texture seam B in the order of merging, the texture seams are merged in that order.
Fig. 10 is a schematic diagram of an apparatus for a three-dimensional model texture processing method according to an embodiment of the present application, where, as shown in fig. 10, the apparatus includes:
an obtaining module 801, configured to obtain a plurality of initial patches in a three-dimensional model and texture maps corresponding to the initial patches, where the texture maps include at least one texture seam;
A determining module 802, configured to determine at least one target continuous plane according to a comprehensive plane index of each initial patch, where the target continuous plane includes at least one initial patch, and the comprehensive plane index is used to characterize the flatness and the long and narrow degree of a point set in the initial patch;
a merging module 803, configured to merge texture maps corresponding to the initial patches in the target continuous plane, and generate an initial texture map of the target continuous plane;
and a repairing module 804, configured to repair the gap in the initial texture map to obtain a target texture map, and render the target texture map onto the target continuous plane in the three-dimensional model.
Optionally, the determining module 802 is specifically configured to:
determining a reference patch from the plurality of initial patches according to the comprehensive plane index of each initial patch;
and sequentially determining the surface patches to be combined according to the comprehensive plane index of the reference surface patch and the comprehensive plane indexes of a plurality of residual surface patches except the reference surface patch in the plurality of initial surface patches, and sequentially combining the surface patches to be combined to obtain the target continuous plane.
Optionally, the determining module 802 is specifically configured to:
A. taking the reference surface piece as a current continuous plane;
B. determining a combined plane index after the first point set is combined to the second point set according to the first point set of the current residual surface and the second point set of the current continuous plane;
C. if the combined plane index is greater than a preset threshold, combining the current residual patches to the current continuous plane to obtain a new current continuous plane, and taking the next residual patch of the current residual patches as a new current residual patch; if the combined plane index is smaller than or equal to a preset threshold value, taking the next remaining patch of the current remaining patches as a new current remaining patch;
and C, repeating the steps B-C until all the rest patches are traversed, and taking the current continuous plane as the target continuous plane.
Optionally, the determining module 802 is specifically configured to:
merging the first point set to the second point set to obtain a merged point set;
determining a covariance matrix of the combined point set, and carrying out feature decomposition on the covariance matrix to obtain a plurality of feature values;
And determining the combined plane index according to each characteristic value.
Optionally, the merging module 803 is specifically configured to:
acquiring a first texture map corresponding to a first initial surface patch to be combined and a second texture map corresponding to a second initial surface patch to be combined in the target continuous plane, wherein the first initial surface patch to be combined and the second initial surface patch to be combined are any two adjacent planes in the target continuous plane in a three-dimensional model, the first texture map comprises a first texture joint and each vertex on the first texture joint, and the second texture map comprises a second texture joint and each vertex on the second texture joint;
combining the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a combined texture map;
and obtaining an initial texture map of the target continuous plane according to each combined texture map.
Optionally, the merging module 803 is specifically configured to:
determining conversion parameters according to the texture coordinates of each vertex on the first joint and the texture coordinates of each vertex on the second joint;
Rigidly transforming the texture map to be transformed according to the transformation parameters to obtain a transformed texture map and each vertex on a transformed texture joint, wherein the texture map to be transformed is a texture map with the smallest area in the first texture map and the second texture map;
and aligning and combining each vertex on the texture joint after transformation with each vertex on the texture joint of the texture graph except the texture graph to be transformed to obtain a combined texture graph.
Optionally, the merging module 803 is specifically configured to:
calculating the merging cost value of each texture joint in the target continuous plane, and determining the merging sequence of each texture joint according to the merging cost value;
and merging the texture seams according to the merging sequence of the texture seams.
Fig. 11 is a block diagram of an electronic device 400 according to an embodiment of the present application. As shown in fig. 11, the electronic device may include: a processor 401, and a memory 402.
Optionally, a bus 403 may be further included, where the memory 402 is configured to store machine readable instructions executable by the processor 401 (e.g., execution instructions corresponding to the acquisition module, the calling module, the comparing module in the apparatus in fig. 4, etc.), where when the electronic device 400 is running, the processor 401 communicates with the memory 402 through the bus 403, and where the machine readable instructions are executed by the processor 401 to perform the method steps in the foregoing method embodiments.
The present application also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor performs the method steps in the three-dimensional model texture processing method embodiment described above.
It will be clearly understood by those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described system and apparatus may refer to corresponding procedures in the method embodiments, which are not described in detail in this application. In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. The above-described apparatus embodiments are merely illustrative, and the division of the modules is merely a logical function division, and there may be additional divisions when actually implemented, and for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some communication interface, indirect coupling or communication connection of devices or modules, electrical, mechanical, or other form.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes or substitutions are covered in the protection scope of the present application.
Claims (10)
1. A method for texture processing of a three-dimensional model, the method comprising:
acquiring a plurality of initial patches in a three-dimensional model and texture maps corresponding to the initial patches, wherein the texture maps comprise at least one texture seam;
determining at least one target continuous plane according to the comprehensive plane index of each initial patch, wherein the target continuous plane comprises at least one initial patch, and the comprehensive plane index is used for representing the planeness and the long and narrow degree of a point set in the initial patch;
merging texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane;
repairing the gaps in the initial texture map to obtain a target texture map, and rendering the target texture map onto the target continuous plane in the three-dimensional model.
2. The method of claim 1, wherein determining at least one target continuous plane based on the composite plane index of each of the initial patches comprises:
determining a reference patch from the plurality of initial patches according to the comprehensive plane index of each initial patch;
And sequentially determining the surface patches to be combined according to the comprehensive plane index of the reference surface patch and the comprehensive plane indexes of a plurality of residual surface patches except the reference surface patch in the plurality of initial surface patches, and sequentially combining the surface patches to be combined to obtain the target continuous plane.
3. The method according to claim 2, wherein sequentially determining the to-be-combined patches according to the integrated plane index of the reference patch and the integrated plane indexes of the remaining patches except the reference patch in the plurality of initial patches, and sequentially combining the to-be-combined patches to obtain the target continuous plane, comprises:
A. taking the reference surface piece as a current continuous plane;
B. determining a combined plane index after the first point set is combined to the second point set according to the first point set of the current residual surface and the second point set of the current continuous plane;
C. if the combined plane index is greater than a preset threshold, combining the current residual patches to the current continuous plane to obtain a new current continuous plane, and taking the next residual patch of the current residual patches as a new current residual patch; if the combined plane index is smaller than or equal to a preset threshold value, taking the next remaining patch of the current remaining patches as a new current remaining patch;
And C, repeating the steps B-C until all the rest patches are traversed, and taking the current continuous plane as the target continuous plane.
4. A method of texture processing of a three-dimensional model according to claim 3, wherein the determining the merged plane index after merging the first set of points into the second set of points based on the first set of points of the current remaining patch and the second set of points of the current continuous plane comprises:
merging the first point set to the second point set to obtain a merged point set;
determining a covariance matrix of the combined point set, and carrying out feature decomposition on the covariance matrix to obtain a plurality of feature values;
and determining the combined plane index according to each characteristic value.
5. The method according to claim 1, wherein merging texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane includes:
acquiring a first texture map corresponding to a first initial surface patch to be combined and a second texture map corresponding to a second initial surface patch to be combined in the target continuous plane, wherein the first initial surface patch to be combined and the second initial surface patch to be combined are any two adjacent planes in the target continuous plane in a three-dimensional model, the first texture map comprises a first texture joint and each vertex on the first texture joint, and the second texture map comprises a second texture joint and each vertex on the second texture joint;
Combining the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a combined texture map;
and obtaining an initial texture map of the target continuous plane according to each combined texture map.
6. The method according to claim 5, wherein merging the first texture map and the second texture map according to each vertex on the first texture seam and each vertex on the second texture seam to obtain a merged texture map comprises:
determining conversion parameters according to the texture coordinates of each vertex on the first joint and the texture coordinates of each vertex on the second joint;
rigidly transforming the texture map to be transformed according to the transformation parameters to obtain a transformed texture map and each vertex on a transformed texture joint, wherein the texture map to be transformed is a texture map with the smallest area in the first texture map and the second texture map;
and aligning and combining each vertex on the texture joint after transformation with each vertex on the texture joint of the texture graph except the texture graph to be transformed to obtain a combined texture graph.
7. The method for processing textures of a three-dimensional model according to claim 5, wherein before obtaining the first texture map corresponding to the first initial patch to be merged and the second texture map corresponding to the second initial patch to be merged in the target continuous plane, the method comprises:
calculating the merging cost value of each texture joint in the target continuous plane, and determining the merging sequence of each texture joint according to the merging cost value;
and merging the texture seams according to the merging sequence of the texture seams.
8. A three-dimensional model texture processing apparatus, comprising:
the acquisition module is used for acquiring a plurality of initial patches in the three-dimensional model and texture maps corresponding to the initial patches, wherein the texture maps comprise at least one texture seam;
a determining module, configured to determine at least one target continuous plane according to a comprehensive plane index of each initial patch, where the target continuous plane includes at least one initial patch, and the comprehensive plane index is used to characterize the flatness and the long and narrow degree of a point set in the initial patch;
the merging module is used for merging texture maps corresponding to the initial patches in the target continuous plane to generate an initial texture map of the target continuous plane;
And the repairing module is used for repairing the gaps in the initial texture map to obtain a target texture map, and rendering the target texture map onto the target continuous plane in the three-dimensional model.
9. An electronic device comprising a memory and a processor, the memory storing a computer program executable by the processor, the processor implementing the steps of the three-dimensional model texture processing method of any one of claims 1-7 when the computer program is executed.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, performs the steps of the three-dimensional model texture processing method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311558331.2A CN117611720A (en) | 2023-11-20 | 2023-11-20 | Three-dimensional model texture processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311558331.2A CN117611720A (en) | 2023-11-20 | 2023-11-20 | Three-dimensional model texture processing method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117611720A true CN117611720A (en) | 2024-02-27 |
Family
ID=89948918
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311558331.2A Pending CN117611720A (en) | 2023-11-20 | 2023-11-20 | Three-dimensional model texture processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117611720A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120976441A (en) * | 2025-10-17 | 2025-11-18 | 南昌大学 | A Fast 3D Face Reconstruction Method and System Based on Left and Right Face Depth Cameras |
-
2023
- 2023-11-20 CN CN202311558331.2A patent/CN117611720A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120976441A (en) * | 2025-10-17 | 2025-11-18 | 南昌大学 | A Fast 3D Face Reconstruction Method and System Based on Left and Right Face Depth Cameras |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12353191B2 (en) | Conversion of mesh geometry to editable and watertight boundary representation in computer aided design | |
| CN103617603B (en) | A kind of self-repairing method of 3-dimensional digital geometric mesh model structure | |
| CN103294421B (en) | 3D copying device | |
| US20090153577A1 (en) | Method and system for texturing of 3d model in 2d environment | |
| Marchandise et al. | CAD and mesh repair with radial basis functions | |
| CN111738265B (en) | Semantic segmentation method, system, medium and electronic device for RGB-D images | |
| CN102812463A (en) | Method And System Enabling 3D Printing Of Three-dimensional Object Models | |
| CN110084894B (en) | Local amplification display method and device of three-dimensional model and electronic equipment | |
| Du et al. | Constrained boundary recovery for three dimensional Delaunay triangulations | |
| CN119762674B (en) | Implementation method and system of three-dimensional optical system | |
| CN104200517A (en) | Three-dimensional reconstruction method | |
| CN107958481A (en) | A kind of three-dimensional rebuilding method and device | |
| Shen et al. | A line/trimmed NURBS surface intersection algorithm using matrix representations | |
| CN117197063B (en) | Point cloud quality evaluation method based on multi-view projection and transducer model and related products | |
| CN117611720A (en) | Three-dimensional model texture processing method and device, electronic equipment and storage medium | |
| CN106952342A (en) | Point Cloud Homogenization Method Based on Center of Gravity Voronoi Subdivision | |
| KR20060066302A (en) | 3D mesh generation method using dense unaligned 3D measurement points | |
| CN115100354A (en) | Three-dimensional static model reconstruction method and device | |
| CN120029459A (en) | A visual positioning and verification method for complex spatial structure traces with virtual-real fusion | |
| CN110378948B (en) | 3D model reconstruction method and device and electronic equipment | |
| CN119810300A (en) | A method, device, equipment and medium for generating wood grain material texture map | |
| CN119359788A (en) | Front-end-based geometric analysis method and device for section of three-dimensional model | |
| JPH03138784A (en) | 3D model reconstruction method and display method | |
| CN115953552A (en) | A large-scale part model reconstruction method based on local point cloud information | |
| Azariadis et al. | Product design using point-cloud surfaces: A recursive subdivision technique for point parameterization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |