WO2021136334A1 - Video generating method and apparatus, electronic device, and computer readable storage medium - Google Patents

Abstract

Disclosed in the present application are a video generating method and apparatus, an electronic device, and a computer readable storage medium. The method comprises: obtaining at least one piece of first image data; performing character analysis processing on the first image data to obtain character information comprised in the first image data; obtaining at least one first text segment; determining matching data of the character information of the first image data and the first text segment; according to the matching data, processing the first image data to generate a plurality of pieces of second image data, wherein character information, matched with the first text segment, in the second image data has a first display effect; and generating first video data according to the plurality of pieces of second image data. The method can automatically generate, according to various image and text materials, an image and text video in which image data and a text segment correspond to each other, thereby greatly improving the generation efficiency of the image and text video.

Description

Video generation method and device, electronic equipment and computer readable storage medium

This application claims the priority of the Chinese patent application filed on December 31, 2019 with the application number 201911412228.0 and the invention title "Video generation method and device, electronic equipment, and computer-readable storage medium", the entire content of which is incorporated by reference In this application.

Technical field

This application relates to the field of video generation, and in particular to a video generation method and device, electronic equipment, and computer-readable storage media.

Background technique

With the development of Internet technology, more and more users learn by watching videos, so a large number of videos with pictures and texts are needed. This kind of graphic video is different from various common videos. It is actually a collection of materials related to specific content, such as pictures and text. Therefore, in the prior art, graphics and text can only be generated by manual editing. video. For example, it is necessary to collect and organize various graphic materials, such as pictures, articles, etc., and then manually organize them to finally form graphic videos. However, such an existing method of manually making graphic videos requires a lot of manual participation, which is not only costly, but also relatively low in production efficiency.

Therefore, there is a need for a solution that can automatically produce graphics and text videos based on various graphics and text materials to reduce production costs and improve efficiency.

Summary of the invention

The content of the embodiments of this application is provided to introduce some concepts that will be further described in the following detailed description in a condensed form. The content of this application is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

The embodiments of the present application provide a video generation method and device, electronic equipment, and computer-readable storage medium, which can automatically parse text in an image and establish a matching relationship with audio, thereby generating a video with text and audio synchronization display effects.

To achieve the foregoing objective, an embodiment of the present application provides a video generation method, including:

Acquiring at least one first image data;

Performing text analysis processing on the first image data to obtain text information contained in the first image data;

Obtain at least one first text segment;

Determining the matching data between the text information of the first image data and the first text segment;

Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and

The first video data is generated according to the plurality of second image data.

The embodiment of the application also provides a video generation method, including:

Acquiring at least one first image data;

Performing text analysis processing on the first image data to obtain text information contained in the first image data;

Input the text information into a search engine to obtain at least one first text segment;

Determining the matching data between the text information of the first image data and the first text segment;

Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and

The first video data is generated according to the second image data.

The embodiment of the application also provides a video generation method, including:

Receiving at least one first image data and at least one first text segment input by a user;

Performing text analysis processing on the first image data to obtain text information contained in the first image data;

Determining the matching data between the text information of the first image data and the first text segment;

Showing the matching data to the user;

Receiving instruction data for the matching data input by a user, where the instruction data includes at least instruction information for the first display effect of the matching data;

Processing the first image data according to the instruction data to generate a plurality of second image data, wherein the text information matching the first text segment in the second image data has the first display effect; as well as

The first video data is generated according to the second image data.

The embodiment of the present application also provides a video generation device, including:

An acquiring component, the acquiring component used to acquire at least one first image data and at least one first text segment;

An analysis component, which is used to perform text analysis processing on the first image data to obtain text information contained in the first image data;

A matching component, the matching component is used to determine the text information of the first image data and the matching data of the first text segment;

An image data generation component, the image data generation component is used to process the first image data according to the matching data to generate a plurality of second image data, wherein the second image data and the first text The matched text information has the first display effect; and

The video data generating component is configured to generate first video data according to the plurality of second image data.

The embodiment of the present application also provides a video generation device, including:

An image data acquisition component, the image data acquisition component being used to acquire at least one piece of first image data;

An analysis component, which is used to perform text analysis processing on the first image data to obtain text information contained in the first image data;

A text segment acquisition component, which is used to input the text information into a search engine to acquire at least one first text segment;

A matching component, the matching component is used to determine the text information of the first image data and the matching data of the first text segment;

An image data generation component, the image data generation component is used to process the first image data according to the matching data to generate a plurality of second image data, wherein the second image data and the first text The matched text information has the first display effect; and

The video data generating component is configured to generate first video data according to the plurality of second image data.

The embodiment of the present application also provides a video generation device, including:

A receiving component configured to receive at least one first image data and at least one first text segment input by a user;

An analysis component, which is used to perform text analysis processing on the first image data to obtain text information contained in the first image data;

A matching component, the matching component is used to determine the text information of the first image data and the matching data of the first text segment;

A display component for displaying the matching data to the user, and

The receiving component is further configured to receive instruction data for the matching data input by a user, wherein the instruction data includes at least instruction information for the first display effect of the matching data;

The video generating device further includes: an image data generating component configured to process the first image data according to the instruction data to generate a plurality of second image data, wherein the second image The text information in the data that matches the first text segment has the first display effect; and

A video data generating component, the video data generating component is configured to generate first video data according to the second image data

The embodiment of the present application also provides an electronic device, including:

Processing unit; and

A memory, coupled to the processing unit and containing instructions stored thereon, which when executed by the processing unit causes the device to perform actions, the actions including:

Acquiring at least one first image data;

Performing text analysis processing on the first image data to obtain text information contained in the first image data;

Obtain at least one first text segment;

Determining the matching data between the text information of the first image data and the first text segment;

Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and

The first video data is generated according to the plurality of second image data.

The embodiments of the present application also provide a computer-readable storage medium on which instructions are stored, and the instructions include:

Acquiring at least one first image data;

Performing text analysis processing on the first image data to obtain text information contained in the first image data;

Obtain at least one first text segment;

Determining the matching data between the text information of the first image data and the first text segment;

Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and

The first video data is generated according to the plurality of second image data.

The video generation method and device, electronic equipment, and computer-readable storage medium provided by the embodiments of the present application obtain the text information contained in the image data from the first image data and determine the match between such text information and at least one text segment Data, so that the matching relationship between the image data and at least one text segment can be established, and then the image data can be processed based on such matching relationship to generate a plurality of second image data corresponding to the text segment, and finally based on these first images. Second, the image data generates video data in which the text information matching the text segment has the first display effect. In this way, the image and text video in which the image data and the text segment correspond to each other can be automatically generated based on various graphic materials, thereby greatly improving Improved the efficiency of graphic and video generation.

The above description is only an overview of the technical solutions of the present disclosure. In order to understand the technical means of the present disclosure more clearly, they can be implemented in accordance with the content of the specification, and in order to make the above and other objectives, features and advantages of the present disclosure more obvious and understandable. In the following, specific embodiments of the present disclosure are specifically cited.

Description of the drawings

1A to 1C are schematic diagrams describing application scenarios of a video generation solution according to an embodiment of the present application;

Fig. 2 is a schematic flowchart of a video generation method according to an embodiment of the present application;

Fig. 3 is a schematic diagram describing an application scenario of a video generation method according to an embodiment of the present application;

FIG. 4 is a schematic flowchart of another video generation method according to an embodiment of the present application;

Fig. 5 is a schematic structural diagram of a video generating device according to an embodiment of the present application;

Fig. 6 is a schematic structural diagram of a video generating device according to an embodiment of the present application;

Fig. 7 is a schematic structural diagram of a video generating device according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the application.

Detailed ways

Hereinafter, exemplary embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although the drawings show exemplary embodiments of the present disclosure, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

With the development of Internet technology, more and more users learn by watching videos, so a large number of videos with pictures and texts are needed. Such a graphic video is different from various common videos, and it is actually a collection of various materials related to specific content, such as pictures and text. For example, when a content needs to be explained, it needs to be explained based on a picture and combined with a paragraph of explanatory text. That is, it is necessary to record a video based on one or more pictures and text or audio corresponding to the content of the picture. In this case, the playback of the picture needs to be synchronized with the text of the explanation, and the text can be further converted into audio, so as to realize the audio explanation of the content of the picture.

However, in the prior art, such image-text video can only be produced manually. For example, you need to collect and organize various materials, such as pictures, articles, and video clips, etc., and then manually edit and organize them. For example, collect the corresponding text according to the content of the picture or manually make the text, and generate matching graphic data , So as to finally form a graphic video. However, such an existing manual video production method requires a lot of manual participation, which is not only high in cost but also relatively low in production efficiency.

Therefore, there is a need for a solution that can automatically produce graphics and text videos based on various materials to reduce production costs and improve efficiency.

1A to 1C are schematic diagrams describing application scenarios of a video generation solution according to an embodiment of the present application. As shown in FIG. 1A, in an application scenario according to an embodiment of the present application, various materials can be obtained from various data sources as input data. These materials may include, for example, pictures, text, mixed data of pictures and text, video, audio, and so on. The pictures and text segments in these materials can be directly used as pictures 11 and text segments 12 for subsequent video generation processing, or if the obtained material data is mixed data containing pictures and text, video, audio, etc., you can These data are processed in advance, and the processed pictures and text are used as the picture 11 and the text segment 12 shown in FIG. 1A for subsequent video generation processing. After the picture 11 is obtained, the picture 11 can be extracted to extract various text information in the picture 11. For example, as shown in FIG. 1A, text information 111 to 11n can be extracted from the picture 11. The extracted text information 111 to 11n may be, for example, subtitles of some sub-content involved in the content described in the picture. Therefore, the matching data between these text information 111 to 11n and the text segment 12 can be further determined. The matching data mentioned here may be the correspondence between each of the text information 111 to 11n and the corresponding content in the text segment 12. For example, as shown in FIG. 1A, the text segment 12 may include sub-text segments 121 to 12n, which respectively correspond to the respective text information 111 to 11n in the picture 11, and may be for the text information 111 to 11n in the picture 11. Further explanation of each subtitle of the content of the picture 11 shown. Therefore, after determining the matching data between the text information of the picture 11 and the text segment, the picture 11 can be processed according to the matching data and a plurality of pictures 131 to 13n for the video can be generated, each of which is a picture for the video. It may be one of the sub-text segments including the content of the picture 11 and the text segment 12, and the text information of the picture 11 corresponding to the included sub-text segment may be given a specific display effect. For example, the text information 111 of the picture 11 corresponds to the sub-text segment 121 of the text segment 12. That is, the sub-text segment 121 records the description and explanation of the text information 111, and the picture 11 can be processed based on such matching data, thereby A picture 131 containing the entire content of the picture 11 and the video of the sub-section 121 is generated, and the picture 131 may contain a display effect applied to the text information 111 corresponding to the sub-text section 121, for example, as shown in FIG. 1A As shown, the text information 111 can be highlighted, so that the user can clearly understand when watching this part of the video, that the sub-text segment 121 is explaining and explaining the text information 111. By analogy, when multiple pictures 131 to 13n are generated, the video 15 can be further generated based on these pictures 131 to 13n.

Next, referring to FIG. 1A and FIG. 2, the video generation method according to the embodiment of the present application will be described in detail. Fig. 2 is a schematic flowchart of a video generation method according to an embodiment of the present application. As shown in FIG. 2, the video generation method according to the embodiment of the present application includes the following steps:

201. Acquire at least one piece of first image data.

In the embodiment of the present application, the material used to generate the video can be obtained from various data sources as the first image data. For example, a picture containing text may be obtained from various web pages as the first image data, or the user may directly input a picture containing text on the user interface as the first image data. Of course, in the embodiment of the present application, various pictures can also be obtained from various data sources, and then the obtained pictures are preprocessed to identify pictures containing text as the first image data. Alternatively, the user may input any material through the user interface, and process the picture input by the user to recognize the picture containing text as the first image data.

202. Perform text analysis processing on the first image data to obtain text information contained in the first image data.

In the embodiments of the present application, after the first image data is acquired, various text analysis processing, such as text extraction technology, can be used to analyze and process the acquired first image data, so that the text sentences contained in the image can be acquired. Segment as text information. For example, when the picture 11 shown in FIG. 1A is acquired as the first image data, all the text segments contained in the image can be acquired through image processing as the text information "TOP1" 111, "in the embodiment of the present application. "High conversion" 112 and "S-level big promotion" 113.

203. Acquire at least one first text segment.

In the embodiment of the present application, after the first image data is acquired, at least one first text segment 12 can be further acquired. In the embodiment of the present application, at least one first text segment can be obtained according to the first image data, or various text segments can be obtained from a text data source to be used as a candidate first text segment for subsequent processing. The first text segment 12 may include a plurality of first sub-text segments. For example, the first text segment 12 may be a text segment containing multiple text fields or multiple text sentences. In the embodiment of the present application, the at least one first text segment obtained in step 203 may be a text segment related to the content of the first image data, or a text segment containing text related to the content of the first image data. , Or any text segment.

In particular, in the embodiment of the present application, there is no restriction on the order of the two steps of obtaining the first image data and obtaining the first text segment. For example, step 201 may be performed to obtain the first image data and then step 203 may be performed to obtain the first text segment, or step 203 may be performed to obtain the first text segment, and then step 201 may be performed to obtain the first image data. Of course, step 201 and step 203 can also be performed at the same time.

204. Determine the matching data between the text information of the first image data and the first text segment.

In the embodiment of the present application, after the text information 111-113 and the first text segment are obtained, the matching data between these text information 111-113 in the first image data and the first text segment can be further determined. For example, the multiple sub-text segments contained in the first text segment may be compared with the text information 111-113, respectively, to determine the sub-text segments 121-123 that respectively match the text information 111-113. In the embodiment of the present application, when multiple first text segments are acquired, each first text segment can be compared with the text information one by one to determine matching data. For example, as shown in Figure 1A, step 204 can be used to determine that the text information "TOP1" 111, "High Conversion" 112, and "S-level promotion" 113 are respectively associated with the sub-text segment in the text segment 12. "121, "Intelligent Optimal Placement Hosting" 122, and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship, and thus constitute matching data. In the embodiment of this application, there may be multiple first text segments. For example, there may be sub-text segments containing the above-mentioned sub-text segments "marking the first position to show strength" 121, "intelligent preferred placement hosting" 122, and "unlimited theme difference marketing" 123. The first text segment 12 may additionally contain another first text that contains sub-text segments "first place in search results for 30 days", "optimized conversion improvement" level 1 "S-level promotion, town shop treasure, etc." Segment 12. Therefore, in this case, it can be determined in this step 204 that the text information "TOP1" 111, "High Conversion" 112, and "S-level promotion" 113 are respectively and the sub-text segment in the text segment 12 "marking the first position to show the strength" "121, "Smart Optimal Placement Hosting" 122 and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship, and the text information "TOP1" 111, "High Conversion" 112 and "S-Level Promotion" 113 are respectively in another text segment 12. The sub-text segments of "search results ranked first for 30 days", "optimized conversion improvement" level one, "S-level big promotion, town shop treasure, etc. scenes" have a corresponding relationship. Therefore, in this case, such a two-layer correspondence relationship can constitute the matching data between the text information of the first image data and the multiple first text segments.

205. Process the first image data according to the matching data to generate multiple second image data.

In the embodiment of the present application, after the text information of the first image data and the matching data of the first text segment are determined in step 204, the first image data may be processed based on the matching data thus determined. For example, the processing may include embedding each corresponding sub-text segment in the first text segment in the first image data, and corresponding to the embedded sub-text segment, so that the text information corresponding to the embedded sub-text segment has a specific Display of results. For example, the text information can be highlighted, the font of the text information can be displayed in bold, or a graphic mark can be added to the text information. Therefore, when the user views the plurality of second image data formed in this way, the object described by the currently displayed subtext field can be obtained according to the text information with a display effect.

For example, referring to FIG. 1A, when it is determined in step 204 that the text information "TOP1" 111, "High Conversion" 112, and "S-level promotion" 113 are respectively the same as the sub-text segment in the text segment 12 "Marking the first position to show strength" 121 , "Intelligent Optimal Placement Hosting" 122 and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship, and after forming matching data, image 11 can be processed based on such matching data, so that the image 11 can be embedded with children. The text segment "Marking the first place to show strength" 121, "Smart optimal placement hosting" 122 and "Unlimited theme difference marketing" 123 are the three sub-text segments pictures 131-133, and each of the pictures 131-133 corresponds to the The text information of the embedded sub-text segment may have a specific display effect. For example, in the picture 131 of the sub-text segment "marking the first place to show strength" 121, the text information "TOP1" 111 corresponding to the sub-text segment "marking the first place to show strength" 121 can have a highlight display effect to remind The user who is watching, the content currently being explained or explained is the text information "TOP1" 111.

206. Generate first video data according to the multiple second image data.

When multiple pictures 131-133 embedded with multiple sub-text segments of the text segment 12 are generated as described above, video data can be generated based on these pictures. Therefore, according to the video generation method of the embodiment of the present application, by obtaining the text information contained in the image data from the first image data and determining the matching data between such text information and at least one text segment, the image data and the at least one text segment can be established. The matching relationship between a text segment, and then the image data can be processed based on such a matching relationship to generate multiple second image data corresponding to the text segment, and finally based on these second image data to generate which matches the text segment The text information has the first display effect of video data. In this way, the image and text video in which the image data and the text segment correspond to each other can be automatically generated based on various image and text materials, thereby greatly improving the generation efficiency of the image and text video.

According to another embodiment of the present application, as shown in FIG. 3, FIG. 3 is a schematic diagram describing an application scenario of a video generation method according to an embodiment of the present application. As shown in FIG. 3, in another application scenario according to an embodiment of the present application, after the picture 11 is acquired and the text information in the picture 11 is extracted. For example, as shown in FIG. 3, text information 111 to 11n are extracted from the picture 11. After that, the text segment 12 can be acquired, and the audio data 181-18n corresponding to each sub-text segment 121-12n in the text segment 12 can be generated or acquired based on the text segment 12. Then, as shown in FIG. 1A, after the matching data of the text information 111 to 11n and the text segment 12 is determined, the picture 11 can be processed according to such matching data and a plurality of pictures 131 to 131 for video can be generated. 13n, the picture for each video can be one of the sub-text segments containing the content of the picture 11 and the text segment 12, and the text information of the picture 11 corresponding to the contained sub-text segment can be applied with specific Display effect. For example, the text information 111 of the picture 11 corresponds to the sub-text segment 121 of the text segment 12. That is, the sub-text segment 121 records the description and explanation of the text information 111, and the picture 11 can be processed based on such matching data, thereby A picture 131 for the video containing the entire content of the picture 11 and the sub-text segment 121 is generated, and the picture 131 may contain a display effect applied to the text information 111 corresponding to the sub-text segment 121, for example, as shown in FIG. 1A As shown, the text information 111 can be highlighted, so that the user can clearly understand when watching this part of the video, that the sub-text segment 121 is explaining and explaining the text information 111. By analogy, in the application scenario shown in FIG. 3, when multiple pictures 131 to 13n are generated, these pictures 131 to 13n and the sub-text segments 121-12n embedded in these pictures 131 to 13n can be used. Corresponding audio 181-18n to further generate video. Therefore, in the application scenario as shown in Figure 3, the generated video not only includes the sub-text segment corresponding to the text information as the content object of the current explanation or description, but also includes the sub-text segment corresponding to the sub-text segment. Audio data, so when the user views the part, he can not only watch the text explaining or explaining the text information, but also listen to the audio of the explanation or explanation.

The following describes the video generation method according to an embodiment of the present application with reference to FIG. 4, which is another schematic flowchart of the video generation method according to the embodiment of the present application. As shown in FIG. 4, the video generation method according to another embodiment of the present application includes the following steps:

401. Acquire first data including images and text.

402. Perform image extraction processing on the first data to extract at least one image from the first data as first image data.

403. Perform text extraction processing on the first data to extract at least one text segment from the first data as a first text segment.

In the embodiment of the present application, the material used to generate the video can be obtained from various data sources as the first image data. For example, a picture containing text may be obtained from various web pages as the first image data, or the user may directly input a picture containing text on the user interface as the first image data. Of course, in the embodiment of the present application, various pictures can also be obtained from various data sources, and then the obtained pictures are preprocessed to identify pictures containing text as the first image data. Alternatively, the user may input any material through the user interface, and process the picture input by the user to recognize the picture containing text as the first image data.

In practical applications, there will also be various mixed data containing both images and corresponding texts. For example, for news reports of a certain event, etc. Therefore, in such mixed data, a picture and a text segment describing the picture already exist. Therefore, as shown in the embodiment of the present application, after obtaining such mixed data, the first image data and the first text segment may be obtained by performing image extraction processing and text extraction processing on the mixed data respectively.

In particular, in the embodiment of the present application, there is no restriction on the order of the two steps of obtaining the first image data and obtaining the first text segment. For example, step 402 may be performed to obtain the first image data and then step 403 may be performed to obtain the first text segment, or step S303 may be performed to obtain the first text segment, and then step 402 may be performed to obtain the first image data. Of course, step 402 and step 403 can also be performed at the same time.

404. Perform text analysis processing on the first image data to obtain text information contained in the first image data.

In the embodiment of the present application, in the embodiment of the present application, after the first image data is acquired, various text analysis processing, such as text extraction technology, can be used to analyze and process the acquired first image data. Acquire text segments contained in the image as text information. For example, when the picture 11 shown in FIG. 1A is acquired as the first image data, all the text segments contained in the image can be acquired through image processing as the text information "TOP1" 111, "in the embodiment of the present application. High conversion" 112 and "S-level big promotion" 113. 203, obtain at least one first text segment.

In the embodiment of the present application, the text analysis processing can use any technical solution in the art to obtain the text information contained in the first image data. For example, the blank area in the first image data can be recognized first, and then the text area surrounded by the blank area can be determined based on the recognized blank area, and then text extraction processing can be performed on the text area to generate text information.

In the embodiment of the present application, after the first image data is acquired, at least one first text segment 12 can be further acquired. In the embodiment of the present application, at least one first text segment can be obtained according to the first image data, or various text segments can be obtained from a text data source to be used as a candidate first text segment for subsequent processing. The first text segment 12 may include a plurality of first sub-text segments. For example, the first text segment 12 may be a text segment containing multiple text fields or multiple text sentences. In the embodiment of the present application, the acquired at least one first text segment may be a text segment related to the content of the first image data, or a text segment containing text related to the content of the first image data, or also Any text segment can be used.

In addition, in the scenario shown in FIG. 1B, in the embodiment of the present application, at least one keyword may be generated based on the text information contained in the first image data, and the first text segment may be obtained based on the generated keyword. For example, a search algorithm may be used to perform a search process on the Internet based on the generated keywords to obtain a text segment related to the text information contained in the first image data. For another example, a text generation algorithm can be used based on the generated keyword to directly generate a text segment matching the text information corresponding to the keyword based on the keyword.

405. Determine the matching data between the text information of the first image data and the first text segment.

In the embodiment of the present application, after the text information 111-113 and the first text segment are obtained, the matching data between these text information 111-113 in the first image data and the first text segment can be further determined. For example, the multiple sub-text segments contained in the first text segment may be compared with the text information 111-113, respectively, to determine the sub-text segments 121-123 that respectively match the text information 111-113. In the embodiment of the present application, when multiple first text segments are acquired, each first text segment can be compared with the text information one by one to determine matching data. For example, as shown in Figure 3, step 204 can be used to determine the text information "TOP1" 111, "High Conversion" 112, and "S-level Big Promotion" 113, respectively, and the sub-text segment in the text segment 12. "121, "Intelligent Optimal Placement Hosting" 122 and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship, and thus constitute matching data. In the embodiment of this application, there may be multiple first text segments. For example, there may be sub-text segments containing the above-mentioned sub-text segments "marking the first position to show strength" 121, "intelligent preferred placement hosting" 122, and "unlimited theme difference marketing" 123. The first text segment 12 may additionally contain another first text that contains sub-text segments "first place in search results for 30 days", "optimized conversion improvement" level 1 "S-level promotion, town shop treasure, etc." Segment 12. Therefore, in this case, the determined text information "TOP1" 111, "High Conversion" 112, and "S-level Big Promotion" 113 can be combined with the sub-text segment in the text segment 12 "Marking the first position to show strength" 121, "Smart Optimal Placement Hosting" 122 and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship, and the text information "TOP1" 111, "High Conversion" 112 and "S-Class Promotion" 113 are respectively subtexts in another text segment 12 The paragraphs "the first 30 days in search results", "optimized conversion improvement", "S-level big promotion, town shop treasures and other scenes" have a corresponding relationship. Therefore, in this case, such a two-layer correspondence relationship can constitute the matching data between the text information of the first image data and the multiple first text segments.

406. Process the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect.

In the embodiment of the present application, after the text information of the first image data and the matching data of the first text segment are determined in step 405, the first image data can be processed based on the matching data thus determined. For example, the processing may include embedding each corresponding sub-text segment in the first text segment in the first image data, and corresponding to the embedded sub-text segment, so that the text information corresponding to the embedded sub-text segment has a specific Display of results. For example, the text information can be highlighted, the font of the text information can be displayed in bold, or a graphic mark can be added to the text information. Therefore, when the user views the plurality of second image data formed in this way, the object described by the currently displayed subtext field can be obtained according to the text information with a display effect.

For example, referring to Figure 3, when it is determined in step 405 that the text information "TOP1" 111, "High Conversion" 112, and "S-Class Promotion" 113 are respectively the same as the sub-text segment in the text segment 12 "Marking the first position to show strength" 121 , "Intelligent Optimal Placement Hosting" 122 and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship, and after forming matching data, image 11 can be processed based on such matching data, so that the image 11 can be embedded with children. The text segment "Marking the first place to show strength" 121, "Smart optimal placement hosting" 122 and "Unlimited theme difference marketing" 123 are the three sub-text segments pictures 131-133, and each of the pictures 131-133 corresponds to the The text information of the embedded sub-text segment may have a specific display effect. For example, in the picture 131 of the sub-text segment "marking the first place to show strength" 121, the text information "TOP1" 111 corresponding to the sub-text segment "marking the first place to show strength" 121 can have a highlight display effect to remind The user who is watching, the content currently being explained or explained is the text information "TOP1" 111.

407. Generate a first audio segment according to the first text segment, where the first audio segment includes audio data corresponding to the first text segment.

According to the embodiment of the present application, the audio data 181-18n corresponding to each sub-text segment 121-12n in the text segment 12 can be further generated or obtained based on the text segment 12. In the embodiment of the present application, audio data is generated based on the text segment 12 in various ways. For example, TTS (Text To Speech) technology can be used to convert the text segment 12 into audio data 181-18n, and other algorithms can also be used to generate content-related audio data based on the content of the text segment 12.

408. Generate the first video data according to the second image data and the first audio segment.

As shown in FIG. 3, when a plurality of pictures 131 to 13n are generated, the pictures 131 to 13n and the audio 181-18n corresponding to the sub-text segments 121-12n embedded in the pictures 131 to 13n can be used to generate Further generate video. Therefore, in the application scenario as shown in Figure 3, the generated video not only includes the sub-text segment corresponding to the text information as the content object of the current explanation or description, but also includes the sub-text segment corresponding to the sub-text segment. Audio data, so when the user views the part, he can not only watch the text explaining or explaining the text information, but also listen to the audio of the explanation or explanation.

In addition, in the embodiment of the present application, the audio data generated from the text segment may further include time information corresponding to the text. For example, the audio information generated based on the sub-text segment "marking the first place to show strength" 121 may further include the playback time required for the audio corresponding to the eight words contained in the sub-text segment "marking the first place to show strength" 121. The playing time can be determined according to the preset speech rate and the length of the text. Therefore, in the video generation method according to the present application, the audio data can be further synchronized with the second image data generated based on the first image data based on the time information. For example, the second image data 131 embedded with the sub-text segment generated based on the sub-text segment "Marking the first position to show strength" 121 can be synchronized with the audio data corresponding to the sub-text segment "Marking the first position to show strength" 121, and further based on In this way, the synchronized second image data and audio data are used to generate video data, so as to ensure that when the user is watching the second image data, the time that the second image data remains played is sufficient to make the audio corresponding to the second image data Data playback is complete.

In addition, in the embodiments of the present application, the user may further specify the playback time of the audio clip corresponding to the second image data before the video data is generated, and after the user confirms the playback time, the second image data and the specified playback time may be combined. The audio clips after the time are synchronized, and video data is generated based on the second image data and audio clips synchronized in this way.

Therefore, according to the video generation method of the embodiment of the present application, by obtaining the text information contained in the image data from the first image data and determining the matching data between such text information and at least one text segment, the image data and the at least one text segment can be established. After a matching relationship between a text segment, the image data can be processed based on such a matching relationship to generate a plurality of second image data corresponding to the text segment, and finally based on these second image data and the matching image data The audio data corresponding to the text segment is generated. The text information that matches the text segment has the first display effect and is synchronized with the video data with audio explanations or instructions. In this way, the image data and the video data can be automatically generated based on various graphic materials. The text segment and audio corresponding to each other's graphic video, thereby greatly improving the efficiency of generating graphic video.

Fig. 5 is a schematic structural diagram of a video generating device according to an embodiment of the present application. Referring to FIG. 5, the video generation device of the present application may include: an acquisition component 501, an analysis component 502, a matching component 503, an image data generation component 504, and a video data generation component 505.

Specifically, the acquiring component 501 is configured to acquire at least one first image data and at least one first text segment.

In the embodiment of the present application, the obtaining component 501 may obtain the material used to generate the video from various data sources as the first image data. For example, a picture containing text may be obtained from various web pages as the first image data, or the user may directly input a picture containing text on the user interface as the first image data. Of course, in the embodiment of the present application, various pictures can also be obtained from various data sources, and then the obtained pictures are preprocessed to identify pictures containing text as the first image data. Alternatively, the user may input any material through the user interface, and process the picture input by the user to recognize the picture containing text as the first image data. In addition, the acquiring component 501 can acquire at least one first text segment according to the first image data, or can acquire various text segments from a text data source to be used as a candidate first text segment for subsequent processing. The first text segment 12 may include a plurality of first sub-text segments. For example, the first text segment 12 may be a text segment containing multiple text fields or multiple text sentences. In the embodiment of the present application, the at least one first text segment acquired by the acquiring component 501 may be a text segment related to the content of the first image data, or a text segment containing text related to the content of the first image data. , Or any text segment.

In addition, the acquiring component 501 may also acquire the first data including the image and the text, and further acquire the first image data and the first text segment by performing image extraction and text extraction on the first data. For example, the obtaining component 501 may obtain pictures containing text from various web pages as the first image data, or the user may directly input pictures containing text on the user interface as the first image data. Of course, in the embodiment of the present application, the acquiring component 501 may also acquire various pictures from various data sources, and then preprocess the acquired pictures to identify pictures containing text as the first image data. Or the acquiring component 501 can also be used by the user to input any material through the user interface, and process the picture input by the user to recognize the picture containing text as the first image data.

In practical applications, there will also be various mixed data containing both images and corresponding texts. For example, for news reports of a certain event, etc. Therefore, in such mixed data, a picture and a text segment describing the picture already exist. Therefore, as shown in the embodiment of the present application, after obtaining such mixed data, the first image data and the first text segment may be obtained by performing image extraction processing and text extraction processing on the mixed data respectively.

The analysis component 502 is configured to perform text analysis processing on the first image data to obtain text information contained in the first image data. In the embodiment of the present application, after acquiring the first image data, the analysis component 502 can use various text analysis and processing technologies, such as text extraction technology, to analyze and process the first image data acquired by the acquisition component 501, so as to obtain The text segment contained in the image is used as text information. For example, when the acquiring component 501 acquires the picture 11 shown in FIG. 1A as the first image data, the analyzing component 502 can acquire all the text segments contained in the image through image processing as the text information in the embodiment of the present application. "TOP1" 111, "High conversion" 112 and "S-level big promotion" 113. 203, obtain at least one first text segment.

In the embodiment of the present application, after the acquiring component 501 acquires the first image data, at least one first text segment 12 can be further acquired. In the embodiment of the present application, the acquiring component 501 can acquire at least one first text segment according to the first image data, or can acquire various text segments from a text data source to use as a candidate first text segment for subsequent processing. The first text segment 12 may include a plurality of first sub-text segments. For example, the first text segment 12 may be a text segment containing multiple text fields or multiple text sentences. In the embodiment of the present application, the at least one first text segment acquired by the acquiring component 501 may be a text segment related to the content of the first image data, or a text segment containing text related to the content of the first image data. , Or any text segment.

The matching component 503 is used to determine the matching data between the text information of the first image data and the first text segment. In the embodiment of the present application, after the analysis component 502 obtains the text information 111-113 and obtains the first text segment of the component 501, the matching component 503 can determine the text information 111-113 in the first image data and the first text segment Matching data.

For example, the matching component 503 may compare the multiple sub-text segments contained in the first text segment with the text information 111-113, respectively, to determine the sub-text segments 121-123 respectively matching the text information 111-113. In the embodiment of the present application, when the acquiring component 501 acquires multiple first text segments, the matching component 503 may compare each first text segment with the text information one by one to determine matching data. For example, as shown in FIG. 1A, the matching component 503 can determine that the text information "TOP1" 111, "High Conversion" 112, and "S-level Big Promotion" 113 are respectively associated with the sub-text segment in the text segment 12 "marking the first position to show strength." 121. "Intelligent Optimal Placement Hosting" 122 and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship and therefore constitute matching data. In the embodiment of this application, there may be multiple first text segments. For example, there may be sub-text segments containing the above-mentioned sub-text segments "marking the first position to show strength" 121, "intelligent preferred placement hosting" 122, and "unlimited theme difference marketing" 123. The first text segment 12 may additionally contain another first text that contains sub-text segments "first place in search results for 30 days", "optimized conversion improvement" level 1 "S-level promotion, town shop treasure, etc." Segment 12. Therefore, in this case, the matching component 503 can determine that the textual information "TOP1" 111, "High Conversion" 112, and "S-level Big Promotion" 113 are respectively and the sub-text segment in the text segment 12 "marking the first position to show strength" 121, "Smart Optimal Placement Hosting" 122 and "Unlimited Theme Differential Marketing" 123 have a corresponding relationship, and the text information "TOP1" 111, "High Conversion" 112 and "S-Class Promotion" 113 are respectively subtexts in another text segment 12 The paragraphs "the first 30 days in search results", "optimized conversion improvement", "S-level big promotion, town shop treasures and other scenes" have a corresponding relationship. Therefore, in this case, such a two-layer correspondence relationship can constitute the matching data between the text information of the first image data and the multiple first text segments.

The image data generating component 504 is configured to process the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has The first display effect. After the matching component 503 determines the text information of the first image data and the matching data of the first text segment, the image data generating component 504 may process the first image data based on the matching data determined by the matching component 503. For example, the processing may include embedding each corresponding sub-text segment in the first text segment in the first image data, and corresponding to the embedded sub-text segment, so that the text information corresponding to the embedded sub-text segment has a specific Display of results. For example, the text information can be highlighted, the font of the text information can be displayed in bold, or a graphic mark can be added to the text information. Therefore, when the user views the plurality of second image data formed in this way, the object described by the currently displayed subtext field can be obtained according to the text information with a display effect.

The video data generating component 505 is configured to generate first video data according to the plurality of second image data. When the image data generating component 504 generates multiple pictures 131-133 embedded with multiple sub-text segments of the text segment 12 as described above, the video data generating component 505 may generate video data based on these pictures.

Therefore, according to the video generation device of the embodiment of the present application, by acquiring the text information contained in the image data from the first image data and determining the matching data between such text information and at least one text segment, the image data and at least one text segment can be established. The matching relationship between a text segment, and then the image data can be processed based on such a matching relationship to generate multiple second image data corresponding to the text segment, and finally based on these second image data to generate which matches the text segment The text information has the first display effect of video data. In this way, the image and text video in which the image data and the text segment correspond to each other can be automatically generated based on various image and text materials, thereby greatly improving the generation efficiency of the image and text video.

Fig. 6 is a schematic structural diagram of a video generation device according to an embodiment of the present application. 6, the video generation device of the present application may include: an image data acquisition component 601, an analysis component 602, a text segment acquisition component 603, a matching component 604, an image data generation component 605, and a video data generation component 606. The image data acquisition component 601 can acquire the materials used to generate the video from various data sources as the first image data. For example, a picture containing text may be obtained from various web pages as the first image data, or the user may directly input a picture containing text on the user interface as the first image data. Of course, in the embodiment of the present application, various pictures can also be obtained from various data sources, and then the obtained pictures are preprocessed to identify pictures containing text as the first image data. Alternatively, the user may input any material through the user interface, and process the picture input by the user to recognize the picture containing text as the first image data.

The analysis component 602 is configured to perform text analysis processing on the first image data to obtain text information contained in the first image data. In the embodiment of the present application, after the image data acquisition component 601 acquires the first image data, the analysis component 602 can use various text analysis and processing technologies, such as text extraction technology, to analyze the first image data acquired by the image data acquisition component 601. Perform analysis and processing, so that the text segment contained in the image can be obtained as text information.

The text segment obtaining component 603 is used to input text information into the search engine to obtain at least one first text segment. In the embodiment of the present application, the text segment obtaining component 603 may generate at least one keyword according to the text information contained in the first image data obtained by the image data obtaining component 601, and obtain the first text segment based on the generated keyword. For example, a search algorithm may be used to perform a search process on the Internet based on the generated keywords to obtain a text segment related to the text information contained in the first image data. For another example, a text generation algorithm can be used based on the generated keyword to directly generate a text segment matching the text information corresponding to the keyword based on the keyword.

The matching component 604 is used to determine the matching data between the text information of the first image data and the first text segment. In the embodiment of the present application, after the image data acquisition component 601 acquires the first image data and the text segment acquisition component 603 acquires the first text segment, the matching component 604 can determine the text information in the first image data and the first text Matching data of the segment.

The image data generating component 605 is configured to process the first image data according to the matching data to generate a plurality of second image data, wherein the text in the second image data that matches the first text segment Information has the first display effect.

After the matching component 604 determines the text information of the first image data and the matching data of the first text segment, the image data generating component 605 may process the first image data based on the matching data determined by the matching component 604. For example, the processing may include embedding each corresponding sub-text segment in the first text segment in the first image data, and corresponding to the embedded sub-text segment, so that the text information corresponding to the embedded sub-text segment has a specific Display of results. For example, the text information can be highlighted, the font of the text information can be displayed in bold, or a graphic mark can be added to the text information. Therefore, when the user views the plurality of second image data formed in this way, the object described by the currently displayed subtext field can be obtained according to the text information with a display effect.

The video data generating component 606 is configured to generate first video data according to the plurality of second image data.

Therefore, according to the video generation device of the embodiment of the present application, the first text segment can be obtained from the Internet using a search algorithm based on the text information in the first image data, and the text information contained in the image data can be obtained by obtaining the text information contained in the image data from the first image data and determining this The matching data between the text information and at least one text segment can establish a matching relationship between the image data and the at least one text segment, and then the image data can be processed based on such a matching relationship to generate a corresponding text segment A plurality of second image data, and finally based on these second image data to generate video data in which the text information matched with the text segment has the first display effect, in this way, the image data and the video data can be automatically generated based on various graphic materials. The textual video corresponding to each other in the text segment greatly improves the generation efficiency of the graphic video.

Fig. 7 is a schematic structural diagram of a video generation device according to an embodiment of the present application. Referring to FIG. 7, the video generating device of the present application may include: a receiving component 701, an analyzing component 702, a matching component 703, a display component 704, an image data generating component 705, and a video data generating component 706. The receiving component 701 is configured to receive at least one first image data and at least one first text segment input by a user. In the embodiment of the present application, the user may input various image data and text segments on, for example, a user interface as the first image data and the first text segment. Of course, the user can also input the first image data and text for the first image data as the first text segment through the receiving component.

The analysis component 702 is configured to perform text analysis processing on the first image data to obtain text information contained in the first image data. After the user inputs the first image data through the receiving component 701, the analysis component 702 can use various text analysis and processing technologies, such as text extraction technology, to analyze and process the first image data input by the user through the receiving component 701, so as to obtain The text segment contained in the image is used as text information.

The matching component 703 is used to determine the matching data between the text information of the first image data and the first text segment. In the embodiment of the present application, after the receiving component 701 receives the first image data and the first text segment input by the user, the matching component 703 can determine the matching data between the text information in the first image data and the first text segment.

The display component 704 is used to display matching data to the user.

In the embodiment of the present application, as shown in FIG. 1C, after the receiving component receives the first image data and the first text segment input by the user, especially after the user has input multiple image data and various text segments , Users often want to be able to see the matching results between the inputted image data and text segments in order to determine the desired display effect. Therefore, in the embodiment of the present application, the display component 704 may be used to display the result of the matching processing performed by the matching component 703 on the image data and text segment input by the user to the user. Therefore, the receiving component 701 may be further configured to receive instruction data for the matching data input by the user, where the instruction data includes at least instruction information for the first display effect of the matching data. For example, as shown in Figures 1C and 3, when the matching component 703 determines that the text information "TOP1" 111, "High Conversion" 112, and "S-Class Promotion" 113 are respectively associated with the sub-text segment in the text segment 12, the "marking first position" is highlighted. When “strength” 121, “intelligent optimal placement hosting” 122, and “unlimited theme difference marketing” 123 have a corresponding relationship, the display component 704 can display the result to the user, so that the user can determine to apply a bold effect to the text information 111, and to the text information 112 applies an underline effect, and applies a bubble graphic to the text information 113, so that the user can customize the display effect.

The image data generating component 705 is configured to process the first image data according to the instruction data to generate a plurality of second image data, wherein the text information matching the first text segment in the second image data has the The first display effect. In the embodiment of the present application, after the user inputs an instruction for the display effect of text information through the receiving component 701, the image data generating component 705 can process the image data according to the instruction to generate a plurality of images that meet the requirements of the user. The second image data. When the user specifies the display effect for only part of the text information, the image data generating component 705 can automatically specify the display effect for other text information, or the automatically specified display effect can also be output to the user, and then further through the receiving component 701 Receive user instructions.

The video data generating component 706 is configured to generate first video data according to a plurality of second image data.

FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the application.

The electronic device of the present disclosure may be a mobile terminal device with mobility, or a less mobile or non-mobile computing device. The electronic device of the present disclosure has at least a processing unit and a memory, and instructions are stored in the memory. The processing unit obtains the instructions from the memory and executes processing to make the electronic device perform actions.

The video generation method and the video generation device are described above, and the generation device can be implemented as an electronic device. As shown in FIG. 8, the electronic device includes a memory 801 and a processor 802.

The memory 801 is used to store programs. In addition to the aforementioned programs, the memory 801 may also be configured to store other various data to support operations on the electronic device. Examples of these data include instructions for any application or method operating on the electronic device, contact data, phone book data, messages, pictures, videos, etc.

The memory 801 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.

The processor 802 is not only limited to the central processing unit (CPU), but may also be a graphics processing unit (GPU), field programmable gate array (FPGA), embedded neural network processor (NPU) or artificial intelligence (AI) chip Wait for the processing chip. The processor 802 is coupled with the memory 801, and executes the program stored in the memory 501 for:

Acquiring at least one first image data;

Performing text analysis processing on the first image data to obtain text information contained in the first image data;

Obtain at least one first text segment;

Determining the matching data between the text information of the first image data and the first text segment;

Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and

The first video data is generated according to the plurality of second image data.

Further, as shown in FIG. 8, the electronic device may further include: a communication component 803, a power supply component 804, an audio component 805, a display 806 and other components. Only part of the components are schematically shown in the figure, which does not mean that the electronic device only includes the components shown in the figure.

The communication component 803 is configured to facilitate wired or wireless communication between the electronic device and other devices. Electronic devices can access wireless networks based on communication standards, such as WiFi, 4G or 5G, or a combination of them. In an exemplary embodiment, the communication component 803 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 803 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

The power supply component 804 provides power for various components of the electronic device. The power supply component 804 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for electronic devices.

The audio component 805 is configured to output and/or input audio signals. For example, the audio component 805 includes a microphone (MIC), and when the electronic device is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive external audio signals. The received audio signal may be further stored in the memory 801 or sent via the communication component 803. In some embodiments, the audio component 805 further includes a speaker for outputting audio signals.

The display 806 includes a screen, and the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.

A person of ordinary skill in the art can understand that all or part of the steps in the foregoing method embodiments can be implemented by a program instructing relevant hardware. The aforementioned program can be stored in a computer readable storage medium. When the program is executed, it executes the steps including the foregoing method embodiments; and the foregoing storage medium includes: ROM, RAM, magnetic disk, or optical disk and other media that can store program codes.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the application, not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or equivalently replace some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. range.

Claims (17)

A video generation method, characterized in that it comprises: Acquiring at least one first image data; Performing text analysis processing on the first image data to obtain text information contained in the first image data; Obtain at least one first text segment; Determining the matching data between the text information of the first image data and the first text segment; Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and The first video data is generated according to the plurality of second image data. The video generation method according to claim 1, wherein the video generation method further comprises: Generate a first audio segment according to the first text segment, wherein the first audio segment includes audio data corresponding to the first text segment, and The generating first video data according to the second image data further includes: The first video data is generated based on the second image data and the first audio segment. The video generation method according to claim 2, wherein the audio clip further includes time information corresponding to the text contained in the first text segment, and the method further comprises: converting the time information to the The audio data is synchronized with the second image data. The video generation method according to claim 1, wherein before said acquiring at least one first image data, the video generation method further comprises: Get the first data containing images and text, The acquiring at least one first image data includes: performing image extraction processing on the first data to extract at least one image from the first data as the first image data, and The acquiring at least one first text segment includes: performing text extraction processing on the first data to extract at least one text segment from the first data as the first text segment. The video generation method according to claim 1, wherein said obtaining at least one first text segment comprises: Generating at least one first keyword according to the text information; Obtain the first text segment from at least one data source using the first keyword. The video generation method according to claim 1, wherein said obtaining at least one first text segment comprises: Generating at least one first keyword according to the text information; At least one preset text generation algorithm is used to generate the first text segment based on the first keyword. The video generation method according to claim 1, wherein the performing text analysis processing on the first image data to obtain text information contained in the first image data comprises: Identifying at least one blank area in the first image data; Determining at least one text area in the first image data based on the identified at least one blank area; and Performing text extraction processing on the at least one text area to obtain the text information. The video generation method according to claim 1, wherein the method further comprises: determining a video template according to the result of the word processing analysis, and The generating first video data according to the second image data includes: The first video data is generated according to the second image data based on the determined video template. The video generation method according to claim 1, wherein the first display effect includes the color of the text in the text information. The video generation method according to claim 1, wherein the processing the first image data according to the matching data to generate a plurality of second image data comprises: Acquiring at least one graphic data according to the text information; Determining the associated position of the text information in the second image data according to the matching data; At least one of the plurality of second image data is generated according to the matching data, the at least one graphic data, and the associated location, wherein each of the at least one second image data includes the location at the associated location At least one of the at least one graphic data at the location. A video generation method, characterized in that it comprises: Acquiring at least one first image data; Performing text analysis processing on the first image data to obtain text information contained in the first image data; Input the text information into a search engine to obtain at least one first text segment; Determining the matching data between the text information of the first image data and the first text segment; Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and The first video data is generated according to the second image data. A video generation method, characterized in that it comprises: Receiving at least one first image data and at least one first text segment input by a user; Performing text analysis processing on the first image data to obtain text information contained in the first image data; Determining the matching data between the text information of the first image data and the first text segment; Showing the matching data to the user; Receiving instruction data for the matching data input by a user, where the instruction data includes at least instruction information for the first display effect of the matching data; Processing the first image data according to the instruction data to generate a plurality of second image data, wherein the text information matching the first text segment in the second image data has the first display effect; as well as The first video data is generated according to the second image data. A video generating device, characterized in that it comprises: An acquiring component, the acquiring component used to acquire at least one first image data and at least one first text segment; An analysis component, which is used to perform text analysis processing on the first image data to obtain text information contained in the first image data; A matching component, the matching component is used to determine the text information of the first image data and the matching data of the first text segment; An image data generation component, the image data generation component is used to process the first image data according to the matching data to generate a plurality of second image data, wherein the second image data and the first text The matched text information has the first display effect; and The video data generating component is configured to generate first video data according to the plurality of second image data. A video generating device, characterized in that it comprises: An image data acquisition component, the image data acquisition component being used to acquire at least one piece of first image data; An analysis component, which is used to perform text analysis processing on the first image data to obtain text information contained in the first image data; A text segment acquisition component, which is used to input the text information into a search engine to acquire at least one first text segment; A matching component, the matching component is used to determine the text information of the first image data and the matching data of the first text segment; An image data generation component, the image data generation component is used to process the first image data according to the matching data to generate a plurality of second image data, wherein the second image data and the first text The matched text information has the first display effect; and The video data generating component is configured to generate first video data according to the plurality of second image data. A video generating device, characterized in that it comprises: A receiving component configured to receive at least one first image data and at least one first text segment input by a user; An analysis component, which is used to perform text analysis processing on the first image data to obtain text information contained in the first image data; A matching component, the matching component is used to determine the text information of the first image data and the matching data of the first text segment; A display component for displaying the matching data to the user, and The receiving component is further configured to receive instruction data for the matching data input by a user, wherein the instruction data includes at least instruction information for the first display effect of the matching data; The video generating device further includes: an image data generating component configured to process the first image data according to the instruction data to generate a plurality of second image data, wherein the second image The text information in the data that matches the first text segment has the first display effect; and The video data generating component is configured to generate first video data according to the second image data. An electronic device including: Processing unit; and A memory, coupled to the processing unit and containing instructions stored thereon, which when executed by the processing unit causes the device to perform actions, the actions including: Acquiring at least one first image data; Performing text analysis processing on the first image data to obtain text information contained in the first image data; Obtain at least one first text segment; Determining the matching data between the text information of the first image data and the first text segment; Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and The first video data is generated according to the plurality of second image data. A computer-readable storage medium having instructions stored on the computer-readable storage medium, the instructions including: Acquiring at least one first image data; Performing text analysis processing on the first image data to obtain text information contained in the first image data; Obtain at least one first text segment; Determining the matching data between the text information of the first image data and the first text segment; Processing the first image data according to the matching data to generate a plurality of second image data, wherein the text information in the second image data that matches the first text segment has a first display effect; and The first video data is generated according to the plurality of second image data.

Images