JP2021197563A - Related information distribution devices, programs, content distribution systems and content output terminals - Google Patents

Abstract

[Problem] To provide a related information distribution device, program, content distribution system, and content output terminal that provide information highly related to the content to be distributed. [Solution] A content distribution server (1) includes an important word acquisition unit (13) that acquires important words related to the content from the image information and audio information of the content to be transmitted to a receiving device (6) for each predetermined time range, a related information acquisition unit (15) that acquires word-related information related to the important words acquired by the important word acquisition unit (13) from an information server (4) that stores various information, and a related information transmission unit (17) that transmits the word-related information acquired by the related information acquisition unit (15) to the receiving device (6). [Selected Figure] Figure 1

Description

The present invention relates to a related information distribution device, a program, a content distribution system, and a content output terminal.

Conventionally, with the spread of SNS (Social Networking Service), the number of services in which viewers post comments in television programs is increasing. Then, the comment posted by the viewer is displayed so as to be viewable using a part of the screen, for example, while the television program is being broadcast.

As a technique for providing such a service, for example, "a video information acquisition unit that acquires video information of video content from an external device and a predetermined display device display the video of the video content according to the acquired video information. A comment acquisition unit that acquires viewers' comments on video content from the video display unit and an external posting site where comments describing the occasional impressions of the viewer's video content while viewing the video content are posted immediately. A comment display unit for displaying a comment acquired by the comment acquisition unit is provided in a predetermined comment display area in a display device displaying an image of the video content, and the comment display unit is provided with the comment acquisition unit. Disclosed is an information processing apparatus characterized in that when a comment acquired by a unit is longer than a predetermined number of characters, the display of the next comment is started during the display of the comment "(for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2016-149780

When the technique described in Patent Document 1 is used, for example, a comment with a predetermined tag is acquired from an external posting site in order to acquire a viewer's comment on the video content. Therefore, if a predetermined tag is added to a comment that is not related to the content of the video content, the comment is also acquired. In addition, the viewer had to attach a predetermined tag when posting a comment.

Therefore, an object of the present invention is to provide a related information distribution device, a program, a content distribution system, and a content output terminal that provide information highly relevant to the content to be distributed.

The present invention solves the above-mentioned problems by the following solution means.
The first invention is an important word acquisition means for acquiring important words related to the content of the content from image information and audio information of the content transmitted to a display device at predetermined time ranges, and the important word acquisition means. A related information acquisition means that acquires word-related information related to the important word from an information storage device that stores various information, and a relation that transmits the word-related information acquired by the related information acquisition means to the display device. It is a related information distribution device including an information transmission means.
The second invention is based on at least one of the speech content obtained by analyzing the voice information and the target image obtained by analyzing the image information in the related information distribution device of the first invention. The important word acquisition means includes a word extraction means for extracting a plurality of words related to the content for each predetermined time range, and an importance calculation means for calculating the importance of each word extracted by the word extraction means. , The related information distribution device that acquires the word of high importance calculated by the importance calculation means as the important word.
According to a third aspect of the invention, in the related information distribution device of the second invention, the importance calculation means determines the importance of each word extracted by the word extraction means, the frequency of appearance of each word, the utterance volume, and /. Alternatively, it is a related information distribution device that calculates based on the appearance time.
A fourth aspect of the invention is the related information distribution device of the second invention, wherein the importance calculation means extracts the word when the target image obtained by analyzing the image information indicates a person. It is a related information distribution device that calculates the importance of each word extracted by means based on the emotional information of the person when each word appears.
The fifth invention is an individual information storage unit in which individual information including a word indicating the interest of a user who browses the content is registered in any of the related information distribution devices from the second invention to the fourth invention. The importance calculation means is a related information distribution device that calculates the importance of each word extracted by the word extraction means based on the individual information stored in the individual information storage unit.
A sixth aspect of the invention is the related information distribution device according to any one of the first to fifth inventions, wherein the related information acquisition means sequentially transmits the content to the display device, and the word-related information. The related information transmission means is a related information distribution device that transmits the acquired word-related information to the display device in response to the acquisition of the word-related information by the related information acquisition means.
The seventh invention includes, in any of the related information distribution devices from the first invention to the sixth invention, a classification designation receiving means for receiving classification designations related to the various information, and the related information acquisition means is described above. It is a related information distribution device that acquires the word-related information from the information of the designated classification among the various information stored in the information storage device based on the classification designation received by the classification designation receiving means.
The eighth invention is a program for operating a computer as any related information distribution device from the first invention to the seventh invention.
A ninth aspect of the present invention is a content distribution system including any related information distribution device from the first invention to the seventh invention and the display device, wherein the display device is related to the received word. It is a content distribution system including a content display control means for sequentially displaying information in an information display area and reproducing and displaying the received content in the content display area.
A tenth aspect of the present invention is a content receiving means for receiving one of the contents designated by a user from a content server for storing a plurality of contents, and an image information and an audio information of the contents received by the content receiving means to obtain the contents. An important word acquisition means for acquiring important words related to contents at predetermined time ranges and word-related information related to the important words acquired by the important word acquisition means are acquired from an information storage device that stores various information. It is a content output terminal including a related information acquisition means and an information output means for outputting the word-related information acquired by the related information acquisition means together with the content received by the content receiving means.

According to the present invention, it is possible to provide a related information distribution device, a program, a content distribution system, and a content output terminal that provide information highly relevant to the content to be distributed.

It is a figure which shows the whole structure of the content distribution system which concerns on 1st Embodiment. It is a figure which shows the functional block of the content distribution server which concerns on 1st Embodiment. It is a flowchart which shows the content distribution processing of the content distribution server which concerns on 1st Embodiment. It is a flowchart which shows the important word acquisition process of the content distribution server which concerns on 1st Embodiment. It is a figure which shows the specific example for demonstrating the content distribution process in the content distribution server which concerns on 1st Embodiment. It is a figure which shows the specific example for demonstrating the content distribution process in the content distribution server which concerns on 1st Embodiment. It is a figure which shows the display example in the receiving device which concerns on 1st Embodiment. It is a figure which shows the whole structure of the content distribution system which concerns on 2nd Embodiment, and the functional block of a content distribution server. It is a flowchart which shows the content distribution processing of the content distribution server which concerns on 2nd Embodiment. It is a figure which shows the display example in the receiving device which concerns on 2nd Embodiment. It is a figure which shows the whole structure of the content distribution system which concerns on 3rd Embodiment, and the functional block of a content distribution server. It is a figure which shows the example of the individual information storage part of the content distribution server which concerns on 3rd Embodiment. It is a flowchart which shows the important word acquisition process of the content distribution server which concerns on 3rd Embodiment. It is a figure which shows the display example in the terminal which concerns on 3rd Embodiment.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. It should be noted that this is only an example, and the technical scope of the present invention is not limited to this.
(First Embodiment)
<Overall configuration of content distribution system 100>
FIG. 1 is a diagram showing an overall configuration of the content distribution system 100 according to the first embodiment.
In the content distribution system 100, the content distribution server 1 (related information distribution device) distributes content that is a television broadcast program to the reception device 6 (display device). Further, in the content distribution system 100, the content distribution server 1 transmits information that is highly relevant to the content of the content distributed to the receiving device 6. By doing so, the content distribution system 100 is a system in which the receiving device 6 is made to display information related to the content together with the content.
The content distribution system 100 shown in FIG. 1 includes a content distribution server 1, an information server 4 (information storage device), and a plurality of receiving devices 6, each of which is connected via a communication network N.

<Content distribution server 1>
FIG. 2 is a diagram showing a functional block of the content distribution server 1 according to the first embodiment.
As shown in FIG. 2, the content distribution server 1 includes a control unit 10, a storage unit 20, and a communication interface unit 29.
The control unit 10 is a central processing unit (CPU) that controls the entire content distribution server 1. The control unit 10 executes various functions in cooperation with the above-mentioned hardware by appropriately reading and executing the operating system (OS) stored in the storage unit 20 and various application programs.
The control unit 10 includes a word extraction unit 11 (word extraction means), an importance calculation unit 12 (importance calculation means), an important word acquisition unit 13 (important word acquisition means), and a related information acquisition unit 15 (related information). (Acquisition means), a content distribution unit 16, and a related information transmission unit 17 (related information transmission means).

The word extraction unit 11 is a control unit that extracts a plurality of words related to the content for each predetermined time range. Here, the predetermined time range means a range such as 10 seconds or 30 seconds. Further, the time ranges may overlap, such as 10 seconds from the 0th second to the 10th second and 10 seconds from the 5th second to the 15th second. The predetermined time range includes a plurality of frames constituting the content, but in the subsequent processing, the plurality of frames included in the predetermined time range may be referred to as section frames.

The word extraction unit 11 acquires words related to the content from, for example, the utterance content obtained by analyzing the voice information of the content. More specifically, the word extraction unit 11 converts, for example, the utterance content obtained by analyzing voice information into text, analyzes the text using morphological analysis, and extracts words. May be good. The word extraction unit 11 may extract words by analyzing the text using, for example, semantic analysis by natural language processing other than morphological analysis. When semantic analysis is used, important words in the topic can be extracted from the context of the sentence acquired as the utterance content.

Further, the word extraction unit 11 acquires words related to the content from, for example, the target image obtained by analyzing the image information of the content. More specifically, the word extraction unit 11 acquires an image similar to the target image by using, for example, an image storage device (not shown) that stores the correspondence between the image and its name, and the acquired image. The name associated with may be acquired as a word indicating the target image. The word extraction unit 11 may apply the target image to a learning model (not shown) learned by deep learning to acquire a word indicating the target image.

The importance calculation unit 12 is a control unit that calculates the importance of each word extracted by the word extraction unit 11. Here, the importance of a word is an index indicating whether or not the word is highly relevant to the content of the content. If a word is of high importance, it is considered to be highly relevant to the content.

The importance calculation unit 12 calculates the importance of each word based on, for example, the appearance frequency of each word obtained from the voice information of the content and the utterance volume of the voice, and the target image obtained from the image information of the content. Calculated based on the appearance time of.
Further, the importance calculation unit 12 determines the importance of each word, such as the facial expression or voice of the person when each word appears, when the target image obtained by analyzing the image information indicates a person. It may be calculated based on emotional information.

The important word acquisition unit 13 is a control unit that acquires a highly important word calculated by the importance calculation unit 12 as an important word. For example, the important word acquisition unit 13 may set a word whose importance is equal to or higher than the threshold value as an important word. Then, the important word acquisition unit 13 may acquire a plurality of important words for each predetermined time range, but may not acquire the important words when there is no word whose importance is equal to or higher than the threshold value.

The related information acquisition unit 15 is a control unit that acquires word-related information related to the important word acquired by the important word acquisition unit 13 from the information server 4 described later. Here, the word-related information refers to, for example, a message such as an explanation of an important word or a comment including the important word, but is not limited thereto.

The content distribution unit 16 is a control unit that distributes the content to be processed to the receiving device 6. The content distribution unit 16 may distribute the content to the receiving device 6 before the processing by the word extraction unit 11, and at the same time as the processing by the word extraction unit 11 or the processing by the word extraction unit 11. After that, the content may be delivered to the receiving device 6.
The related information transmission unit 17 is a control unit that transmits the word-related information acquired by the related information acquisition unit 15 to the receiving device 6.
Details of each of these functions will be described later.

The storage unit 20 is a storage device such as a hard disk and a semiconductor memory element for storing programs, data, and the like necessary for the operation of the content distribution server 1.
The storage unit 20 includes a program storage unit 21 and a content storage unit 22.
The program storage unit 21 is a storage area for storing various programs for functioning as the content distribution server 1. The program storage unit 21 stores the related information acquisition program 21a. The related information acquisition program 21a is a program for executing each function of the control unit 10 described above.

The content storage unit 22 is a storage area for storing content to be delivered to the receiving device 6. Here, the content includes a video (image) that can be displayed and an audio as needed, and means a content that changes with the passage of time. The content consists of a plurality of frames (still images). The content may be, for example, a live distribution in which a moving image taken by a camera itself is distributed and is not recorded, that is, a content used as a so-called live broadcast, a movie or a drama produced and stored in advance, or the like. The content to be delivered live is stored in the content storage unit 22 after shooting.

The communication interface unit 29 is an interface for communicating with the information server 4 and the receiving device 6.

<Information server 4>
The information server 4 shown in FIG. 1 is a server having an information DB 41 (database) that stores various types of information. The information DB 41 of the information server 4 stores various types of information as character information. The character information may be associated with a URL (Uniform Resource Locator).
The information server 4 is not limited to one server, and may be composed of a plurality of servers. In addition to the information DB 41, the information server 4 includes a control unit, a storage unit, a communication interface unit, and the like, although not shown.

<Receiver 6>
The receiving device 6 includes means for receiving content and word-related information, content display control means for reproducing and displaying the content and word-related information on a display 61 (display screen), and means for outputting the content by voice. For example, it is a terminal such as a television. The receiving device 6 may also be configured by, for example, a personal computer (PC), a tablet terminal, or the like. In addition to the display 61, the receiving device 6 includes a control unit, a storage unit, a communication interface unit, an audio output unit such as a speaker, and an operation unit such as a remote controller, although not shown.

The computer is an information processing device provided with a control unit, a storage device, and the like, and the content distribution server 1, the information server 4, and the receiving device 6 are both information processing devices provided with a control unit, a storage device, and the like. , Included in the computer concept.
The communication network N is a network between the content distribution server 1, the information server 4, and the receiving device 6, and is a communication network such as an Internet line.

<Explanation of processing>
Next, the processing of the content distribution system 100 will be specifically described.
FIG. 3 is a flowchart showing the content distribution process of the content distribution server 1 according to the first embodiment.
FIG. 4 is a flowchart showing an important word acquisition process of the content distribution server 1 according to the first embodiment.
As a premise of this processing, the content distribution server 1 unilaterally distributes data including content from the content distribution server 1 to the receiving device 6 as in the distribution of a television broadcast program.

In step S (hereinafter, simply referred to as “S”) 11 in FIG. 3, the control unit 10 (content distribution unit 16) distributes the content to the receiving device 6. Here, the control unit 10 shall deliver the content live. When distributing the content stored in the content storage unit 22 in advance, the control unit 10 extracts and distributes the corresponding content from the content storage unit 22.
In S12, the control unit 10 acquires a section frame composed of a plurality of frames constituting the content in a predetermined time range to be transmitted to the receiving device 6 from the content.
In S13, the control unit 10 performs important word acquisition processing.

Here, the important word acquisition process will be described with reference to FIG.
In S21 of FIG. 4, the control unit 10 (word extraction unit 11) analyzes the voice information included in the acquired section frame and acquires the utterance content. Then, the control unit 10 extracts a word from the acquired utterance content. The control unit 10 may use any method as a method of extracting a word after converting the utterance content into a text, and may use, for example, the above-mentioned morphological analysis or semantic analysis.
In S22, the control unit 10 (word extraction unit 11) analyzes the image information included in the acquired section frame to acquire the target image. Then, the control unit 10 acquires a word indicating the target image. At that time, the control unit 10 may analyze the image information for all the frames included in the section frame, but in order to improve the processing efficiency, for example, a part of the frames which are thinned out at predetermined intervals. You may go about.

In S23, the control unit 10 (importance calculation unit 12) calculates the importance of each word acquired in the processes of S21 and S22.
When each word is extracted from the utterance content, the importance of each word is calculated based on, for example, the frequency of appearance of the word and the utterance volume which is the volume at which the word is uttered. When a word appears a plurality of times or the utterance volume of the word is loud, the control unit 10 calculates the importance high.
Further, the importance of each word is calculated based on, for example, the appearance time of the target image when each word is acquired from the image information. The control unit 10 calculates the importance of the target image in proportion to the length of the appearance time of the target image.
Further, when the word obtained from the utterance content and the word indicating the target image match, the control unit 10 may calculate the importance of the word to be high.

In S24, the control unit 10 (important word acquisition unit 13) acquires a word whose importance is equal to or higher than a predetermined threshold value as an important word based on the importance calculated in the process of S23. After that, the control unit 10 shifts the processing to S14 in FIG.

In S14 of FIG. 3, the control unit 10 (related information acquisition unit 15) transmits the acquired important word as a keyword to the information server 4, and acquires word-related information related to the important word from the information server 4.
In S15, the control unit 10 (related information transmission unit 17) sets the acquired word-related information in a predetermined format and transmits the acquired word-related information to the receiving device 6.
By doing so, the control unit (content display control means) of the receiving device 6 receives the word-related information and outputs the word-related information to the display 61 together with the content.

In S16, the control unit 10 determines whether or not to end the reproduction of the content by acquiring, for example, that the content has been terminated or the receiving device 6 has performed an operation to terminate the reproduction of the content. do. When the reproduction of the content is terminated (S16: YES), the control unit 10 terminates this process. When the playback of the content is not finished (S16: NO), the control unit 10 shifts the processing to S11 and acquires a section frame constituting the content in a predetermined time range following the time range used in the immediately preceding processing. Then, the subsequent processing is repeated.

<Specific example>
Next, a specific example will be described.
5 and 6 are diagrams showing specific examples for explaining the content distribution process in the content distribution server 1 according to the first embodiment.
FIG. 7 is a diagram showing a display example in the receiving device 6 according to the first embodiment.
FIG. 5 shows a frame of a content 70. The content 70 shown in this example is an information program that provides various information to the viewer, and three persons from the person A to the person C appear.
FIG. 6 shows an acquisition information table 75 regarding various information acquired from the section frame of the content 70 including the frame shown in FIG. 5, and important word information 77 obtained from the acquisition information table 75.

According to the acquisition information table 75 of FIGS. 5 and 6, in the section frame with the content 70 (including the frame having the time stamp of 00:12:33), the person C in FIG. 5 explains the “tapioca” and the person. Shows a situation where A is surprised. Further, in the next section frame (including the frame whose time stamp is 00:12:45), the image of the person A is up, and the situation where "tapioca" is explained is shown.
In the acquisition information table 75 of FIG. 6, the time indicated by the time stamp, the image information, the voice information, and the utterance content are associated with each other.
The image information includes a target image from person A to person C obtained by analyzing the image information in the section frame, and a facial expression (emotion information) obtained from the target image when the target image is a person. include.
The voice information includes the utterance volume obtained from the voice information and the voice color (emotion information).
The utterance content includes the utterance content obtained from the voice information.

The important word information 77 shown in FIG. 6 includes each word acquired from the acquisition information table 75 by the processing of S21 and S22 of FIG. 4, and a score indicating the importance of each word calculated by the processing of S23 of FIG. .. That is, the important word information 77 shown in FIG. 6 shows each word based on the utterance content and its score. Further, the important word information 77 indicates a word which is a name (for example, tapioca) of a target image obtained from the image information and a score thereof. When at least one of the persons A to C shown in FIG. 5 is a talent or the like, the important word information 77 includes the talent name as an important word.

Each important word score of the important word information 77 shown in FIG. 6 is calculated by multiplying, for example, the frequency of appearance of the word included in a predetermined time range, the ratio of the average surprised facial expression, and the ratio of the average surprised voice. It was done. According to this method of calculating the important word score, the important word score is the score of the word (including the one obtained from the utterance content and the target image) when the facial expression of the person changes, and the change of the facial expression is used. It is calculated accordingly. Then, the method of calculating the important word score may be partially changed so that the important word score is increased, for example, when the person changes to a smile. Further, the important word score may be such that the score of the word included in the lively conversation is increased in the case of a conversation by a plurality of people. In a lively conversation, multiple people are uttering, the volume of voice is loud, and the number of occurrences of important words tends to increase. Therefore, the important word score of the word satisfying such a condition may be increased.

After that, the control unit 10 of the content distribution server 1 acquires a word having a score equal to or higher than the threshold value as an important word by the process of S24 in FIG. Here, the threshold value may be a predetermined numerical value or may be the one with the highest score among the acquired important word scores. Then, the control unit 10 of the content distribution server 1 acquires the word-related information from the information server 4 by transmitting the important word as a keyword to the information server 4, and transmits the word-related information to the receiving device 6 (S14 in FIG. 3). And S15).

FIG. 7 shows an example of the content displayed in the content display area 80 of the display 61 of the receiving device 6 and the word-related information 81 and 82 displayed in the information display area.
The word-related information 81 and 82 are obtained from the information server 4 with the important word "tapioca" as a keyword.
As described above, the content distribution server 1 transmits the word-related information 81 and 82 related to the content of the content together with the content to the receiving device 6, and the receiving device 6 transmits the content and the word-related information 81 and 82. And output. Therefore, the user can see the information related to the content while enjoying the content, and may be able to provide useful information to the user.

In the case of live broadcasting in which the content acquired by shooting with a camera is distributed as it is, the content distribution server 1 transmits the word-related information after the process of acquiring the information related to the content of the content. Therefore, the transmission of word-related information is slightly delayed from the distribution of the content, and there is a slight time lag between the two displays. However, the content distribution server 1 can display information related to the content of the content on the display 61 within a short time after the content at the position is distributed.

After displaying the word-related information 81 and 82 in the information display area, the receiving device 6 may hide the word-related information 81 and 82 when a predetermined timing elapses. Further, when the receiving device 6 receives the next word-related information after displaying the word-related information 81 and 82, the information display area may be changed from the word-related information 81 and 82 to the next word-related information.
In the example of FIG. 7, the information display area is on the lower side of the screen, but it may be at a different position. Further, the receiving device 6 may scroll the word-related information itself from the bottom to the top or from the left to the right in the information display area.

As described above, according to the first embodiment, the content distribution system 100 has the following effects.
(1) The content distribution server 1 transmits the content and word-related information related to the content to the receiving device 6. Therefore, the receiving device 6 can display word-related information that is highly relevant to the content together with the content.
(2) The content distribution server 1 acquires important words related to the content from the audio information and image information of the content, and acquires word-related information related to the acquired important words from the information server 4 and receives the receiving device 6. Send to. Therefore, the word-related information can be information that is highly relevant to the content.

(3) The content distribution server 1 uses words related to the content at predetermined time ranges based on at least one of the utterance content obtained by analyzing the voice information and the target image obtained by analyzing the image information. Multiple extractions are made, the importance of each extracted word is calculated, and the words with high importance are acquired as important words. Therefore, the important word can be a word having a high degree of importance among the words related to the content, and the word related to the content can be acquired.
(4) The content distribution server 1 determines the importance of each word based on the appearance frequency and utterance volume of the word in the utterance obtained from the voice information, and the appearance time of the target image corresponding to the word obtained from the image information. To calculate. Therefore, it is possible to increase the importance of words that are frequently spoken, words that are included in loud speech, and words that indicate a target image with a long display.

(5) The content distribution server 1 repeats the process of acquiring important words from the section frame of the content, acquiring the word-related information, and transmitting the information to the receiving device 6 while the content is being output. Therefore, new information related to the content can always be transmitted to the receiving device 6.

(Second Embodiment)
The second embodiment will be described by using an operation by the operation unit of the receiving device as an example. In the following description, the same reference numerals or the same reference numerals will be added to the portions that perform the same functions as those of the first embodiment described above, and duplicate description will be omitted as appropriate.
FIG. 8 is a diagram showing the overall configuration of the content distribution system 200 and the functional blocks of the content distribution server 201 according to the second embodiment.
The content distribution system 200 includes a content distribution server 201, an information server 4, and a plurality of receiving devices 6.

<Content distribution server 201>
The content distribution server 201 includes a control unit 210, a storage unit 220, and a communication interface unit 29.
The control unit 210 includes a word extraction unit 11, an importance calculation unit 12, an important word acquisition unit 13, a classification designation reception unit 214 (classification designation reception means), a related information acquisition unit 215, and a content distribution unit 16. , A related information transmission unit 17.

The classification designation reception unit 214 receives classification designations related to various types of information. The classification designation refers to those that specify the acquisition destination of various information such as SNS and articles on the Internet (hereinafter, also referred to as net articles).
The related information acquisition unit 215 acquires word-related information from the designated classification information stored in the information server 4 based on the classification designation received by the classification designation reception unit 214.
For example, when SNS is specified in the classification designation, the related information acquisition unit 215 acquires a message such as a posted comment including important words as word-related information. In this case, the related information acquisition unit 215 acquires the message based on the hash tag (tag information) in which the symbol "#" is added to the tag, which is used as an identifier in the SNS.
Further, for example, when a net article is specified in the classification designation, the related information acquisition unit 215 describes the article on the Internet including important words, excluding messages such as comments, as word-related information. Get as. In this case, the related information acquisition unit 215 acquires the article except for the hashtag.

The storage unit 220 includes a program storage unit 221 and a content storage unit 22.
The program storage unit 221 stores the related information acquisition program 221a, which is a program for executing each function of the control unit 210 described above.

<Explanation of processing>
Next, the processing of the content distribution system 200 will be described.
FIG. 9 is a flowchart showing the content distribution process of the content distribution server 201 according to the second embodiment.
FIG. 10 is a diagram showing a display example in the receiving device 6 according to the second embodiment.
The processes from S211 to S213 in FIG. 9 are the same as the processes from S11 to S13 in the first embodiment (FIG. 3).
In S214, the control unit 210 transmits the important word display screen (information display area) including the acquired important word to the receiving device 6.
By doing so, the control unit of the receiving device 6 receives the important word display screen and outputs it to the display 61.

FIG. 10 is an output example on the display 61 in which the important word display screen 292 is displayed together with the content 270 displayed in the content display area.
The important word display screen 292 includes an important word area 293 and search buttons 294a and 294b. The important word area 293 outputs the important words acquired in the process of S213 in FIG. 9 in order downward, and the search buttons 294a and 294b are arranged side by side to the right of each important word. .. The search button 294a targets online articles excluding SNS, and the search button 294b targets only SNS information.
The search buttons 294a and 294b are provided separately in order to meet the needs of both a user who wants to extract a message such as a tweet and a user who wants to extract ordinary information other than a tweet.
When the user selects the search button 294a or 294b by operating Eba Tao and the remote controller, the control unit of the receiving device 6 transmits a signal corresponding to the selection operation to the content distribution server 201.

In S215 of FIG. 9, the control unit 210 (classification designation reception unit 214) determines whether or not the selection operation corresponding to the classification designation has been accepted. When the selection operation corresponding to the classification designation is accepted (S215: YES), the control unit 210 shifts the processing to S216. On the other hand, when the selection operation for the classification designation is not accepted (S215: NO), the control unit 210 shifts the processing to S217. If the selection operation is not accepted by a predetermined time (for example, the same time as the time range of the section frame) after the processing of S214, the control unit 210 assumes that the selection operation for the classification designation is not accepted. The processing may be transferred to S218, and until then, the control unit 210 may be limited to the processing of S215.

In S216, the control unit 210 (related information acquisition unit 215) transmits the classification designation and the important word corresponding to the selection operation to the information server 4, and the information server 4 transmits the word-related information based on the classification designation related to the important word. get.
The processing of S217 and S218 is the same as the processing of S15 and S16 of the first embodiment (FIG. 3).

As described above, according to the second embodiment, the content distribution system 200 has the following effects.
The content distribution server 201 transmits the important word display screen 292 including the important word and the classification designation to the receiving device 6, and accepts the classification designation selected by the user. Then, the content distribution server 201 acquires word-related information related to important words from the information server 4 based on the information of the classification corresponding to the received classification designation, and transmits the word-related information to the receiving device 6.
Therefore, since the word-related information is acquired from the information of the classification specified by the user, it is possible to provide the information that meets the needs of the user.

(Third Embodiment)
The second embodiment is a case where the content is distributed to a terminal such as a tablet by, for example, moving image distribution using a streaming technology such as YouTube (registered trademark). Further, an example will be described in which the user's interests are registered in advance or appropriately so that the user's interests are prioritized and the word-related information is output.
FIG. 11 is a diagram showing the overall configuration of the content distribution system 300 and the functional blocks of the content distribution server 301 according to the third embodiment.
FIG. 12 is a diagram showing an example of the individual information storage unit 323 of the content distribution server 301 according to the third embodiment.
The content distribution system 300 shown in FIG. 11 includes a content distribution server 301, an information server 4, and a terminal 306 (display device).

<Content distribution server 301>
The content distribution server 301 includes a control unit 310, a storage unit 320, and a communication interface unit 29.
The control unit 310 includes a word extraction unit 11, an importance calculation unit 312, an important word acquisition unit 13, a related information acquisition unit 15, a content distribution unit 16, and a related information transmission unit 17.

The importance calculation unit 312 is a control unit that calculates the importance of each word extracted by the word extraction unit 11. The importance calculation unit 312 calculates the importance of each word based on the individual information including the words indicating the interests of each user stored in the individual information storage unit 323 described later. As an example, the importance calculation unit 312 calculates the importance high if the word for which the importance is calculated matches the word of interest, which is a word indicating interest, and conversely, for the interest. If there is no word that matches the excluded word that you do not want to put out, the importance is calculated low. The importance calculation unit 312 may calculate the importance even if the words for which the importance is calculated do not match the words of interest but are similar to each other.

The storage unit 320 includes a program storage unit 321, a content storage unit 22, and an individual information storage unit 323.
The program storage unit 321 stores the related information acquisition program 321a, which is a program for executing each function of the control unit 310 described above.

The individual information storage unit 323 is a storage area for storing individual information indicating the interests of each user. The individual information storage unit 323 shown in FIG. 12 stores, for example, an interest word and, if necessary, an exclusion word in association with a terminal ID (IDentification) that identifies the terminal 306. The words of interest are, for example, words indicating the user's hobbies, names of favorite talents, words indicating favorite foods and sports, and the like. Excluded words are, for example, the names of disliked talents, words indicating foods disliked by users, and the like.
In the example shown in FIG. 12, when the terminal ID is "r0123", a favorite food such as "fish dish" or a place name such as "Ueno" is registered as an exclusion word in the individual information storage unit 323. Disliked foods such as "okonomiyaki" are registered.
The individual information to be stored in the individual information storage unit 323 may be acquired from each user in advance and stored. Further, while using the content distribution system 300, the individual information stored in the individual information storage unit 323 may be added and updated at any time.

<Terminal 306>
The terminal 306 is, for example, a tablet, which is a means for receiving content and word-related information, a content display control means for reproducing and displaying the content and word-related information on the touch panel display 361 (display screen), and audio output of the content. Provide means to do so. The terminal 306 may be another, for example, a PC, a smartphone, or the like. In addition to the touch panel display 361, the terminal 306 includes a control unit, a storage unit, a communication interface unit, an audio output unit such as a speaker, and the like, although not shown.
The computer is an information processing device provided with a control unit, a storage device, and the like, and the terminal 306 is an information processing device provided with a control unit, a storage unit, and the like, and is included in the concept of a computer.

<Explanation of processing>
Next, the processing of the content distribution system 300 will be described.
FIG. 13 is a flowchart showing an important word acquisition process of the content distribution server 301 according to the third embodiment.
Here, the content distribution process of the content distribution server 301 according to the third embodiment is the same as that of the first embodiment (FIG. 3). However, at the start of processing of the content distribution server 301, the control unit of the terminal 306 transmits a content distribution request specifying the content to the content distribution server 301 together with the terminal ID. By doing so, in the process corresponding to S11 in FIG. 3, the control unit 310 (content distribution unit 16) of the content distribution server 301 distributes the designated content to the terminal 306.

Next, the process corresponding to S13 in FIG. 3 will be described with reference to FIG.
S321 and S322 of FIG. 13 are the same as the processes of S21 and S22 of the first embodiment (FIG. 4).
In S323, the control unit 310 (importance calculation unit 312) calculates the importance of each word acquired in the processes of S321 and S322 by using the individual information of the individual information storage unit 323. If the word for which the importance is calculated matches the word of interest of the individual information storage unit 323, the control unit 310 calculates so as to increase the importance. Further, if the word for which the importance is calculated matches the excluded word of the individual information storage unit 323, the control unit 310 calculates so that the importance is low.
The process of S324 is the same as the process of S24 of the first embodiment (FIG. 4).

<Specific example>
FIG. 14 is a diagram showing a display example on the terminal 306 according to the third embodiment.
FIG. 14 shows a distribution screen 330 having a content display area 331 and an information display area 332. The content display area 331 displays the content specified by the user. The content shown in this example is content in which the characters transmit information by posting their own videos. In the example shown in FIG. 14, the frame 331a having the content specified by the user is displayed.
In addition, the information display area 332 displays information related to the content specified by the user. Word-related information 333a to 333d are output to the information display area 332.

The control unit 310 (word extraction unit 11) extracts a plurality of words from the audio information and the image information in the section frame including the frame 331a (see S321 and S322 in FIG. 13).
Then, the control unit 310 (importance calculation unit 312, important word acquisition unit 13) refers to the individual information storage unit 323, calculates the importance of each word, and acquires the important word (S323 in FIG. 13 and the important word acquisition unit 13). See S324).
As an example, the control unit 310 (importance calculation unit 312) calculates the importance of each word based on the appearance frequency and utterance volume of each word and the appearance time of the target image. When a predetermined time range includes an image of a man and a fish such as frame 331a, the control unit 310 highly calculates the name of the man (when the man is a talent) and the importance of the fish as the target image. ..
Further, when the terminal ID of the terminal 306 is "r0123", "Ueno" is registered as a word of interest.
Therefore, the control unit 310 (related information acquisition unit 15) acquires word-related information including "sea bream" and "Ueno" like the word-related information 333b.

As described above, according to the third embodiment, the content distribution system 300 has the following effects.
By registering the words of interest to the user as individual information, the content distribution server 301 increases the importance of the registered individual information and extracts the important words. Therefore, the content distribution server 301 will transmit the information including the individual information to the terminal 306 as the information about the content. As a result, the word-related information displayed on the terminal 306 can be likely to include information of interest to the user.
By assigning a URL to the word-related information, even deeper information can be obtained if the information is of interest to the user himself / herself.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments. Moreover, the effects described in the embodiments are merely a list of the most suitable effects resulting from the present invention, and the effects according to the present invention are not limited to those described in the embodiments. The above-described embodiment and the modified form described later can be used in combination as appropriate, but detailed description thereof will be omitted.

(Deformed form)
(1) In the first embodiment and the second embodiment, the distribution of the content not stored in the content storage unit has been described, but the content stored in the content storage unit can also be performed by the same processing. For the content stored in the content storage unit, the important word acquisition process may be performed in advance, and the important word information may be stored in the storage unit. Then, each time the content is delivered to the receiving device, the word-related information related to the important word may be acquired.
By doing so, the processing load on the content distribution server can be reduced. In addition, when acquiring word-related information, the latest information can always be acquired from the information server, and fresh information can be provided.

(2) The method of outputting word-related information in each embodiment has been described by showing an example, but the above example is an example. For example, the display / non-display of word-related information may be switched by a user operation. Further, the output position is also arbitrary, and it may be displayed on the content or a screen different from the content may be prepared. Further, the output method is also arbitrary, and depending on the passage of time, new word-related information may be switched to at predetermined time intervals, or may be output so as to flow like a telop. Further, the word-related information may be output in chronological order with the scroll bar, and the user may operate the scroll bar so that the word-related information can be confirmed later.

(3) In each embodiment, the one that outputs the word-related information as it is has been described as an example, but the present invention is not limited to this. As in the third embodiment, the URL specifying the page of the word-related information is linked to the heading of the page, and the user selects the link to display the page of the word-related information specified by the URL. You may try to open it.

(4) In each embodiment, the predetermined time range has been described as a predetermined time range, but the present invention is not limited to this. It may be any time range instead of a predetermined time range. For example, the end of a conversation or the change of a scene may be automatically detected, and the detected part may be divided into a time range. By doing so, the range in which the word extraction unit extracts words can be set as the range of conversation.

(5) In each embodiment, the case where the word-related information is acquired by the content distribution server and transmitted to the receiving device (or terminal) has been described as an example, but the present invention is not limited to this. The terminal (content output terminal) acquires the content receiving means for receiving the content, the important word acquiring means for acquiring the important words related to the content from the image information and the voice information of the received content at predetermined time ranges, and the acquisition. It may be provided with a related information acquisition means for acquiring word-related information related to the important word, and an information output means for outputting the acquired word-related information together with the content received by the content receiving means.

(6) In the second embodiment, an example is described in which a user is allowed to select an SNS and an online article, but the present invention is not limited to this. Since there are various types of SNS, it may be further subdivided for each type. Further, a plurality of classifications may be selectable by the user, such as the ON / OFF button.

(7) In the third embodiment, an example of storing an interest word or an excluded word in the individual information storage unit has been described. Then, the words of interest and the excluded words are registered in advance and / or are registered at an appropriate timing, but the present invention is not limited to this. The terminal has a function of acquiring location information, and for example, the acquired location information of the terminal may be transmitted to the content distribution server at the time of a content distribution request. Then, a word related to the area specified from the location information may be included as a word of interest. By doing so, it is possible to output word-related information regarding the position of the terminal, and there is a possibility that information of interest to the user can be provided.

(8) In the third embodiment, the method of calculating the importance using the individual information storage unit at the time of acquiring an important word has been described as an example, but the present invention is not limited to this. When acquiring the related information, the word-related information including the important word and the interest word stored in the individual information storage unit may be acquired.
(9) In the third embodiment, the case where the terminal is specified by using the terminal ID has been described as an example, but the present invention is not limited to this. For example, a user ID that identifies the user may be used. In that case, the individual information storage unit may also store the individual information using the user ID as key information. Further, the terminal ID and the user ID may be used together.

1,201,301 Content distribution server 4 Information server 6 Receiver 10,210,310 Control unit 11 Word extraction unit 12,312 Importance calculation unit 13 Important word acquisition unit 15,215 Related information acquisition unit 16 Content distribution unit 17 Related Information transmission unit 20, 220, 320 Storage unit 21a, 221a, 321a Related information acquisition program 22 Content storage unit 41 Information DB
61 Display 81,82,333a to 333d Word-related information 100,200,300 Content distribution system 214 Classification designation reception unit 292 Important word display screen 306 Terminal 323 Individual information storage unit 332 Information display area 361 Touch panel display N Communication network

Claims (10)

An important word acquisition means for acquiring important words related to the content of the content from image information and audio information of the content transmitted to the display device at predetermined time ranges, and
A related information acquisition means for acquiring word-related information related to the important word acquired by the important word acquisition means from an information storage device storing various information, and a related information acquisition means.
A related information transmitting means for transmitting the word-related information acquired by the related information acquiring means to the display device, and a related information transmitting means.
Related information distribution device. In the related information distribution device according to claim 1,
Word extraction that extracts a plurality of words related to the content in each predetermined time range based on at least one of the utterance content obtained by analyzing the voice information and the target image obtained by analyzing the image information. Means and
An importance calculation means for calculating the importance of each word extracted by the word extraction means, and
Equipped with
The important word acquisition means is a related information distribution device that acquires the highly important word calculated by the importance calculation means as the important word. In the related information distribution device according to claim 2,
The importance calculation means is a related information distribution device that calculates the importance of each word extracted by the word extraction means based on the appearance frequency and utterance volume of each word, and / or the appearance time. In the related information distribution device according to claim 2,
In the importance calculation means, when the target image obtained by analyzing the image information indicates a person, each word appears with the importance of each word extracted by the word extraction means. A related information distribution device that calculates based on the emotional information of the person at the time.
In the related information distribution device according to any one of claims 2 to 4.
It is equipped with an individual information storage unit that registers individual information including words indicating the interests of users who browse the contents.
The importance calculation means is a related information distribution device that calculates the importance of each word extracted by the word extraction means based on the individual information stored in the individual information storage unit. In the related information distribution device according to any one of claims 1 to 5.
The related information acquisition means acquires the word-related information when sequentially transmitting the content to the display device.
The related information transmission means is a related information distribution device that transmits the acquired word-related information to the display device in response to the acquisition of the word-related information by the related information acquisition means. In the related information distribution device according to any one of claims 1 to 6.
It is equipped with a classification designation reception means that accepts classification designations related to the various types of information.
The related information acquisition means acquires the word-related information from the information of the designated classification among the various information stored in the information storage device based on the classification designation received by the classification designation receiving means. , Related information distribution device. A program for operating a computer as the related information distribution device according to any one of claims 1 to 7. The related information distribution device according to any one of claims 1 to 7.
With the display device
Is a content distribution system that includes
The display device is a content distribution system including a content display control means for sequentially displaying received word-related information in an information display area and reproducing and displaying the received content in the content display area. A content receiving means for receiving one of the contents specified by the user from a content server that stores a plurality of contents, and a content receiving means.
An important word acquisition means for acquiring important words related to the content of the content from the image information and audio information of the content received by the content receiving means at predetermined time ranges.
A related information acquisition means for acquiring word-related information related to the important word acquired by the important word acquisition means from an information storage device storing various information, and a related information acquisition means.
An information output means that outputs the word-related information acquired by the related information acquisition means together with the content received by the content receiving means, and an information output means.
Content output terminal with.

Images