CN106792170A - Method for processing video frequency and device - Google Patents
Method for processing video frequency and device Download PDFInfo
- Publication number
- CN106792170A CN106792170A CN201611152708.4A CN201611152708A CN106792170A CN 106792170 A CN106792170 A CN 106792170A CN 201611152708 A CN201611152708 A CN 201611152708A CN 106792170 A CN106792170 A CN 106792170A
- Authority
- CN
- China
- Prior art keywords
- video
- user
- statistics
- mood
- time period
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26258—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4667—Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4668—Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for programme selection
- H04N21/4826—End-user interface for programme selection using recommendation lists, e.g. of programmes or channels sorted out according to their score
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This disclosure relates to method for processing video frequency and device, the method includes：During video is played, the face-image of the user of the collection viewing video；When according to the facial image detection for collecting to user's expression shape change, identifying user mood simultaneously determines the video playback time point corresponding with the user emotion；The user emotion and video playback time point are uploaded onto the server, the user emotion is used to determine the mood label for the video.By detecting user's expression shape change identifying user mood and the user emotion and corresponding video playback time point uploading onto the server, method for processing video frequency and device according to the disclosure can make the server carry out statistical analysis according to the user emotion for receiving and corresponding video playback time point, for video adds mood label in order to searching for and recommending, the demand of user is better met.
Description
Technical field
This disclosure relates to field of computer technology, more particularly to a kind of method for processing video frequency and device.
Background technology
With the popularization of terminal and developing rapidly for network, viewing video increasingly facilitates.Present user is in viewing video
When, which video may only be watched in selection by the quality of the method marking video such as thumb up, comment and expression mood, user
When, can only also be selected by others' marking and comment.Video playback and interactive too single, the user for perceiving of user
Information very little, causes user quickly to find required video, and video provider also cannot exactly according to the demand of user
Recommend video.
The content of the invention
In view of this, the present disclosure proposes a kind of method for processing video frequency, including：During video is played, collection viewing
The face-image of the user of the video；When according to the facial image detection for collecting to user's expression shape change, identification
User emotion simultaneously determines the video playback time point corresponding with the user emotion；The user emotion and the video are broadcast
Putting time point uploads onto the server, and the user emotion is used to determine the mood label for the video.
According to the one side of the disclosure, there is provided a kind of method for processing video frequency, including：Receive and store the use of terminal transmission
Family mood and the corresponding video playback time point of the user emotion；To the user emotion and its corresponding video playback time
Point carries out statistics and obtains statistics；Mood label corresponding with the video is determined according to the statistics.
According to another aspect of the present disclosure, there is provided a kind of video process apparatus, including：Acquisition module, for playing
During video, the face-image of the user of the collection viewing video；Identification module, for according to the face for collecting
When portion's image detection is to user's expression shape change, identifying user mood and when determining corresponding with user emotion video playback
Between point；Uploading module, for the user emotion and video playback time point to be uploaded onto the server, the user emotion
For determining the mood label for the video.
According to another aspect of the present disclosure, there is provided a kind of video process apparatus, including：Receiver module, for receiving simultaneously
User emotion and the corresponding video playback time point of the user emotion that storage terminal sends；Statistical module, for described
User emotion and its corresponding video playback time point carry out statistics and obtain statistics；Mood label determining module, for root
Determine mood label corresponding with the video according to the statistics.
According to another aspect of the present disclosure, there is provided a kind of video process apparatus, including：Processor；For storage treatment
The memory of device executable instruction；Wherein, the processor is configured as：During video is played, regarded described in collection viewing
The face-image of the user of frequency；When according to the facial image detection for collecting to user's expression shape change, identifying user feelings
Thread simultaneously determines the video playback time point corresponding with the user emotion；By the user emotion and the video playback time
Point uploads onto the server, and the user emotion is used to determine the mood label for the video.
According to another aspect of the present disclosure, there is provided a kind of video process apparatus, including：Processor；For storage treatment
The memory of device executable instruction；Wherein, the processor is configured as：Receive and store user emotion and the institute of terminal transmission
State the corresponding video playback time point of user emotion；The user emotion and its corresponding video playback time point are counted
Obtain statistics；Mood label corresponding with the video is determined according to the statistics.
According to another aspect of the present disclosure, there is provided a kind of non-volatile computer readable storage medium storing program for executing, when the storage
Instruction in medium by terminal computing device when so that terminal is able to carry out a kind of method for processing video frequency, methods described bag
Include：During video is played, the face-image of the user of the collection viewing video；According to the face figure for collecting
As when detecting user's expression shape change, identifying user mood simultaneously determines the video playback time corresponding with the user emotion
Point；The user emotion and video playback time point are uploaded onto the server, the user emotion is used to determine to be directed to institute
State the mood label of video.
According to another aspect of the present disclosure, there is provided a kind of non-volatile computer readable storage medium storing program for executing, when the storage
Instruction in medium by server computing device when so that server is able to carry out a kind of method for processing video frequency, the side
Method includes：Receive and store the user emotion and the corresponding video playback time point of the user emotion of terminal transmission；To described
User emotion and its corresponding video playback time point carry out statistics and obtain statistics；Determined according to the statistics and institute
State the corresponding mood label of video.
By detecting user's expression shape change identifying user mood and by the user emotion and corresponding video playback
Time point uploads onto the server, and the method for processing video frequency and device according to disclosure above-described embodiment can make server according to connecing
The user emotion and corresponding video playback time point for receiving carry out statistical analysis, are that video adds mood label in order to search for
And recommendation, better meet the demand of user.
According to below with reference to the accompanying drawings to detailed description of illustrative embodiments, the further feature and aspect of the disclosure will become
It is clear.
Brief description of the drawings
Comprising in the description and accompanying drawing and the specification of the part that constitutes specification together illustrates the disclosure
Exemplary embodiment, feature and aspect, and for explaining the principle of the disclosure.
Fig. 1 shows the flow chart of the method for processing video frequency according to the embodiment of the disclosure one.
Fig. 2 shows the schematic diagram of the method for processing video frequency according to the embodiment of the disclosure one.
Fig. 3 shows the flow chart of the S12 methods according to the step of one embodiment of the disclosure.
Fig. 4 shows the flow chart of the method for processing video frequency according to the embodiment of the disclosure one.
Fig. 5 shows the schematic diagram of the method for processing video frequency according to the embodiment of the disclosure one.
Fig. 6 shows the flow chart of the S22 methods according to the step of one embodiment of the disclosure.
Fig. 7 shows the schematic diagram of the method for processing video frequency according to the embodiment of the disclosure one.
Fig. 8 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Fig. 9 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Figure 10 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Figure 11 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Figure 12 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Figure 13 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Figure 14 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Figure 15 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Figure 16 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one.
Specific embodiment
Describe various exemplary embodiments, feature and the aspect of the disclosure in detail below with reference to accompanying drawing.It is identical in accompanying drawing
Reference represent the same or analogous element of function.Although the various aspects of embodiment are shown in the drawings, remove
Non-specifically is pointed out, it is not necessary to accompanying drawing drawn to scale.
Special word " exemplary " means " being used as example, embodiment or illustrative " herein.Here as " exemplary "
Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, in order to better illustrate the disclosure, numerous details are given in specific embodiment below.
It will be appreciated by those skilled in the art that without some details, the disclosure can equally be implemented.In some instances, for
Method well known to those skilled in the art, means, element and circuit are not described in detail, in order to highlight the purport of the disclosure.
Embodiment 1
Fig. 1 shows the flow chart of the method for processing video frequency according to the embodiment of the disclosure one, and the method can be used for terminal, example
Such as, mobile phone, computer, panel computer etc..Fig. 2 shows the schematic diagram of the method for processing video frequency according to the embodiment of the disclosure one.
As shown in figure 1, the method includes：
Step S11, during video is played, the face-image of the user of the collection viewing video.
In a kind of possible implementation method, as shown in Fig. 2 can be using the face of the user of camera collection viewing video
Portion's image, for example, when user watches video with terminals such as mobile phone, panel computer or notebooks, terminal can control preposition
Camera is opened, real-time or timing acquiring image, and therefrom obtains the face-image of user.May be included in the image for collecting
One or more face-images, can respectively carry out follow-up treatment for each face-image.The acquisition of face-image can be used
The technology such as the identification of any proper technology in correlation technique, such as area of skin color or human face region identification, the disclosure is not made to this
Limitation.
Step S12, when according to the facial image detection for collecting to user's expression shape change, identifying user mood is simultaneously
It is determined that the video playback time point corresponding with the user emotion.
In a kind of possible implementation method, can by the face-image that will currently collect with it is (such as previous before
Acquisition time) collection face-image be compared to detect user expression shape change, for example, can be demarcated on face-image
The characteristic point (such as in positions such as eye, mouth, apple fleshes) of expression is represented, if the spy on the current face-image for collecting
The difference levied between the characteristic point position a little and on the face-image that collects of previous acquisition time exceedes threshold value, then can be considered
Detect expression shape change.
In alternatively possible implementation method, the corresponding expression of face-image for collecting every time is also can recognize that (for example
Matched etc. with the expression template for prestoring by by face-image), thus detect expression shape change.The disclosure is to basis
The concrete mode of the facial image detection user's expression shape change for collecting is not restricted.
In a kind of possible implementation method, identifying user mood and video can be determined when user's expression shape change is detected
Play time, and the user emotion is synchronized or associated with video playback time point.Those skilled in the art can be with
Understand, the identification of user emotion can use related algorithm of the prior art.For example, can set up facial image features or
Corresponding relation between expression and user emotion, so that can be according to the face-image after expression shape change or according to the face-image institute
User's expression of identification obtains corresponding user emotion, and the mood of expression correspondence " making laughs " for example smiled or laugh is frowned
The mood of expression correspondence " indignation ", mood of expression correspondence " terrified " of scream etc..
" video playback time point " herein, can refer to relative point in time or time offset in video, for example
Video playback is to 00:00:User's expression shape change is detected when 10, user emotion is identified, then the corresponding video of the user emotion
Play time is 00:00:10.
Step S13, the user emotion and video playback time point are uploaded onto the server, and the user emotion is used
In it is determined that for the mood label of the video.
In a kind of possible implementation method, as shown in Fig. 2 terminal can be by wired or wireless mode by the use
Family mood and corresponding video playback time point are uploaded onto the server, and server can be received and be directed to same video from multiple terminals
User emotion and video playback time point, and counted and determined the mood label for the video.The mood mark
Label can be used for multiple purposes such as video search and recommendation.
Fig. 3 shows the flow chart of the S12 methods according to the step of one embodiment of the disclosure, shown in Fig. 3, the step S12 bags
Include：
Step S121, according to the facial image detection user expression shape change for collecting.
Step S122, when user's expression shape change is detected, it is determined that the user after change expresses one's feelings, corresponding user emotion is made
It is the user emotion for being recognized.
Step S123, it is determined that detecting the time point of user's expression shape change as the video playback time point.
Although it should be noted that describing Video processing as an example to detect identifying user mood during expression shape change
Method as above, it is understood by one of ordinary skill in the art that the disclosure answers not limited to this.In fact, user completely can be according to individual
Hobby and/or practical application scene flexibly setting when identifying user mood, as long as can be used in upload server being counted
.
So, by detecting user's expression shape change identifying user mood and by the user emotion and corresponding video
Play time uploads onto the server, and the method for processing video frequency according to disclosure above-described embodiment can make server according to reception
To user emotion and corresponding video playback time point carry out statistical analysis, be video addition mood label in order to searching for and
Recommend, better meet the demand of user.
Wherein, due to obtaining user emotion and corresponding video playback time point, it is possible to achieve for the difference of video
Time period is counted so that statistics is more accurate.
Additionally, the present embodiment is in user's expression shape change, user emotion is just obtained, i.e., timely and effectively obtain user's feelings
Thread, reduces the network bandwidth pressure between the data processing pressure of terminal and terminal and server again.
Embodiment 2
Fig. 4 shows the flow chart of the method for processing video frequency according to the embodiment of the disclosure one, and the method can be used for server etc..
Fig. 5 shows the schematic diagram of the method for processing video frequency according to the embodiment of the disclosure one, and as shown in Figure 4 and Figure 5, the method includes：
Step S21, receives and stores the user emotion and the corresponding video playback time of the user emotion of terminal transmission
Point.
In a kind of possible implementation method, the video can be seen by different users by different terminal plays
See；Can also be that different users are watched by same terminal plays, the time that different users starts viewing can also be not
With.Therefore, different terminals sends the natural time of the user emotion video playback time point corresponding with the user emotion
It is probably what is differed.As shown in figure 5, server can receive and store user emotion and the user's feelings that multiple terminals send
The corresponding video playback time point of thread, is labeled in order to follow-up statistical analysis and to video, and the terminal in Fig. 5 can be at least
Including part as shown in Figure 2, the part terminal in Fig. 5 is rough schematic view, and the terminal can be same type of terminal,
Such as mobile phone etc., or different terminals, such as mobile phone, computer, IPAD etc..
Step S22, statistics is carried out to the user emotion and its corresponding video playback time point and obtains statistics.
In a kind of possible implementation method, the user emotion that server can be received to whole section of video different time points
Ratio shared by total amount, user emotion species, every kind of user emotion count and obtains the statistics；Can also be between timesharing
Duan Jinhang statistics obtains the user emotion of each time period, and the user emotion further according to each time period obtains the statistics knot
Really.The present embodiment is not restricted to specific statistical.
Step S23, mood label corresponding with the video is determined according to the statistics.
In a kind of possible implementation method, as it was previously stated, can be according to the ratio-dependent institute shared by every kind of user emotion
State the corresponding mood label of video, it is also possible to the total duration of species and every kind of user emotion according to all time period user emotions
Determine corresponding mood label of the video, etc..
In a kind of possible implementation method, as shown in figure 5, server can create the mood label and the video
Related information and be saved in database, when user by be input into keyword (such as keyword relevant with mood) search regard
Frequently, or click on selection mood label when, according to user search or selection keyword or mood label, can will with correlation
The related information of the video of mood label is displayed in video recommendations list, wherein, the related information can include described regarding
Frequency sectional drawing and/or the video playback are linked.
So, counted by user emotion, according to statistics to video labeling mood label, according to the disclosure
The method for processing video frequency of above-described embodiment can increase the dimension of video information, be that video addition mood label can be facilitated the search for
And recommendation, search, the degree of accuracy recommended is greatly optimized, better meet the demand of user.
Wherein, due to obtaining user emotion and corresponding video playback time point, it is possible to achieve for the difference of video
Time period is counted so that statistics is more accurate.
Fig. 6 shows the flow chart of the S22 methods according to the step of one embodiment of the disclosure, shown in Fig. 6, the step S22 bags
Include：
Step S221, for each time period at least one time period of the video, counts the video playback
Time point is in the user emotion in the time period, to determine corresponding first mood label of each time period.
In a kind of possible implementation method, the video can be divided into one or more length identical or different
Time period, for each time period at least one time period of the video, statistics video playback time point is in should
First ratio of whole user emotions that the species of the user emotion in the time period and every kind of user emotion were accounted in the time period, can
According to corresponding first mood label of described first ratio-dependent time period, to be such as more than first threshold according to the first ratio
User emotion species, determine the first mood label, the first threshold can be 50% or arbitrarily set as needed
The other values put；For be not above in statistics the first threshold time period it is considered that this section of statistics without
Effect, the first mood label is not recorded.For example, as shown in table 1, using each second an as time period, for wherein 1 second (i.e. one
The individual time period), in the user emotion stored in server, the user emotion that corresponding video playback time point was fallen into this second
Be 1000, it is a total of make laughs, indignation, sad and terrified 4 kinds of moods, wherein mood of making laughs be 800, the ratio that accounts for total amount be
80%, then the first mood label for corresponding to this second is assured that to make laughs.
Table 1
Although it should be noted that using 1s as a time period as example describes method for processing video frequency as above, this
Art personnel are it is understood that the disclosure answers not limited to this.In fact, user completely can be according to personal like and/or reality
Length, size of first threshold of the flexible setting time section of application scenarios etc., as long as being obtained in that rational statistics simultaneously really
Fixed first mood label.
Step S222, statistics is carried out to the first mood label and obtains the statistics.
In a kind of possible implementation method, statistics is carried out to the first mood label can be directed to described at least one
All or part of time period in the individual time period, for example, from the description to step 221, might not all of time period
All it is effective timing statisticses section, the time period invalid for statistics can not mark the first mood label.Therefore, to described
First mood label carries out all or part of time period that statistics can be directed at least one time period.
Can be as needed to the mode that the first mood label is counted in a kind of possible implementation method
Any appropriate ways, can for example count the ratio shared by all kinds of mood labels in all first mood labels for a video
Example, using the forward mood label as video of ratio sequence, also can respectively be counted for different periods, and the disclosure is to this
It is not restricted.
In a kind of possible implementation method, for example, in the case of each time segment length identical, can be to described
One mood label carries out counting the ratio that the total amount and each first mood label that obtain the first mood label account for total amount,
The mood label of the video can be determined according to the ratio, for example, the ratio is exceeded the first of predetermined threshold
Mood label is defined as the mood label of the video.
In alternatively possible implementation method, the mode of statistics is to each time segment length uniformly or non-uniformly situation
It is all suitable for, for example, for all or part of time period at least one time period, can be to the first mood label
Carry out statistics obtain each first mood label corresponding time period duration sum account for above-mentioned all or part of time period it is total when
Second ratio long can determine the mood label of the video according to the statistics as the statistics, for example, will
Second ratio exceedes the first mood label of Second Threshold as mood label corresponding with the video, second threshold
Value can be 20% or the other values for arbitrarily setting as needed.For example, as shown in table 2, the total length of the video is
100s, is divided into 100 length and is the time period of 1 second and all participates in counting, and the first mood label is including making laughs, indignation, sorrow
4 kinds of wound and terror, wherein " making laughs " has 25 as the time period of the first mood label, each time period duration 1 second then " does
Laugh at " this corresponding duration sum of the first mood label be 25 seconds, account for the 25% of total duration, as make laughs it is corresponding second ratio
Example.According to identical principle, indignation, sad respective second ratio corresponding with terrified three the first mood labels can be calculated.
The duration sum and its second shared ratio of each the first mood label are listed in table 2, by the second ratio more than second
First mood label of predetermined threshold is defined as the mood label of the video, and as shown in table 2, the second predetermined threshold can be
20%, then the mood label of the video is " terror is made laughs "., when the video of both types is searched for, server is just for user
The video with this two classes mood label can be included to show user in list of videos is recommended by searching.
Table 2
In a kind of possible implementation method, can also add mood label by different time sections to video realize point
Duan Tongji, improves the precision of mood label for labelling, video is further used for search, the recommendation results for more refining,
Video segmentation is recommended according to mood label such as.
Fig. 7 shows a schematic diagram for exemplary application scene of the embodiment of the present disclosure.The left side of Fig. 7 is with web application
As a example by scene, right side is by taking client end AP P application scenarios as an example.The embodiment of the present disclosure can be respectively applied in terminal and server.
When user watches video in terminal by webpage mode or client end AP P modes, adopted using the camera head in terminal
Collection user's face image, identifying user mood, and with corresponding video playback time point upload server, server in association
Statistical analysis can be carried out according to above-described embodiment, determine the mood label of the video.In user with the keyword relevant with mood
Retrieved, or during selection mood label, can be by the corresponding video recommendations of mood label for matching to user.
Embodiment 3
Fig. 8 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one, and the device can be used for terminal, for example,
Mobile phone, computer, panel computer etc..As shown in figure 8, the device mainly includes：Acquisition module 81, identification module 82 and upload
Module 83.
The acquisition module 81 is configured as during video is played, the face figure of the user of the collection viewing video
Picture；
The identification module 82 is configured as when according to the facial image detection for collecting to user's expression shape change, knowing
Other user emotion simultaneously determines the video playback time point corresponding with the user emotion；
The uploading module 83 is configured as uploading onto the server the user emotion and video playback time point, institute
State user emotion for determine be directed to the video mood label.
So, by detecting user's expression shape change identifying user mood and by the user emotion and corresponding video
Play time uploads onto the server, and the video process apparatus according to disclosure above-described embodiment can make server according to reception
To user emotion and corresponding video playback time point carry out statistical analysis, be video addition mood label in order to searching for and
Recommend, better meet the demand of user.
Fig. 9 shows the block diagram of the image processing apparatus according to the embodiment of the disclosure one.Label and Fig. 8 identical groups in Fig. 9
Part has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 9, the identification module 82 includes：Detection unit 821, recognition unit 822 and time point determine single
Unit 823.
The detection unit 821 is configured as according to the facial image detection user expression shape change for collecting；
The recognition unit 822 is configured as when user's expression shape change is detected, it is determined that the user's expression correspondence after change
User emotion as the user emotion for being recognized；
The time point determining unit 823 is configured to determine that the time point for detecting user's expression shape change as the video
Play time.
Embodiment 4
Figure 10 shows the block diagram of the video process apparatus according to the embodiment of the disclosure one, and the device can be used for server etc..
As shown in Figure 10, the device mainly includes：Receiver module 101, statistical module 102 and mood label determining module 103.
The user emotion and the user emotion that the receiver module 101 is configured to receive and store terminal transmission are corresponding
Video playback time point；
The statistical module 102 is configured as carrying out statistics to the user emotion and its corresponding video playback time point obtaining
Obtain statistics；
The mood label determining module 103 is configured as determining mood corresponding with the video according to the statistics
Label.
So, counted by user emotion, according to statistics to video labeling mood label, according to the disclosure
The video process apparatus of above-described embodiment can increase the dimension of video information, be that video addition mood label can be facilitated the search for
And recommendation, search, the degree of accuracy recommended is greatly optimized, better meet the demand of user.
Figure 11 shows the block diagram of the image processing apparatus according to the embodiment of the disclosure one.Label and Figure 10 identicals in Figure 11
Component has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 11, the statistical module 102 includes：First statistic unit 1021 and the second statistic unit 1022.
First statistic unit 1021 is configured as each time period at least one time period for the video,
The user emotion that the video playback time point was in the time period is counted, to determine corresponding first mood of each time period
Label；
Second statistic unit 1022 is configured as carrying out the first mood label the statistics acquisition statistics.
Figure 12 shows the block diagram of the image processing apparatus according to the embodiment of the disclosure one.Label and Figure 11 identicals in Figure 12
Component has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 12, first statistic unit 1021 includes：First statistics subelement 10211 and determination subelement
10212。
The first statistics subelement 10211 is configured as each time at least one time period for the video
Section, the species and every kind of user emotion for counting the user emotion that the video playback time point was in the time period accounts for the time
First ratio of the whole user emotions in section；
The determination subelement 10212 is configured as according to corresponding first mood mark of described first ratio-dependent time period
Sign.
In a kind of possible implementation method, the determination subelement is configured as being more than first threshold according to the first ratio
User emotion species, determine the first mood label.
Figure 13 shows the block diagram of the image processing apparatus according to the embodiment of the disclosure one.Label and Figure 11 identicals in Figure 13
Component has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 13, second statistic unit 1022 includes：Second statistics subelement 10221
The second statistics subelement 10221 was configured as all or part of time at least one time period
Section, count each first mood label corresponding time period duration sum account for all or part of time period total duration the
Two ratios, as the statistics.
Figure 14 shows the block diagram of the image processing apparatus according to the embodiment of the disclosure one.Label and Figure 10 identicals in Figure 14
Component has identical function, for simplicity, omits the detailed description to these components.
As shown in figure 14, the mood label determining module 103 includes：Mood tag determination unit 1031.
The mood tag determination unit 1031 is configured as exceeding second ratio the first mood mark of Second Threshold
Sign as mood label corresponding with the video.
Embodiment 5
Figure 15 is a kind of block diagram of the video process apparatus 800 according to an exemplary embodiment.For example, device 800
Can be mobile phone, computer, digital broadcast terminal, messaging devices, game console, tablet device, Medical Devices,
Body-building equipment, personal digital assistant etc..
Reference picture 15, device 800 can include following one or more assemblies：Processing assembly 802, memory 804, power supply
Component 806, multimedia groupware 808, audio-frequency assembly 810, the interface 812 of input/output (I/O), sensor cluster 814, and
Communication component 816.
The integrated operation of the usual control device 800 of processing assembly 802, such as with display, call, data communication, phase
Machine is operated and the associated operation of record operation.Processing assembly 802 can refer to including one or more processors 820 to perform
Order, to complete all or part of step of above-mentioned method.Additionally, processing assembly 802 can include one or more modules, just
Interaction between processing assembly 802 and other assemblies.For example, processing assembly 802 can include multi-media module, it is many to facilitate
Interaction between media component 808 and processing assembly 802.
Memory 804 is configured as storing various types of data supporting the operation in device 800.These data are shown
Example includes the instruction for any application program or method operated on device 800, and contact data, telephone book data disappears
Breath, picture, video etc..Memory 804 can be by any kind of volatibility or non-volatile memory device or their group
Close and realize, such as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM) is erasable to compile
Journey read-only storage (EPROM), programmable read only memory (PROM), read-only storage (ROM), magnetic memory, flash
Device, disk or CD.
Power supply module 806 provides electric power for the various assemblies of device 800.Power supply module 806 can include power management system
System, one or more power supplys, and other generate, manage and distribute the component that electric power is associated with for device 800.
Multimedia groupware 808 is included in one screen of output interface of offer between described device 800 and user.One
In a little embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel, screen
Curtain may be implemented as touch-screen, to receive the input signal from user.Touch panel includes one or more touch sensings
Device is with the gesture on sensing touch, slip and touch panel.The touch sensor can not only sensing touch or sliding action
Border, but also detection and the touch or slide related duration and pressure.In certain embodiments, many matchmakers
Body component 808 includes a front camera and/or rear camera.When device 800 be in operator scheme, such as screening-mode or
During video mode, front camera and/or rear camera can receive outside multi-medium data.Each front camera and
Rear camera can be a fixed optical lens system or with focusing and optical zoom capabilities.
Audio-frequency assembly 810 is configured as output and/or input audio signal.For example, audio-frequency assembly 810 includes a Mike
Wind (MIC), when device 800 is in operator scheme, such as call model, logging mode and speech recognition mode, microphone is matched somebody with somebody
It is set to reception external audio signal.The audio signal for being received can be further stored in memory 804 or via communication set
Part 816 sends.In certain embodiments, audio-frequency assembly 810 also includes a loudspeaker, for exports audio signal.
, to provide interface between processing assembly 802 and peripheral interface module, above-mentioned peripheral interface module can for I/O interfaces 812
To be keyboard, click wheel, button etc..These buttons may include but be not limited to：Home button, volume button, start button and lock
Determine button.
Sensor cluster 814 includes one or more sensors, and the state for providing various aspects for device 800 is commented
Estimate.For example, sensor cluster 814 can detect the opening/closed mode of device 800, the relative positioning of component is for example described
Component is the display and keypad of device 800, and sensor cluster 814 can be with 800 1 components of detection means 800 or device
Position change, user is presence or absence of with what device 800 was contacted, the orientation of device 800 or acceleration/deceleration and device 800
Temperature change.Sensor cluster 814 can include proximity transducer, be configured to be detected when without any physical contact
The presence of neighbouring object.Sensor cluster 814 can also include optical sensor, such as CMOS or ccd image sensor, for into
As being used in application.In certain embodiments, the sensor cluster 814 can also include acceleration transducer, gyro sensors
Device, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 816 is configured to facilitate the communication of wired or wireless way between device 800 and other equipment.Device
800 can access the wireless network based on communication standard, such as WiFi, 2G or 3G, or combinations thereof.In an exemplary implementation
In example, communication component 816 receives broadcast singal or broadcast related information from external broadcasting management system via broadcast channel.
In one exemplary embodiment, the communication component 816 also includes near-field communication (NFC) module, to promote junction service.Example
Such as, NFC module can be based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band (UWB) technology,
Bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, device 800 can be by one or more application specific integrated circuits (ASIC), numeral letter
Number processor (DSP), digital signal processing appts (DSPD), PLD (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components realization, for performing the side described in above-described embodiment 1
Method.
In the exemplary embodiment, a kind of non-volatile computer readable storage medium storing program for executing including instructing, example are additionally provided
Such as include the memory 804 of instruction, above-mentioned instruction can be performed to complete the above method by the processor 820 of device 800.
Figure 16 is a kind of block diagram of the video process apparatus 1900 according to an exemplary embodiment.For example, device
1900 may be provided in a server.Reference picture 16, device 1900 include processing assembly 1922, its further include one or
Multiple processors, and the memory resource as representated by memory 1932, can be by the execution of processing assembly 1922 for storing
Instruction, such as application program.In memory 1932 store application program can include it is one or more each
Corresponding to one group of module of instruction.Additionally, processing assembly 1922 is configured as execute instruction, to perform described in above-described embodiment 2
Method.
Device 1900 can also include that a power supply module 1926 is configured as the power management of performs device 1900, one
Wired or wireless network interface 1950 is configured as device 1900 being connected to network, and input and output (I/O) interface
1958.Device 1900 can operate the operating system in memory 1932, such as Windows ServerTM, Mac based on storage
OS XTM, UnixTM, LinuxTM, FreeBSDTM or similar.
In the exemplary embodiment, a kind of non-volatile computer readable storage medium storing program for executing including instructing, example are additionally provided
Such as include the memory 1932 of instruction, above-mentioned instruction can be performed to complete the above method by the processing assembly 1922 of device 1900.
The disclosure can be system, method and/or computer program product.Computer program product can include computer
Readable storage medium storing program for executing, containing for making processor realize the computer-readable program instructions of various aspects of the disclosure.
Computer-readable recording medium can be the tangible of the instruction that holding and storage are used by instruction execution equipment
Equipment.Computer-readable recording medium for example can be-- but be not limited to-- storage device electric, magnetic storage apparatus, optical storage
Equipment, electromagnetism storage device, semiconductor memory apparatus or above-mentioned any appropriate combination.Computer-readable recording medium
More specifically example (non exhaustive list) includes：Portable computer diskette, hard disk, random access memory (RAM), read-only deposit
It is reservoir (ROM), erasable programmable read only memory (EPROM or flash memory), static RAM (SRAM), portable
Compact disk read-only storage (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanical coding equipment, for example thereon
Be stored with instruction punch card or groove internal projection structure and above-mentioned any appropriate combination.Calculating used herein above
Machine readable storage medium storing program for executing is not construed as instantaneous signal in itself, the electromagnetic wave of such as radio wave or other Free propagations, logical
Cross electromagnetic wave (for example, the light pulse for passing through fiber optic cables) that waveguide or other transmission mediums propagate or by wire transfer
Electric signal.
Computer-readable program instructions as described herein can from computer-readable recording medium download to each calculate/
Processing equipment, or outer computer or outer is downloaded to by network, such as internet, LAN, wide area network and/or wireless network
Portion's storage device.Network can include copper transmission cable, Optical Fiber Transmission, be wirelessly transferred, router, fire wall, interchanger, gateway
Computer and/or Edge Server.Adapter or network interface in each calculating/processing equipment are received from network to be counted
Calculation machine readable program instructions, and the computer-readable program instructions are forwarded, for storing the meter in each calculating/processing equipment
In calculation machine readable storage medium storing program for executing.
For perform the disclosure operation computer program instructions can be assembly instruction, instruction set architecture (ISA) instruction,
Machine instruction, machine-dependent instructions, microcode, firmware instructions, condition setup data or with one or more programming language
Source code or object code that any combination is write, programming language of the programming language including object-oriented-such as
Smalltalk, C++ etc., and routine procedural programming languages-such as " C " language or similar programming language.Computer
Readable program instructions can perform fully on the user computer, partly perform on the user computer, as one solely
Vertical software kit is performed, part performs or completely in remote computer on the remote computer on the user computer for part
Or performed on server.In the situation for being related to remote computer, remote computer can be by the network-bag of any kind
LAN (LAN) or wide area network (WAN)-be connected to subscriber computer are included, or, it may be connected to outer computer (such as profit
With ISP come by Internet connection).In certain embodiments, by using computer-readable program instructions
Status information carry out personalized customization electronic circuit, such as PLD, field programmable gate array (FPGA) or can
Programmed logic array (PLA) (PLA), the electronic circuit can perform computer-readable program instructions, so as to realize each side of the disclosure
Face.
Referring herein to the method according to the embodiment of the present disclosure, device (system) and computer program product flow chart and/
Or block diagram describes various aspects of the disclosure.It should be appreciated that each square frame and flow chart of flow chart and/or block diagram and/
Or in block diagram each square frame combination, can be realized by computer-readable program instructions.
These computer-readable program instructions can be supplied to all-purpose computer, special-purpose computer or other programmable datas
The processor of processing unit, so as to produce a kind of machine so that these instructions are by computer or other programmable datas
During the computing device of processing unit, work(specified in one or more square frames realized in flow chart and/or block diagram is generated
The device of energy/action.Can also be the storage of these computer-readable program instructions in a computer-readable storage medium, these refer to
Order causes that computer, programmable data processing unit and/or other equipment work in a specific way, so that, be stored with instruction
Computer-readable medium then includes a manufacture, and it includes realizing in one or more square frames in flow chart and/or block diagram
The instruction of the various aspects of the function/action of regulation.
Can also computer-readable program instructions be loaded into computer, other programmable data processing units or other
In equipment so that perform series of operation steps on computer, other programmable data processing units or miscellaneous equipment, to produce
The computer implemented process of life, so that performed on computer, other programmable data processing units or miscellaneous equipment
Instruct function/action specified in one or more square frames realized in flow chart and/or block diagram.
Flow chart and block diagram in accompanying drawing show system, method and the computer journey of the multiple embodiments according to the disclosure
The architectural framework in the cards of sequence product, function and operation.At this point, each square frame in flow chart or block diagram can generation
One part for module, program segment or instruction of table a, part for the module, program segment or instruction is used comprising one or more
In the executable instruction of the logic function for realizing regulation.In some realizations as replacement, the function of being marked in square frame
Can occur with different from the order marked in accompanying drawing.For example, two continuous square frames can essentially be held substantially in parallel
OK, they can also be performed in the opposite order sometimes, and this is depending on involved function.It is also noted that block diagram and/or
The combination of the square frame in each square frame and block diagram and/or flow chart in flow chart, can use the function of performing regulation or dynamic
The special hardware based system made is realized, or can be realized with the combination of computer instruction with specialized hardware.
It is described above the presently disclosed embodiments, described above is exemplary, and non-exclusive, and
It is not limited to disclosed each embodiment.In the case of without departing from the scope and spirit of illustrated each embodiment, for this skill
Many modifications and changes will be apparent from for the those of ordinary skill in art field.The selection of term used herein, purport
Best explaining principle, practical application or the technological improvement to the technology in market of each embodiment, or lead this technology
Other those of ordinary skill in domain are understood that each embodiment disclosed herein.
Claims (18)
1. a kind of method for processing video frequency, it is characterised in that including：
During video is played, the face-image of the user of the collection viewing video；
When according to the facial image detection for collecting to user's expression shape change, identifying user mood simultaneously determines and the use
The corresponding video playback time point of family mood；
The user emotion and video playback time point are uploaded onto the server, the user emotion is used to determine to be directed to institute
State the mood label of video.
2. method for processing video frequency according to claim 1, it is characterised in that according to the face-image inspection for collecting
When measuring user's expression shape change, identifying user mood simultaneously determines the video playback time point corresponding with the user emotion, bag
Include：
According to the facial image detection user expression shape change for collecting；
When user's expression shape change is detected, it is determined that the user after change expresses one's feelings corresponding user emotion as the user for being recognized
Mood；
It is determined that detecting the time point of user's expression shape change as the video playback time point.
3. a kind of method for processing video frequency, it is characterised in that including：
Receive and store the user emotion and the corresponding video playback time point of the user emotion of terminal transmission；
Statistics is carried out to the user emotion and its corresponding video playback time point and obtains statistics；
Mood label corresponding with the video is determined according to the statistics.
4. method for processing video frequency according to claim 3, it is characterised in that described to the user emotion and its corresponding
Video playback time point carries out statistics acquisition statistics to be included：
For each time period at least one time period of the video, when the statistics video playback time point is in this
Between user emotion in section, to determine corresponding first mood label of each time period；
Statistics is carried out to the first mood label and obtains the statistics.
5. method for processing video frequency according to claim 4, it is characterised in that at least one time period of the video
In each time period, the user emotion that the video playback time point was in the time period is counted, to determine each time
The corresponding first mood label of section, including：
For each time period at least one time period of the video, when the statistics video playback time point is in this
Between user emotion in section species and the first ratio of whole user emotions for accounting in the time period of every kind of user emotion；
According to corresponding first mood label of described first ratio-dependent time period.
6. method for processing video frequency according to claim 5, it is characterised in that according to described first ratio-dependent time period
Corresponding first mood label, including：
Species according to the first ratio more than the user emotion of first threshold, determines the first mood label.
7. method for processing video frequency according to claim 4, it is characterised in that statistics is carried out to the first mood label and is obtained
The statistics is obtained, including：
For all or part of time period at least one time period, each first mood label corresponding time period is counted
Duration sum account for all or part of time period total duration the second ratio, as the statistics.
8. method for processing video frequency according to claim 7, it is characterised in that determined to be regarded with described according to the statistics
Frequently corresponding mood label, including：
Second ratio is exceeded the first mood label of Second Threshold as mood label corresponding with the video.
9. a kind of video process apparatus, it is characterised in that including：
Acquisition module, for during video is played, the face-image of the user of the video to be watched in collection；
Identification module, for when according to the facial image detection that collects to user's expression shape change, identifying user mood
And determine the video playback time point corresponding with the user emotion；
Uploading module, for the user emotion and video playback time point to be uploaded onto the server, the user emotion
For determining the mood label for the video.
10. video process apparatus according to claim 9, it is characterised in that the identification module includes：
Detection unit, for according to the facial image detection user expression shape change for collecting；
Recognition unit, for when user's expression shape change is detected, corresponding user emotion to be made it is determined that the user after change expresses one's feelings
It is the user emotion for being recognized；
Time point determining unit, for determine detect user's expression shape change time point as the video playback time point.
A kind of 11. video process apparatus, it is characterised in that including：
Receiver module, for receiving and store terminal transmission user emotion and the corresponding video playback time of the user emotion
Point；
Statistical module, statistics is obtained for carrying out statistics to the user emotion and its corresponding video playback time point；
Mood label determining module, for determining mood label corresponding with the video according to the statistics.
12. video process apparatus according to claim 11, it is characterised in that the statistical module includes：
First statistic unit, at least one time period for the video in each time period, count the video
Play time is in the user emotion in the time period, to determine corresponding first mood label of each time period；
Second statistic unit, the statistics is obtained for carrying out statistics to the first mood label.
13. video process apparatus according to claim 12, it is characterised in that first statistic unit includes：
First statistics subelement, at least one time period for the video in each time period, statistics described in regard
Whole use that the species and every kind of user emotion of the user emotion that frequency play time was in the time period were accounted in the time period
First ratio of family mood；
Determination subelement, for according to corresponding first mood label of described first ratio-dependent time period.
14. video process apparatus according to claim 13, it is characterised in that
The determination subelement, for the species according to the first ratio more than the user emotion of first threshold, determines described first
Mood label.
15. video process apparatus according to claim 12, it is characterised in that second statistic unit includes：
Second statistics subelement, for for all or part of time period at least one time period, statistics each first
The duration sum of mood label corresponding time period accounts for the second ratio of the total duration of all or part of time period, used as institute
State statistics.
16. video process apparatus according to claim 15, it is characterised in that the mood label determining module includes：
Mood tag determination unit, the first mood label for second ratio to be exceeded Second Threshold is regarded as with described
Frequently corresponding mood label.
A kind of 17. video process apparatus, it is characterised in that including：
Processor；
Memory for storing processor-executable instruction；
Wherein, the processor is configured as：
During video is played, the face-image of the user of the collection viewing video；
When according to the facial image detection for collecting to user's expression shape change, identifying user mood simultaneously determines and the use
The corresponding video playback time point of family mood；
The user emotion and video playback time point are uploaded onto the server, the user emotion is used to determine to be directed to institute
State the mood label of video.
A kind of 18. video process apparatus, it is characterised in that including：
Processor；
Memory for storing processor-executable instruction；
Wherein, the processor is configured as：
Receive and store the user emotion and the corresponding video playback time point of the user emotion of terminal transmission；
Statistics is carried out to the user emotion and its corresponding video playback time point and obtains statistics；
Mood label corresponding with the video is determined according to the statistics.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611152708.4A CN106792170A (en) | 2016-12-14 | 2016-12-14 | Method for processing video frequency and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611152708.4A CN106792170A (en) | 2016-12-14 | 2016-12-14 | Method for processing video frequency and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106792170A true CN106792170A (en) | 2017-05-31 |
Family
ID=58888175
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611152708.4A Pending CN106792170A (en) | 2016-12-14 | 2016-12-14 | Method for processing video frequency and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106792170A (en) |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107612815A (en) * | 2017-09-19 | 2018-01-19 | 北京金山安全软件有限公司 | Information sending method, device and equipment |
| CN107786894A (en) * | 2017-09-29 | 2018-03-09 | 维沃移动通信有限公司 | A kind of recognition methods of user feedback data, mobile terminal and storage medium |
| CN107862598A (en) * | 2017-09-30 | 2018-03-30 | 平安普惠企业管理有限公司 | Long-range the interview measures and procedures for the examination and approval, server and readable storage medium storing program for executing |
| CN107948732A (en) * | 2017-12-04 | 2018-04-20 | 京东方科技集团股份有限公司 | Playback method, video play device and the system of video |
| CN108304793A (en) * | 2018-01-26 | 2018-07-20 | 北京易真学思教育科技有限公司 | Online learning analysis system and method |
| CN109040842A (en) * | 2018-08-16 | 2018-12-18 | 上海哔哩哔哩科技有限公司 | Video spectators' emotional information capturing analysis method, device, system and storage medium |
| CN109672935A (en) * | 2017-10-13 | 2019-04-23 | 富泰华工业（深圳）有限公司 | Video push system and method based on user emotion |
| CN109819325A (en) * | 2019-01-11 | 2019-05-28 | 平安科技（深圳）有限公司 | Hot video marks processing method, device, computer equipment and storage medium |
| CN109963180A (en) * | 2017-12-25 | 2019-07-02 | 上海全土豆文化传播有限公司 | Video information statistical method and device |
| CN110558997A (en) * | 2019-08-30 | 2019-12-13 | 深圳智慧林网络科技有限公司 | Robot-based escort method, robot and computer-readable storage medium |
| CN110826436A (en) * | 2019-10-23 | 2020-02-21 | 上海能塔智能科技有限公司 | Emotion data transmission and processing method and device, terminal device and cloud platform |
| CN108391164B (en) * | 2018-02-24 | 2020-08-21 | Oppo广东移动通信有限公司 | Video parsing method and related product |
| CN111666793A (en) * | 2019-03-08 | 2020-09-15 | 阿里巴巴集团控股有限公司 | Video processing method, video processing device and electronic device |
| CN111918015A (en) * | 2019-05-07 | 2020-11-10 | 阿瓦亚公司 | Video call routing and management based on AI-determined facial emotions |
| CN112073757A (en) * | 2020-08-13 | 2020-12-11 | 北京奇艺世纪科技有限公司 | Emotion fluctuation index acquisition method, emotion fluctuation index display method and multimedia content production method |
| WO2021042513A1 (en) * | 2019-09-03 | 2021-03-11 | 平安科技（深圳）有限公司 | Method and apparatus for adding expression in video chat, computer device and storage medium |
| CN112492397A (en) * | 2019-09-12 | 2021-03-12 | 上海哔哩哔哩科技有限公司 | Video processing method, computer device, and storage medium |
| CN112565913A (en) * | 2020-11-30 | 2021-03-26 | 维沃移动通信有限公司 | Video call method and device and electronic equipment |
| CN113744445A (en) * | 2021-09-06 | 2021-12-03 | 北京雷石天地电子技术有限公司 | Match voting method, device, computer equipment and storage medium |
| CN113965804A (en) * | 2021-09-28 | 2022-01-21 | 展讯半导体(南京)有限公司 | Video processing method and related product |
| CN116074573A (en) * | 2021-10-30 | 2023-05-05 | 杭州当虹科技股份有限公司 | Emotional expression output control method and system based on video content |
| CN116095424A (en) * | 2023-02-10 | 2023-05-09 | 蔚来汽车科技(安徽)有限公司 | Video tag generation method, device, medium and vehicle |
| CN116932897A (en) * | 2023-07-05 | 2023-10-24 | 国网浙江省电力有限公司湖州供电公司 | Electric power information pushing method and system based on label technology |
| CN116958502A (en) * | 2023-08-10 | 2023-10-27 | 斑马网络技术有限公司 | A method and system for collecting facial expression materials |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030118974A1 (en) * | 2001-12-21 | 2003-06-26 | Pere Obrador | Video indexing based on viewers' behavior and emotion feedback |
| US20050289582A1 (en) * | 2004-06-24 | 2005-12-29 | Hitachi, Ltd. | System and method for capturing and using biometrics to review a product, service, creative work or thing |
| US20070150281A1 (en) * | 2005-12-22 | 2007-06-28 | Hoff Todd M | Method and system for utilizing emotion to search content |
| US20090150919A1 (en) * | 2007-11-30 | 2009-06-11 | Lee Michael J | Correlating Media Instance Information With Physiological Responses From Participating Subjects |
| US20110219042A1 (en) * | 2006-10-27 | 2011-09-08 | Samsung Electronics Co., Ltd. | Method and apparatus for generating meta data of content |
| CN103339649A (en) * | 2011-02-27 | 2013-10-02 | 阿弗科迪瓦公司 | Video recommendation based on affect |
| CN103530788A (en) * | 2012-07-02 | 2014-01-22 | 纬创资通股份有限公司 | Multimedia evaluation system, multimedia evaluation device and multimedia evaluation method |
| CN103826160A (en) * | 2014-01-09 | 2014-05-28 | 广州三星通信技术研究有限公司 | Method and device for obtaining video information, and method and device for playing video |
| CN103873492A (en) * | 2012-12-07 | 2014-06-18 | 联想(北京)有限公司 | Electronic device and data transmission method |
| CN104410911A (en) * | 2014-12-31 | 2015-03-11 | 合一网络技术(北京)有限公司 | Video emotion tagging-based method for assisting identification of facial expression |
| CN105956059A (en) * | 2016-04-27 | 2016-09-21 | 乐视控股（北京）有限公司 | Emotion recognition-based information recommendation method and apparatus |
| US20160316237A1 (en) * | 2015-04-21 | 2016-10-27 | Thales Avionics, Inc. | Facial analysis for vehicle entertainment system metrics |
-
2016
- 2016-12-14 CN CN201611152708.4A patent/CN106792170A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030118974A1 (en) * | 2001-12-21 | 2003-06-26 | Pere Obrador | Video indexing based on viewers' behavior and emotion feedback |
| US20050289582A1 (en) * | 2004-06-24 | 2005-12-29 | Hitachi, Ltd. | System and method for capturing and using biometrics to review a product, service, creative work or thing |
| US20070150281A1 (en) * | 2005-12-22 | 2007-06-28 | Hoff Todd M | Method and system for utilizing emotion to search content |
| US20110219042A1 (en) * | 2006-10-27 | 2011-09-08 | Samsung Electronics Co., Ltd. | Method and apparatus for generating meta data of content |
| US20090150919A1 (en) * | 2007-11-30 | 2009-06-11 | Lee Michael J | Correlating Media Instance Information With Physiological Responses From Participating Subjects |
| CN103339649A (en) * | 2011-02-27 | 2013-10-02 | 阿弗科迪瓦公司 | Video recommendation based on affect |
| CN103530788A (en) * | 2012-07-02 | 2014-01-22 | 纬创资通股份有限公司 | Multimedia evaluation system, multimedia evaluation device and multimedia evaluation method |
| CN103873492A (en) * | 2012-12-07 | 2014-06-18 | 联想(北京)有限公司 | Electronic device and data transmission method |
| CN103826160A (en) * | 2014-01-09 | 2014-05-28 | 广州三星通信技术研究有限公司 | Method and device for obtaining video information, and method and device for playing video |
| CN104410911A (en) * | 2014-12-31 | 2015-03-11 | 合一网络技术(北京)有限公司 | Video emotion tagging-based method for assisting identification of facial expression |
| US20160316237A1 (en) * | 2015-04-21 | 2016-10-27 | Thales Avionics, Inc. | Facial analysis for vehicle entertainment system metrics |
| CN105956059A (en) * | 2016-04-27 | 2016-09-21 | 乐视控股（北京）有限公司 | Emotion recognition-based information recommendation method and apparatus |
Non-Patent Citations (1)
| Title |
|---|
| 中国人工智能学会: "《中国人工智能》", 31 December 2007 * |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107612815A (en) * | 2017-09-19 | 2018-01-19 | 北京金山安全软件有限公司 | Information sending method, device and equipment |
| CN107786894A (en) * | 2017-09-29 | 2018-03-09 | 维沃移动通信有限公司 | A kind of recognition methods of user feedback data, mobile terminal and storage medium |
| CN107862598A (en) * | 2017-09-30 | 2018-03-30 | 平安普惠企业管理有限公司 | Long-range the interview measures and procedures for the examination and approval, server and readable storage medium storing program for executing |
| CN109672935A (en) * | 2017-10-13 | 2019-04-23 | 富泰华工业（深圳）有限公司 | Video push system and method based on user emotion |
| CN107948732A (en) * | 2017-12-04 | 2018-04-20 | 京东方科技集团股份有限公司 | Playback method, video play device and the system of video |
| US10560749B2 (en) | 2017-12-04 | 2020-02-11 | Boe Technology Group Co., Ltd. | Video playing method, video playing device, video playing system, apparatus and computer-readable storage medium |
| CN107948732B (en) * | 2017-12-04 | 2020-12-01 | 京东方科技集团股份有限公司 | Video playback method, video playback device and system |
| CN109963180A (en) * | 2017-12-25 | 2019-07-02 | 上海全土豆文化传播有限公司 | Video information statistical method and device |
| CN108304793A (en) * | 2018-01-26 | 2018-07-20 | 北京易真学思教育科技有限公司 | Online learning analysis system and method |
| CN108304793B (en) * | 2018-01-26 | 2021-01-08 | 北京世纪好未来教育科技有限公司 | Online learning analysis system and method |
| CN108391164B (en) * | 2018-02-24 | 2020-08-21 | Oppo广东移动通信有限公司 | Video parsing method and related product |
| CN109040842A (en) * | 2018-08-16 | 2018-12-18 | 上海哔哩哔哩科技有限公司 | Video spectators' emotional information capturing analysis method, device, system and storage medium |
| CN109819325B (en) * | 2019-01-11 | 2021-08-20 | 平安科技（深圳）有限公司 | Hotspot video annotation processing method and device, computer equipment and storage medium |
| CN109819325A (en) * | 2019-01-11 | 2019-05-28 | 平安科技（深圳）有限公司 | Hot video marks processing method, device, computer equipment and storage medium |
| CN111666793A (en) * | 2019-03-08 | 2020-09-15 | 阿里巴巴集团控股有限公司 | Video processing method, video processing device and electronic device |
| CN111918015A (en) * | 2019-05-07 | 2020-11-10 | 阿瓦亚公司 | Video call routing and management based on AI-determined facial emotions |
| CN110558997A (en) * | 2019-08-30 | 2019-12-13 | 深圳智慧林网络科技有限公司 | Robot-based escort method, robot and computer-readable storage medium |
| WO2021042513A1 (en) * | 2019-09-03 | 2021-03-11 | 平安科技（深圳）有限公司 | Method and apparatus for adding expression in video chat, computer device and storage medium |
| CN112492397A (en) * | 2019-09-12 | 2021-03-12 | 上海哔哩哔哩科技有限公司 | Video processing method, computer device, and storage medium |
| CN110826436A (en) * | 2019-10-23 | 2020-02-21 | 上海能塔智能科技有限公司 | Emotion data transmission and processing method and device, terminal device and cloud platform |
| CN112073757A (en) * | 2020-08-13 | 2020-12-11 | 北京奇艺世纪科技有限公司 | Emotion fluctuation index acquisition method, emotion fluctuation index display method and multimedia content production method |
| CN112565913B (en) * | 2020-11-30 | 2023-06-20 | 维沃移动通信有限公司 | Video call method, device and electronic equipment |
| CN112565913A (en) * | 2020-11-30 | 2021-03-26 | 维沃移动通信有限公司 | Video call method and device and electronic equipment |
| CN113744445A (en) * | 2021-09-06 | 2021-12-03 | 北京雷石天地电子技术有限公司 | Match voting method, device, computer equipment and storage medium |
| CN113965804A (en) * | 2021-09-28 | 2022-01-21 | 展讯半导体(南京)有限公司 | Video processing method and related product |
| CN116074573A (en) * | 2021-10-30 | 2023-05-05 | 杭州当虹科技股份有限公司 | Emotional expression output control method and system based on video content |
| CN116095424A (en) * | 2023-02-10 | 2023-05-09 | 蔚来汽车科技(安徽)有限公司 | Video tag generation method, device, medium and vehicle |
| CN116095424B (en) * | 2023-02-10 | 2025-09-23 | 蔚来汽车科技(安徽)有限公司 | Video tag generation method, device, medium and vehicle |
| CN116932897A (en) * | 2023-07-05 | 2023-10-24 | 国网浙江省电力有限公司湖州供电公司 | Electric power information pushing method and system based on label technology |
| CN116958502A (en) * | 2023-08-10 | 2023-10-27 | 斑马网络技术有限公司 | A method and system for collecting facial expression materials |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106792170A (en) | Method for processing video frequency and device | |
| CN107948708A (en) | Barrage methods of exhibiting and device | |
| CN109257645A (en) | Video cover generation method and device | |
| CN106993229A (en) | Interactive attribute methods of exhibiting and device | |
| CN103530788A (en) | Multimedia evaluation system, multimedia evaluation device and multimedia evaluation method | |
| CN108985176A (en) | image generating method and device | |
| CN108924644A (en) | Video clip extracting method and device | |
| CN108833939A (en) | Generate the method and device of the poster of video | |
| CN108093315A (en) | Video generation method and device | |
| CN106791535A (en) | Video recording method and device | |
| CN110990534B (en) | Data processing method and device for data processing | |
| CN106899875A (en) | The display control method and device of plug-in captions | |
| CN108540850A (en) | Barrage display methods and device | |
| CN108737891A (en) | Video material processing method and processing device | |
| CN110399934A (en) | A kind of video classification methods, device and electronic equipment | |
| CN110209877A (en) | Video analysis method and device | |
| CN106791821A (en) | Play appraisal procedure and device | |
| CN106782576A (en) | audio mixing method and device | |
| CN106991018A (en) | The method and device of changing an interface skin | |
| CN108174269A (en) | Visualize audio frequency playing method and device | |
| CN107122430A (en) | Search result display methods and device | |
| CN110121106A (en) | Video broadcasting method and device | |
| CN112685641A (en) | Information processing method and device | |
| CN109544716A (en) | Student registers method and device, electronic equipment and storage medium | |
| CN106599191A (en) | User attribute analysis method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170531 |
|
| RJ01 | Rejection of invention patent application after publication |