KR102796897B1 - Method for changing video playback speed and electronic device for performing the same - Google Patents

Abstract

A method for changing the playback speed of an image in an electronic device is disclosed. Specifically, the method for changing the playback speed of an image in an electronic device may include: a step of checking a first time period of an image and information related to the first time period; a step of determining a playback speed for the first time period based on an algorithm using the information; and a step of controlling the first time period to be played at the playback speed.

Description

METHOD FOR CHANGING VIDEO PLAYBACK SPEED AND ELECTRONIC DEVICE FOR PERFORMING THE SAME

Embodiments of the present specification relate to a method for changing video playback speed and an electronic device therefor.

Through various platforms, the frequency of watching videos is increasing. In relation to this, users can watch videos quickly by changing the speed to high speeds such as 1.5x or 2x, and skipping parts that are not of interest by skipping 10 seconds forward or 10 seconds back, thereby focusing on watching key scenes.

However, actions such as changing the user's speed, moving forward 10 seconds, or moving back 10 seconds were performed manually. This caused problems in which users watched the video inefficiently as they watched parts they were not interested in at regular speed or skipped key scenes.

The present disclosure has been proposed to solve the above-described problems, and the disclosed embodiments are intended to provide a method for changing a video playback speed and an electronic device therefor. Specifically, the present disclosure relates to a method for changing a video playback speed and an electronic device therefor, which determines a playback speed for a first time section based on an algorithm using information related to a first time section of a video, thereby controlling the first time section to be played at the determined playback speed.

The technical problems to be solved by this embodiment are not limited to the technical problems described above, and other technical problems can be inferred from the following embodiments.

As a technical means for achieving the above-described task, a method for changing the video playback speed of an electronic device according to the first aspect of the present disclosure may include a step of confirming a first time section of an video and information related to the first time section; a step of determining a playback speed for the first time section based on an algorithm using the information; and a step of controlling the first time section to be played at the playback speed.

According to one embodiment, the information associated with the first time segment may include at least one of first information about subtitles of the first time segment, second information about audio of the first time segment, third information about keywords associated with the video, and fourth information about playback speeds of multiple users who viewed the video in the first time segment.

According to one embodiment, the step of determining the playback speed may include: calculating a plurality of values corresponding to each of the plurality of pieces of information based on an algorithm using each of the plurality of pieces of information, if the information includes a plurality of pieces of information; and determining the playback speed based on the plurality of weights and the plurality of values corresponding to each of the plurality of pieces of information.

In one embodiment, the plurality of weights can be determined based on information about the genre of the image.

According to one embodiment, the step of determining the playback speed may include the step of determining whether a subtitle is included in the first time interval based on the first information; and the step of determining the playback speed based on whether a subtitle is included in the first time interval.

In one embodiment, the step of determining the playback speed may include: determining the playback speed as a first value when the first time interval includes a subtitle; and determining the playback speed as a second value when the first time interval does not include a subtitle, wherein the first value may be less than the second value.

According to one embodiment, the step of determining the playback speed may include the step of determining whether the frequency or size of the audio is greater than or equal to a set value or whether the audio of the first time period corresponds to a set pattern based on the second information; and the step of determining the playback speed based on whether the frequency or size of the audio is greater than or equal to the set value or whether the audio of the first time period corresponds to the set pattern.

In one embodiment, the step of determining the playback speed may include the step of determining whether the audio includes a human voice and other voices based on the second information; and the step of determining the playback speed based on whether the audio includes a human voice and other voices.

According to one embodiment, the step of determining the playback speed may include the step of determining whether the keyword is included in the first time interval based on the first information, the second information, and the third information; and the step of determining the playback speed based on whether the keyword is included in the first time interval.

In one embodiment, the step of determining the playback speed may include the step of determining the playback speed corresponding to the fourth information.

According to one embodiment, the step of determining the playback speed may further include the step of determining whether a main scene is included in the first time interval based on an artificial intelligence model that inputs information; and the step of determining the playback speed based on whether a main scene is included in the first time interval.

In one embodiment, the artificial intelligence model may be an artificial intelligence model trained to output that a main scene is included in the first time period if a change in an object included in a plurality of frames corresponding to the first time period is less than or equal to a set value.

According to one embodiment, the artificial intelligence model may be an artificial intelligence model trained to output that a main scene is included in the first time period if the composition of a plurality of frames corresponding to the first time period or the behavior of an object included in the plurality of frames satisfies a set condition.

In one embodiment, the step of determining a playback speed for the first time interval may include the step of identifying a second time interval and a third time interval adjacent to the first time interval; and the step of determining the playback speed for the first time interval based on the playback speed for the second time interval and the playback speed for the third time interval.

In one embodiment, the step of determining the playback speed may include the step of determining the playback speed based on an algorithm using information about all time segments of the video and information associated with the first time segment.
An electronic device according to a second aspect of the present disclosure includes a transceiver; one or more processors; and a storage storing one or more commands executed by the one or more processors, wherein the one or more processors may execute the one or more commands to identify a first time period of an image and information related to the first time period, determine a playback speed for the first time period based on an algorithm using the information, and control the first time period to be played at the playback speed.

delete

A recording medium according to the third aspect of the present disclosure may be a non-transitory computer-readable recording medium having recorded thereon a program for executing a method for changing a video playback speed of an electronic device on a computer.

According to the proposed embodiment, one or more of the following effects can be expected:

According to an embodiment of the present specification, a playback speed for a first time interval can be automatically determined based on an algorithm using information related to various first time intervals. Accordingly, a time interval of a video that is predicted to be of no interest to the user can be played at a relatively high speed, and a time interval of a video that is predicted to be of interest to the user can be played at a relatively low speed.

The effects of the invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by a person skilled in the art from the description of the claims.

FIG. 1 is a drawing for explaining a system in which a method for changing the video playback speed of an electronic device according to one embodiment of the present invention can be implemented.
FIG. 2 is a flowchart illustrating a method for changing the video playback speed of an electronic device according to one embodiment.
FIG. 3 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on first information according to one embodiment.
FIG. 4 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on second information according to one embodiment.
FIG. 5 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on second information according to one embodiment.
FIG. 6 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on third information according to one embodiment.
FIG. 7 is a flowchart illustrating a method for determining a playback speed of a specific time period of a video by checking whether a key scene is included in the specific time period based on an artificial intelligence model according to one embodiment.
FIG. 8 is a flowchart illustrating a method for determining a playback speed of a specific time interval based on the playback speeds of adjacent time intervals according to one embodiment.
FIG. 9 is a diagram for explaining a playback speed for a specific time period according to one embodiment.
FIG. 10 is a diagram for explaining a playback speed for a specific time period according to one embodiment.
FIG. 11 is a block diagram schematically illustrating an electronic device for performing a method for changing video playback speed according to one embodiment.

The terms used in the embodiments are selected from the most widely used general terms possible while considering the functions of the present disclosure, but this may vary depending on the intention of a technician working in the field, precedents, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meanings thereof will be described in detail in the corresponding description section. Therefore, the terms used in the present disclosure should be defined based on the meanings of the terms and the overall contents of the present disclosure, rather than simply the names of the terms.

When a part of the specification is said to “include” a component, this does not mean that other components are excluded, unless otherwise specifically stated, but rather that other components may be included. In addition, terms such as “part,” “module,” etc., described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software, or a combination of hardware and software.

The expression “at least one of a, b, and c” as used throughout the specification can encompass “a alone,” “b alone,” “c alone,” “a and b,” “a and c,” “b and c,” or “all of a, b, and c.”

The "terminal" mentioned below may be implemented as a computer or portable terminal capable of connecting to a server or other terminal via a network. Here, the computer includes, for example, a notebook, desktop, laptop, etc. equipped with a WEB Browser, and the portable terminal may include, for example, a wireless communication device that ensures portability and mobility, such as a communication-based terminal such as IMT (International Mobile Telecommunication), CDMA (Code Division Multiple Access), W-CDMA (W-Code Division Multiple Access), LTE (Long Term Evolution), and all kinds of handheld-based wireless communication devices such as a smartphone, tablet PC, etc.

Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

In describing the embodiments, descriptions of technical contents that are well known in the technical field to which the present invention belongs and are not directly related to the present invention will be omitted. This is to convey the gist of the present invention more clearly without obscuring it by omitting unnecessary explanations.

For the same reason, some components in the attached drawings are exaggerated, omitted, or schematically illustrated. In addition, the size of each component does not entirely reflect the actual size. The same reference numerals are given to identical or corresponding components in each drawing.

The advantages and features of the present invention, and the methods for achieving them, will become clear with reference to the embodiments described in detail below together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and the present embodiments are provided only to make the disclosure of the present invention complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

At this time, it will be understood that each block of the processing flow diagrams and combinations of the flow diagrams can be performed by computer program instructions. These computer program instructions can be loaded onto a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing equipment, so that the instructions executed by the processor of the computer or other programmable data processing equipment create a means for performing the functions described in the flow diagram block(s). These computer program instructions can also be stored in a computer-available or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement the function in a specific manner, so that the instructions stored in the computer-available or computer-readable memory can also produce a manufactured article including an instruction means for performing the functions described in the flow diagram block(s). Since the computer program instructions may be installed on a computer or other programmable data processing apparatus, a series of operational steps may be performed on the computer or other programmable data processing apparatus to produce a computer-implemented process, so that the instructions executed by the computer or other programmable data processing apparatus may also provide steps for executing the functions described in the flowchart block(s).

Additionally, each block may represent a module, segment, or portion of code that contains one or more executable instructions for performing a particular logical function(s). It should also be noted that in some alternative implementation examples, the functions mentioned in the blocks may occur out of order. For example, two blocks shown in succession may in fact be performed substantially concurrently, or the blocks may sometimes be performed in reverse order, depending on the functionality they perform.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

FIG. 1 is a drawing for explaining a system in which a method for changing the video playback speed of an electronic device according to one embodiment of the present invention can be implemented.

Referring to FIG. 1, a system (10) according to various embodiments may be a system (10) for implementing a method for changing a video playback speed of an electronic device (100). The system (10) may include an electronic device (100) and a server (110). The system (10) illustrated in FIG. 1 only illustrates components related to the present embodiment. Therefore, a person having ordinary skill in the art related to the present embodiment may understand that other general components may be further included in addition to the components illustrated in FIG. 1.

Each of the electronic device (100) and the server (110) may include a transceiver, storage, and a processor. In addition, each of the electronic device (100) and the server (110) means a unit that processes at least one function or operation, and this may be implemented by hardware or software, or a combination of hardware and software. Meanwhile, throughout the embodiments, each of the electronic device (100) and the server (110) is referred to as a separate device or server, but this may be a logically divided structure, and at least some of them may be implemented by a separate function from one device or server.

According to one embodiment, the electronic device (100) and the server (110) may include a plurality of computer systems or computer software implemented as network servers. For example, at least some of the electronic device (100) and the server (110) may refer to a computer system and computer software that are connected to a lower device that can communicate with another network server through a computer network such as an intranet or the Internet, receive a task execution request, perform the task for the request, and provide the execution result. In addition, at least some of the electronic device (100) and the server (110) may be understood as a broad concept that includes a series of application programs that can operate on a network server, and various databases built on internal or connected other nodes. For example, at least some of the electronic device (100) and the server (110) may be implemented using a network server program that is provided in various ways according to an operating system such as DOS, Windows, Linux, UNIX, or MacOS.

The electronic device (100) and the server (110) can communicate with each other through a network (not shown). The network includes a Local Area Network (LAN), a Wide Area Network (WAN), a Value Added Network (VAN), a mobile radio communication network, a satellite communication network, and a combination thereof, and is a comprehensive data communication network that allows each network component shown in FIG. 1 to communicate smoothly with each other, and may include wired Internet, wireless Internet, and a mobile radio communication network. The wireless communication may include, but is not limited to, wireless LAN (Wi-Fi), Bluetooth, Bluetooth low energy, Zigbee, WFD (Wi-Fi Direct), UWB (ultra wideband), infrared communication (IrDA, infrared Data Association), NFC (Near Field Communication), etc., for example.

According to one embodiment, the electronic device (100) can check a first time period of an image and information related to the first time period, determine a playback speed for the first time period based on an algorithm using the information, and control the first time period to be played at the playback speed.

According to one embodiment, the electronic device (100) may be a user's terminal on which the video is actually played. However, the electronic device (100) according to one embodiment may correspond to the user's terminal, but is not limited thereto. The electronic device (100) may also be a server related to a video streaming platform. For convenience of explanation, the following description will mainly focus on the case where the electronic device (100) is the user's terminal.

According to one embodiment, the server (110) may be a server related to a video streaming platform that provides information related to a video to a user's terminal in real time. In this regard, the server (110) may store information on all time periods of the video.

According to an embodiment, a server (110) may transmit data for a specific time period of a video (e.g., a time period corresponding to 6 to 10 seconds) to an electronic device (100) in real time. That is, the electronic device (100) may determine a playback speed for a specific time period based on information related to the specific time period of the video, but is not limited thereto. For example, if the electronic device (100) is a server related to a video streaming platform, the electronic device (100) may determine a playback speed for a specific time period based on an algorithm using information for all time periods of the video and information related to the specific time period. As another example, if offline playback of a video is possible through the electronic device (100), the electronic device (100) may determine a playback speed for a specific time period based on an algorithm using information for all time periods of the video and information related to the specific time period.

In this specification, the first time period may be any time period of the image. In this regard, when the electronic device (100) is a user's terminal, the electronic device (100) may receive and play back data for a specific time period of the image in real time. That is, the electronic device (100) may appropriately change the playback speed for a specific time period of the image based on data for a specific time period of the image received in real time.

In this specification, playing back a video at regular speed may mean playing back the video at 1x speed. In addition, playing back a video at high speed may mean playing back the video at a higher speed than 1x speed. For example, the high speed may correspond to any one of 1.25x speed, 1.5x speed, 1.75x speed, and 2x speed, but is not limited thereto. Here, if the high speed is higher than the set speed (e.g., 3x speed), the audio quality may be significantly reduced, and therefore the high speed may have a certain maximum speed (e.g., 2x speed). In addition, playing back a video at low speed may mean playing back the video at a lower speed than 1x speed. For example, the low speed may correspond to any one of 0.75x speed, 0.5x speed, and 0.25x speed, but is not limited thereto.

FIG. 2 is a flowchart illustrating a method for changing the video playback speed of an electronic device according to one embodiment.

Referring to FIG. 2, it can be clearly understood that some operations of the method for changing the video playback speed of the electronic device (100) may be changed or substituted, or some of the orders between the operations may be changed, within a range clearly understandable to a person having ordinary skill in the art to which the present invention pertains.

In step S210, the electronic device (100) can check the first time period of the image and information related to the first time period.

According to one embodiment, the electronic device (100) can receive data on a specific time section of an image in real time from the server (110). In this regard, the electronic device (100) can check a first time section of the image and can check information related to the first time section. At this time, the electronic device (100) can be playing a second time section that is a time section preceding the first time section.

The information related to the first time segment according to one embodiment may include characteristic information about the first time segment of the video. For example, the information related to the first time segment may include at least one of first information about subtitles of the first time segment, second information about audio of the first time segment, third information about keywords related to the video, and fourth information about playback speeds of multiple users who viewed the video in the first time segment.

In step S220, the electronic device (100) can determine a playback speed for the first time period based on an algorithm using information.

According to one embodiment, the information related to the first time interval may be a plurality of pieces of information. At this time, the plurality of values corresponding to each of the plurality of pieces of information calculated based on an algorithm using each of the plurality of pieces of information may be different. That is, it may be appropriate for the playback speed of the first time interval to be calculated based on the plurality of values and the plurality of weights corresponding to each of the plurality of pieces of information.

In relation to this, the electronic device (100) according to one embodiment may calculate a plurality of values corresponding to each of the plurality of pieces of information based on an algorithm using each of the plurality of pieces of information, and determine a final playback speed for the first time period based on the plurality of weights and the plurality of values corresponding to each of the plurality of pieces of information. For example, the information related to the first time period may include the first information, the second information, the third information, and the fourth information, and the plurality of weights may be 0.25, 0.25, 0.25, and 0.25. When the plurality of values calculated based on the first information, the second information, the third information, and the fourth information are 1, 1, 2, and 2, the playback speed for the first time period may be calculated as 1.5, which is a weighted average based on the plurality of values and the plurality of weights.

Here, the plurality of weights may be set to the same, but are not limited thereto. The plurality of weights may be set by the user or may be appropriately set based on information about the genre of the video. For example, if the video is a court-related drama, it may be appropriate to play a part with subtitles or a part with audio at regular speed, so it may be appropriate to set the weights corresponding to the first information and the second information to be large. As another example, if the video is an action-related drama, even if there is no subtitle, it may be appropriate to play a part where the frequency or size of the audio is greater than the set value at regular speed, so it may be appropriate to set the weight corresponding to the first information to be small, and the weight corresponding to the second information to be large. That is, since the plurality of weights are set based on information about the genre of the video, the playback speed for each time section of the video can be determined more appropriately.

According to one embodiment, the electronic device (100) may determine the playback speed to correspond to the fourth information. For example, if the first time period is determined to be a time period in which most of the plurality of users who watched the video based on the fourth information watched it at high speed or skipped it, the electronic device (100) may determine the playback speed of the first time period to be high speed based on the fourth information. As another example, if the first time period is determined to be a time period in which most of the plurality of users who watched the video watched it at regular speed or low speed or rewound the video, the electronic device (100) may determine the playback speed of the first time period to be regular speed or low speed based on the fourth information.

An embodiment of determining the playback speed for the first time interval based on an algorithm using each of the first information, the second information, and the third information in addition to the fourth information will be described in detail in FIGS. 3 to 6.

In step S230, the electronic device (100) can control the first time section to be played back at the playback speed. For example, the electronic device (100) can control the first time section of the video to be played back at the playback speed determined in step S230. That is, based on the playback speed determined for each time section of the video, the playback speed of the video can be dynamically changed. Accordingly, the user's video viewing time can be reduced, and key scenes in the video can be emphasized and played back at regular speed or low speed.

FIG. 3 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on first information according to one embodiment.

In step S310, the electronic device (100) can determine whether a subtitle is included in the first time period based on the first information.

According to one embodiment, a portion of a video having a subtitle may be identified as a main scene within the video. In this regard, the electronic device (100) may extract first information about a subtitle of the first time period from data about the first time period of the video, and may determine whether a subtitle is included in the first time period based on the first information.

Here, the subtitles may include at least one of general subtitles and SDH (Subtitles for the Deaf and Hard of Hearing) subtitles that are generally displayed on the user's terminal. In addition, the subtitles may include subtitles expressed in various languages.

In step S320, the electronic device (100) can determine the playback speed based on whether a subtitle is included in the first time period.

According to one embodiment, if a subtitle is included in the first time section, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the video as the first value. Conversely, if a subtitle is not included in the first time section, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the video as the second value. Here, the speed corresponding to the first value may be a lower speed than the speed corresponding to the second value. For example, the first speed may be a regular speed and the second speed may be a high speed, but is not limited thereto.

According to one embodiment, based on the length of the subtitle included in the first time section, the electronic device (100) may determine the playback speed for the first time section of the image. More specifically, the electronic device (100) may determine the playback speed for the first time section of the image by comparing a value obtained by dividing the length of the subtitle by the first time section with a set value. Here, the length of the subtitle may correspond to the number of characters of the subtitle included in the first time section. If the value obtained by dividing the length of the subtitle by the first time section is greater than or equal to the set value, the electronic device (100) may determine the playback speed for the first time section of the image as the first value. If the value obtained by dividing the length of the subtitle by the first time section is less than the set value, the electronic device (100) may determine the playback speed for the first time section of the image as the second value. Here, the playback speed corresponding to the first value may be a lower playback speed than the playback speed corresponding to the second value. For example, the first speed may be a regular speed, the second speed may be a high speed, but is not limited thereto.

According to one embodiment, if a specific symbol (e.g., parentheses) is included in the SDH subtitle, the electronic device (100) may determine the playback speed for the first time section of the video as a fixed speed. More specifically, if a specific symbol is included in the SDH subtitle, the subtitle portion within the specific symbol may correspond to any one of a portion describing sound, a portion identifying a speaker, a portion describing voice tone and emotion, and a portion describing nonverbal elements, and thus may be a key scene within the video.

FIG. 4 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on second information according to one embodiment.

In step S410, the electronic device (100) can determine whether the frequency or size of the audio is greater than or equal to a set value or whether the audio of the first time period corresponds to a set pattern based on the second information.

According to one embodiment, since the frequency or size of the audio is greater than or equal to the set value, high-pitched or loud audio is played, the first time period including the audio having the frequency or size greater than or equal to the set value may be identified as corresponding to a main scene in the image. In addition, even if the audio of the first time period corresponds to the set pattern, the first time period may be identified as corresponding to a main scene in the image. Here, the set pattern may be a pattern in which the frequency or size of the audio changes rapidly within a short period of time, but is not limited thereto. In this regard, the electronic device (100) may extract second information about the audio of the first time period from data about the first time period of the image, and may determine based on the second information whether the frequency or size of the audio is greater than or equal to the set value or whether the audio of the first time period corresponds to the set pattern.

In step S420, the electronic device (100) can determine the playback speed based on whether the frequency or size of the audio is greater than or equal to a set value or whether the audio of the first time period corresponds to a set pattern.

According to one embodiment, if the frequency or size of the audio is equal to or greater than a set value or if the audio of the first time section corresponds to a set pattern, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the image as the first value. Conversely, if the frequency or size of the audio is less than the set value and if the audio of the first time section does not correspond to the set pattern, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the image as the second value. Here, the speed corresponding to the first value may be a lower speed than the speed corresponding to the second value. For example, the first speed may be a regular speed and the second speed may be a high speed, but is not limited thereto.

FIG. 5 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on second information according to one embodiment.

In step S510, the electronic device (100) can determine whether the audio includes a human voice and other voices based on the second information.

In one embodiment, if a human voice is included in the audio, the first time segment may be identified as corresponding to a main scene within the video. Conversely, if other voices are included in the audio, and the other voices are voices that are repeatedly played within the video, the first time segment may be identified as corresponding to a non-main scene within the video. In this regard, the electronic device (100) may extract second information about the audio of the first time segment from data about the first time segment of the video, and may determine whether the audio includes a human voice and other voices based on the second information.

In step S520, the electronic device (100) can determine the playback speed based on whether the audio includes human voice and other voices.

In one embodiment, when the audio includes a human voice, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the image as the first value. Conversely, when the audio includes other voices and the other voices are voices that are repeatedly played within the image, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the image as the second value. Here, the speed corresponding to the first value may be a lower speed than the speed corresponding to the second value. For example, the first speed may be a regular speed and the second speed may be a high speed, but is not limited thereto.

FIG. 6 is a flowchart illustrating a method for determining a playback speed of a specific time period of an image based on third information according to one embodiment.

In step S610, the electronic device (100) can determine whether a keyword is included in the first time period based on the first information, the second information, and the third information.

According to one embodiment, a first time interval including a keyword input by a user may be identified as corresponding to a main scene in a video. Here, the keyword may correspond to one of a keyword searched on a content streaming platform before the video is played and a keyword separately input by the user, but is not limited thereto. In addition, the inclusion of a keyword in the first time interval may mean that the first time interval includes a synonym of the keyword or a keyword translated into another language.

According to one embodiment, the electronic device (100) can determine whether a keyword is included in a subtitle of a first time period identified based on the first information. Alternatively, the electronic device (100) can determine whether a keyword is included in audio of the first time period identified based on the second information. That is, if a keyword is included in a subtitle or a keyword is included in audio, the electronic device (100) can determine that a keyword is included in the first time period.

In step S620, the electronic device (100) can determine the playback speed based on whether the keyword is included in the first time period.

According to one embodiment, if the keyword is included in the first time section, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the image as the first value. Conversely, if the keyword is not included in the first time section, the electronic device (100) according to one embodiment may determine the playback speed for the first time section of the image as the second value. Here, the speed corresponding to the first value may be a lower speed than the speed corresponding to the second value. For example, the first speed may be a regular speed and the second speed may be a high speed, but is not limited thereto.

In another embodiment, if a keyword is included in the first time interval, the first time interval may be skipped or played at high speed. For example, a user may pre-set a related keyword to skip a cruel scene, and if the keyword is included in the first time interval, the first time interval may be skipped or played at high speed. More specifically, if the keyword is included in the subtitle or audio, or if a plurality of frames included in the first time interval are identified as corresponding to the keyword through an artificial intelligence model, the first time interval may be skipped or played at high speed.

FIG. 7 is a flowchart illustrating a method for determining a playback speed of a specific time period of a video by checking whether a key scene is included in the specific time period based on an artificial intelligence model according to one embodiment.

In step S710, the electronic device (100) can determine whether a key scene is included in the first time period based on an artificial intelligence model that inputs information.

Here, the AI model may be an AI model trained to input information related to the video and output whether the main scene is included in the first time period of the video. In particular, since the judgment on whether the main scene is included in the first time period may differ depending on the genre of the video, the parameters of the AI model may be optimized by separating them according to information on the genre of the video.

According to one embodiment, if a change in an object (e.g., a person) included in a plurality of frames corresponding to the first time interval is less than or equal to a set value, the first time interval may be a period in which the object is played in slow motion. In relation to this, if a change in an object included in a plurality of frames corresponding to a specific time interval is less than or equal to a set value, the AI model may be trained to output that a key scene is included in the specific interval.

According to one embodiment, if the similarity between adjacent frames among a plurality of frames corresponding to the first time interval is less than or equal to a set value, the first time interval may be a section with a sharp scene change. In relation to this, if the similarity between adjacent frames among a plurality of frames corresponding to a specific time interval is less than or equal to a set value, the artificial intelligence model may be trained to output that a key scene is included in the specific section.

According to one embodiment, if the composition of the plurality of frames corresponding to the first time interval or the behavior of the object included in the plurality of frames satisfies the set condition, the first time interval may be a time interval including a main scene. According to one embodiment, the fact that the composition of the plurality of frames satisfies the set condition may include a case in which the composition of the plurality of frames is recognized as a main scene in the video, such as a composition related to action or a composition in which two characters are having a conversation. In addition, according to one embodiment, the fact that the behavior of the object included in the plurality of frames satisfies the set condition may include a case in which the behavior of the object included in the plurality of frames satisfies the set condition, such as a case in which the expression of the object is greatly changed or the behavior of the object is greatly recognized as a main scene for the object in the video. In relation to this, if the composition of the plurality of frames corresponding to a specific time interval or the behavior of the object included in the plurality of frames satisfies the set condition, the AI model may be trained to output that a main scene is included in the specific section.

In step S720, the electronic device (100) can determine the playback speed based on whether a main scene is included in the first time period.

According to one embodiment, the electronic device (100) can determine whether a main scene is included in the first time section through the learned artificial intelligence model. If the main scene is included in the first time section, the electronic device (100) according to one embodiment can determine a playback speed for the first time section of the video as a first value. Conversely, if the main scene is not included in the first time section, the electronic device (100) according to one embodiment can determine a playback speed for the first time section of the video as a second value. Here, the playback speed corresponding to the first value may be a lower playback speed than the playback speed corresponding to the second value. For example, the first playback speed may be a regular playback speed and the second playback speed may be a high playback speed, but is not limited thereto.

FIG. 8 is a flowchart illustrating a method for determining a playback speed of a specific time interval based on the playback speeds of adjacent time intervals according to one embodiment.

In step S810, the electronic device (100) can identify a second time period and a third time period adjacent to the first time period.

In step S820, the electronic device (100) can determine the playback speed for the first time period based on the playback speed for the second time period and the playback speed for the third time period.

As discussed above, if the electronic device (100) is a server related to a video streaming platform or if offline playback of a video is possible through the electronic device (100), the electronic device (100) can determine a playback speed of a specific time section based on an algorithm using information about all time sections of the video and information related to a specific time section. Here, the information about all time sections of the video can include a playback speed for a second time section adjacent to a first time section and a playback speed for a third time section.

According to one embodiment, the electronic device (100) may determine the playback speed for the first time interval so that the difference between the playback speed for the first time interval and the playback speed for the second time interval and the difference between the playback speed for the first time interval and the playback speed for the third time interval are small. In this regard, if the difference in playback speeds between adjacent time intervals is large, there is a concern that the video viewing experience of a user who views the video may be significantly impaired. Accordingly, the electronic device (100) may appropriately determine the playback speed for the first time interval based on the playback speed for the second time interval and the playback speed for the third time interval.

FIG. 9 is a diagram for explaining a playback speed for a specific time period according to one embodiment.

The screen (900) may correspond to any one of a plurality of frames included in a specific time period. More specifically, referring to the screen (900), the specific time period may include subtitles and audio. Referring to the screen (900), since the composition of two characters having a conversation satisfies the set condition, the artificial intelligence model may determine the screen (900) as a main scene. In addition, since multiple users who watched the video played the specific time period at regular speed, the playback speed for the specific time period including the frame corresponding to the screen (900) may be determined at regular speed.

FIG. 10 is a diagram for explaining a playback speed for a specific time period according to one embodiment.

The screen (1000) may correspond to any one of a plurality of frames included in a specific time period. More specifically, referring to the screen (1000), the specific time period may not include subtitles and may not include human voices. In addition, since a plurality of users who watched the video skipped the intro part of the video or played it at a high speed, the playback speed for the specific time period including the frame corresponding to the screen (1000) may be determined at a high speed. In this way, the playback speed for each time period of the video may be dynamically changed without damaging the user's video viewing experience.

FIG. 11 is a block diagram schematically illustrating an electronic device (100) for performing a method for changing video playback speed according to one embodiment.

The electronic device (100) of FIG. 11 may be an electronic device (100) for performing a method for changing a video playback speed. The electronic device (100) may include a transceiver (101), a storage (102), and one or more processors (103), according to an embodiment. The electronic device (100) illustrated in FIG. 11 illustrates only components related to the present embodiment. Therefore, it will be understood by those skilled in the art related to the present embodiment that other general-purpose components may be further included in addition to the components illustrated in FIG. 11.

For example, the electronic device (100) may include a transceiver (101) according to an embodiment. The transceiver (101) is a device for performing wired/wireless communication and may communicate with an external electronic device. In addition, the communication technology used by the transceiver (101) may include GSM (global system for mobile communication), CDMA (code division multi access), LTE (long term evolution), 5G, WLAN (wireless LAN), Wi-Fi (wireless-fidelity), Bluetooth, RFID (radio frequency identification), infrared data association (IrDA), ZigBee, and NFC (near field communication). According to an embodiment, the transceiver (101) may receive data per time period of an image in real time from a server (110).

The storage (102) can store information for performing at least one of the methods described above through FIGS. 1 to 11. The storage (102) can store one or more commands executed by one or more processors (103). The storage (102) can be referred to as a memory and can be a volatile memory or a nonvolatile memory. The storage (102) can store information related to each time section of the video. In addition, the storage (102) can temporarily store a playback speed for a first time section determined before the first time section is played back.

One or more processors (103) can control the overall operation of the electronic device (100) and process data and signals. The one or more processors (103) can perform one of the methods described above through FIGS. 1 to 11. The one or more processors (103) can be composed of at least one hardware unit. In addition, the one or more processors (103) can operate by one or more software modules generated by executing one or more commands stored in the storage (102). The one or more processors (103) can control embodiments performed by the electronic device (100) through interactions with the transceiver (101) and the storage (102), and further with components that the electronic device (100) can include.

According to one embodiment, the processor (103) may execute one or more commands so that the playback speed for a specific time period including a frame corresponding to the screen (900) can be determined at a constant speed.

Additionally, although not shown in FIG. 11, if the electronic device (100) is a user's terminal, the electronic device (100) may include a display. The image may be played back at a determined playback speed through the display.

Meanwhile, the present specification and drawings have disclosed preferred embodiments of the present invention, and although specific terms have been used, they have been used only in a general sense to easily explain the technical contents of the present invention and to help understand the invention, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modified examples based on the technical idea of the present invention can be implemented in addition to the embodiments disclosed herein.

The electronic device according to the above-described embodiments may include a processor, a memory for storing and executing program data, a permanent storage such as a disk drive, a communication port for communicating with an external device, a user interface device such as a touch panel, a key, an icon, etc. The methods implemented as software modules or algorithms may be stored on a computer-readable recording medium as computer-readable codes or program commands executable on the processor. Here, the computer-readable recording medium includes a magnetic storage medium (e.g., a read-only memory (ROM), a random-access memory (RAM), a floppy disk, a hard disk, etc.) and an optical reading medium (e.g., a CD-ROM, a Digital Versatile Disc (DVD)). The computer-readable recording medium may be distributed to computer systems connected to a network, so that the computer-readable code may be stored and executed in a distributed manner. The medium may be readable by a computer, stored in a memory, and executed by a processor.

The present embodiment may be represented by functional block configurations and various processing steps. These functional blocks may be implemented by various numbers of hardware and/or software configurations that perform specific functions. For example, the embodiment may employ integrated circuit configurations such as memory, processing, logic, look-up tables, etc., which may perform various functions under the control of one or more microprocessors or other control devices. Similarly to the fact that the components may be implemented as software programs or software elements, the present embodiment may be implemented in a programming or scripting language such as C, C++, Java, assembler, Python, etc., including various algorithms implemented as a combination of data structures, processes, routines, or other programming configurations. The functional aspects may be implemented as algorithms that are executed on one or more processors. In addition, the present embodiment may employ conventional techniques for electronic environment setting, signal processing, and/or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations. The terms may also include the meaning of a series of software processes (routines) in connection with a processor, etc.

The above-described embodiments are only examples, and other embodiments may be implemented within the scope of the claims set forth herein.

Claims (17)

A method for changing the video playback speed of an electronic device,
A step of checking a first time period of a video and information related to the first time period;
A step of determining a playback speed for the first time period based on an algorithm using the above information; and
Including a step of controlling the first time interval to be played back at the playback speed;
The above information is,
Contains second information about the audio of the first time period,
The step of determining the above playback speed is:
A step of determining whether the audio includes a human voice and other voices based on the second information; and
Comprising a step of determining the playback speed based on whether the audio includes the human voice and the other voice,
The step of determining the above playback speed is:
Including a step of determining the playback speed as a first value when the audio includes the human voice, and determining the playback speed as a second value when the audio includes the other voice,
The above first value is smaller than the above second value,
The above other voices are,
The voice that is played repeatedly in the above video,
How to change video playback speed.
In the first paragraph,
The above information is,
Including at least one of first information about subtitles of the first time period, third information about keywords related to the video, and fourth information about playback speeds of multiple users who watched the video in the first time period.
How to change video playback speed.
In the second paragraph,
The step of determining the above playback speed is:
When the above information includes multiple pieces of information, a step of calculating multiple values corresponding to each piece of the above information based on the above algorithm using each piece of the above information; and
A step of determining the playback speed based on a plurality of weights and a plurality of values corresponding to each of the plurality of pieces of information,
How to change video playback speed.
In the third paragraph,
The above multiple weights are,
Based on information about the genre of the above video,
How to change video playback speed.
In the second paragraph,
The step of determining the above playback speed is:
A step of checking whether a subtitle is included in the first time period based on the first information; and
Comprising a step of determining the playback speed based on whether the first time interval includes a subtitle,
How to change video playback speed.
In clause 5,
The step of determining the above playback speed is:
a step of determining the playback speed as a first value when a subtitle is included in the first time interval; and
In the case where the subtitle is not included in the first time interval, a step of determining the playback speed as a second value is included.
The above first value is smaller than the above second value,
How to change video playback speed.
In the first paragraph,
The step of determining the above playback speed is:
A step of determining whether the frequency or size of the audio is greater than or equal to a set value or whether the audio of the first time period corresponds to a set pattern based on the second information;
A step of determining the playback speed based on whether the frequency or size of the audio is greater than or equal to the set value or whether the audio of the first time period corresponds to the set pattern.
How to change video playback speed.
delete In the second paragraph,
The step of determining the above playback speed is:
A step of checking whether the keyword is included in the first time period based on the first information, the second information, and the third information; and
A step of determining the playback speed based on whether the keyword is included in the first time interval,
How to change video playback speed.
In the second paragraph,
The step of determining the above playback speed is:
comprising a step of determining the playback speed corresponding to the fourth information;
How to change video playback speed.
In the third paragraph,
The step of determining the above playback speed is:
A step of checking whether a key scene is included in the first time period based on an artificial intelligence model that inputs the above information; and
Further comprising a step of determining the playback speed based on whether the main scene is included in the first time period.
How to change video playback speed.
In Article 11,
The above artificial intelligence model is,
An artificial intelligence model trained to output that the main scene is included in the first time period when the change of the object included in the plurality of frames corresponding to the first time period is less than or equal to a set value.
How to change video playback speed.
In Article 11,
The above artificial intelligence model is,
An artificial intelligence model trained to output that the main scene is included in the first time period when the composition of a plurality of frames corresponding to the first time period or the behavior of an object included in the plurality of frames satisfies a set condition.
How to change video playback speed.
In the first paragraph,
The step of determining the playback speed for the above first time interval is:
A step of confirming a second time period and a third time period adjacent to the first time period; and
A step of determining a playback speed for the first time interval based on the playback speed for the second time interval and the playback speed for the third time interval,
How to change video playback speed.
In the first paragraph,
The step of determining the above playback speed is:
A step of determining the playback speed based on the algorithm using information about all time periods of the video and information related to the first time period,
How to change video playback speed.
As an electronic device,
transceiver;
one or more processors; and
comprising storage for storing one or more instructions executed by said one or more processors;
The one or more processors, by executing the one or more instructions,
Check the first time period of the video and the information related to the first time period,
Based on the algorithm using the above information, the playback speed for the first time period is determined, and
Controlling the above first time interval to be played at the above playback speed,
The above information is,
Contains second information about the audio of the first time period,
One or more of the above processors,
Based on the second information, it is determined whether the audio includes a human voice and other voices, and based on whether the audio includes the human voice and other voices, the playback speed is determined.
One or more of the above processors,
If the audio includes the human voice, the playback speed is determined as a first value, and if the audio includes the other voice, the playback speed is determined as a second value.
The above first value is smaller than the above second value,
The above other voices are,
The voice that is played repeatedly in the above video,
Electronic devices.
A non-transitory computer-readable recording medium having recorded thereon a program for executing a method for changing the video playback speed according to any one of claims 1 to 7 and claims 9 to 15 on a computer.

Images