KR20160027886A - Method and portable terminal having bended display unit and cover for executing application - Google Patents

Abstract

A portable terminal apparatus is disclosed. This apparatus displays a UI element corresponding to an application in a side display area of a vender display while a front display area of a vender display and a vender display including a front display area and a side display area is covered with a cover, Wherein the application is executed in response to at least one UI element of the at least one UI element and the application corresponding to at least one UI element in which the touch is detected according to the opening of the cover, And a control unit for controlling the display

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal having a bendable display and a cover,

The present invention relates to a portable terminal having a bendable display and a cover, and a method for executing the application. More particularly, the UI element displayed in the side display area is selected from a bended display including a front display area and a side display area And a method and apparatus for detecting an opening of a cover and executing an application corresponding to a selected UI element.

2. Description of the Related Art [0002] With the recent development of digital technology, portable terminals such as a mobile communication terminal, a PDA (Personal Digital Assistant), an electronic notebook, a smart phone, a tablet PC, . Such a portable terminal can be used for various applications such as voice communication, message transmission such as SMS (Short Message Service) / MMS (Multimedia Message Service), video call, electronic notebook, photographing, e-mail transmission / reception, (SNS, Social Networking Service), messenger, dictionary, game, and so on.

In recent years, a cover for protecting a display unit is mounted on a portable terminal. In this case, the display area of the display unit may be turned on or off depending on whether the cover is opened or closed.

However, there has been a problem in that, in order to allow a user to execute an application of the portable terminal in a state that the display portion of the portable terminal is covered with the cover, the cover must be opened and the related application must be selected and executed.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal and a screen display control method thereof that can extend a display area to a side as well as a front side by implementing a bended display.

It is another object of the present invention to provide a portable terminal having a bendable display, which divides the bendable display into a front display area and a side display area, and simultaneously displays execution screens of two or more different applications using the front display area and the side display area And a multitasking method.

It is still another object of the present invention to provide a method of providing an application cover according to user interaction in a side display area of a bendable display by providing a cover capable of covering a front display area of the bendable display.

According to an aspect of the present invention, there is provided a portable terminal including a front display area and a side display area, the front display area of the front display being covered with a cover Displaying a UI element corresponding to an application in a side display area of the bendable display; Sensing touch of at least one UI element among the UI elements and opening of the cover; And an execution step of executing an application corresponding to the detected UI element based on the opening of the cover and displaying an execution screen of the application on the front display area. Here, the UI element may be an icon for executing the application.

The method of claim 1, wherein when the touch of a plurality of UI elements among the UI elements is detected and the cover is opened, a plurality of applications corresponding to the plurality of UI elements detected by the touch are executed, Can be displayed on the front display area. The execution screens of the plurality of applications may be displayed in a plurality of windows, respectively.

Wherein when the cover is opened while the first application is being executed in the portable terminal, the execution step may include displaying an execution screen of the second application corresponding to the UI element in which the touch is sensed and an execution screen of the first application Can be simultaneously displayed on the front display area.

The execution step may include displaying the execution screen of the first application being executed in the side display area when the cover is opened while the first application is running in the portable terminal, The execution screen of the second application corresponding to the second application can be displayed on the front display area.

When a touch is detected in one of the UI elements displayed in the side display area and the touch is continued for a predetermined time, the menu item of the application corresponding to the UI element detected by the touch is displayed on the side display area It is also possible to detect the touch of one of the menu items and the opening of the cover and perform the function of the application corresponding to the item based on the opening of the cover.

In another aspect of the present invention, there is provided a method for displaying an execution screen of a first application in a front display area of a vender display in a mobile terminal having a vender display including a front display area and a side display area step; Sensing that the front display area is covered with a cover; And displaying the first UI element corresponding to the first application on the side display area based on the covering of the cover. At least one UI element corresponding to the application that has been executed here is arranged and displayed in the side display area according to the application execution time order, and the first UI element is displayed in the most recently executed order .

According to another aspect of the present invention, there is provided a portable terminal including: a bendable display including a front display area and a side display area; And displaying a UI element corresponding to an application on a side display area of the bendable display in a state that a front display area of the bendied display is covered with a cover, wherein a touch of at least one UI element among the UI elements, And a control unit for executing the application corresponding to at least one UI element in which the touch is sensed and controlling the vended display such that an execution screen of the application is displayed in the front display area have.

Here, the UI element may be an icon for executing the application. The controller may execute a plurality of applications corresponding to the plurality of UI elements in which the touch is detected when a touch of a plurality of UI elements and opening of the cover are detected, The bendable display can be controlled to display a screen on the front display area. The execution screens of the plurality of applications may be displayed in a plurality of windows, respectively.

In addition, when the cover is opened while the first application is running, the control unit displays the execution screen of the second application corresponding to the UI element in which the touch is sensed and the execution screen of the first application Can be controlled to be simultaneously displayed on the front display area.

In addition, when the cover is opened while the first application is running, the control unit displays the execution screen of the first application being executed in the side display area according to the opening of the cover, 2 application can control the vended display to display in the front display area. In addition, when the touch is sensed in one UI element and the touch is continued for a predetermined time, the control unit displays the menu item of the application corresponding to the UI element in which the touch is detected on the side display area, Can be controlled. Also, the controller may perform the function of the application corresponding to the item when the opening of the cover is sensed in a state that the touch is sensed by one of the menu items.

According to another aspect of the present invention, there is provided a portable terminal including: a bendable display including a front display area and a side display area; And displaying an execution screen of a first application in a front display area of the bendable display and displaying a first UI element corresponding to the first application on the side display area when the front display area is covered with a cover, And a control unit for controlling the bendable display. Wherein the control unit arranges and displays at least one UI element corresponding to an application that has been executed in the side display area in accordance with an application execution time order and the first UI element is the one most recently executed in time order The bendable display can be controlled to be displayed in an aligned manner.

As described above, according to various embodiments of the present invention, the display area can be expanded more easily by extending the bendable display with one end to the side of the portable terminal. The bendable display may be divided into a front display area and a side display area, and a notification event may be supported using the side display area. Accordingly, in various embodiments of the present invention, even if the user does not utilize the front display area, it is possible to more intuitively confirm the event information based on the side display area.

Also, according to various embodiments of the present invention, when the notification event occurs, the status of the portable terminal can be checked, and event information of the generated notification event can be processed in a mode corresponding to the checked status. For example, event information corresponding to a notification event is output using various display situations where the main display area of the vended display is not used, that is, a side display area of the visual display corresponding to the manners notification mode, Event information corresponding to the notification event can be output through at least one display area based on the user setting among the main display area and the side display area corresponding to the normal mode. Accordingly, it is possible to cope with a variety of notification events such as call reception, message reception, push service reception, and SNS notification reception to the portable terminal, thereby improving user convenience.

Various embodiments of the present invention may be implemented in all types of portable terminals and corresponding devices. In addition, according to various embodiments of the present invention, it is possible to implement an optimal environment for outputting event information for each state of the portable terminal, thereby contributing to improving usability, convenience, and competitiveness of the portable terminal.

1 is a diagram showing an example of a portable terminal having a cover and a bendable display according to an embodiment of the present invention.
2 is a view schematically showing a configuration of a portable terminal according to an embodiment of the present invention.
FIGS. 3 to 10 are diagrams showing a user interaction in a side display area of a mobile terminal having a bended display and a method of executing an application according to the open / closed state of the cover.
11 to 12 are flowcharts illustrating a process of executing an application by detecting the opening of the UI element and the cover displayed in the side display area.

BRIEF DESCRIPTION OF THE DRAWINGS The terminology used herein will be briefly described, and the present disclosure will be described in detail.

Although the terms used in the embodiments of the present invention have been selected in consideration of the functions in the present disclosure and are capable of being used in general terms that are currently widely used, they may vary depending on the intention or circumstance of a person skilled in the art, . Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Accordingly, the terms used in the present disclosure should not be construed as merely descriptive terms, but rather should be defined based on the meaning of the terms and throughout the present invention.

Embodiments of the present invention are capable of various transformations and may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the description. It is to be understood, however, that it is not intended to limit the scope of the specific embodiments but includes all transformations, equivalents, and alternatives falling within the spirit and scope of the disclosure disclosed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise", "comprising" and the like are used to specify that there is a stated feature, number, step, operation, element, component, or combination thereof, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In the exemplary embodiments of the present invention, 'module' or 'sub' performs at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which need to be implemented by specific hardware, and implemented by at least one processor (not shown) .

In an embodiment of the present invention, when a portion is referred to as being "connected" to another portion, it may be referred to as being "directly connected", as well as "electrically connected" . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the present disclosure may be embodied in many different forms and is not limited to the embodiments described herein. In order that the present disclosure may be more fully understood, the same reference numbers are used throughout the specification to refer to the same or like parts.

In an embodiment of the present invention, the cover may be an object or an apparatus for protecting the display by covering a part or all of the display area of the portable terminal. The cover may be electrically or non-electrically connected to the portable terminal. In addition, the cover may be communicatively connected to the portable terminal. In addition, the cover may be sold separately to / from the portable terminal, or may be integrally formed and sold together with the portable terminal.

Also, in an embodiment of the present invention, the user input may include at least one of a touch input, a bending input, a voice input, a button input, and a multimodal input, but is not limited thereto.

Further, in the embodiment of the present invention, "touch input" means a touch gesture or the like that the user performs on the display and the cover to control the apparatus. In addition, the "touch input" may include a touch (e.g., floating or hovering) that is not touched on the display and is spaced apart by a certain distance. The touch input includes a touch & hold gesture, a tab gesture for releasing after touch, a double tap gesture, a panning gesture, a flick gesture, a touch & drag movement in one direction after touch, Gestures, pinch gestures, and the like.

Further, in the embodiment of the present invention, "button input" means an input by which a user uses a physical button attached to the apparatus to control the apparatus.

Further, in the embodiment of the present invention, "motion input" means motion in which the user applies to the apparatus to control the apparatus. For example, the motion input may include inputs by which the user rotates the device, tilts the device, or moves the device up, down, left, and right.

Further, in the embodiment of the present invention, "multiple input" means that at least two input methods are combined. For example, the device may receive the user's touch input and motion input, and may also receive the user's touch input and voice input.

Further, in the embodiment of the present invention, "application" refers to a set of computer programs designed to perform a specific task. In an embodiment of the invention, the application may be varied. But are not limited to, a gaming application, a video playback application, a map application, a memo application, a calendar application, a phonebook application, a broadcast application, a motion support application, a payment application, a photo folder application and the like.

Further, in the embodiment of the present invention, the "application identification information" may be unique information for distinguishing the application from other applications. For example, the identification information of the application may be an icon, an index item, link information, and the like, but is not limited thereto.

Further, in the embodiment of the present invention, the UI (User Interaction) element means an element capable of interacting with a user and capable of visual, auditory, and olfactory feedback according to user input. The UI element may be expressed in the form of at least one of an image, a text, and a moving image, or may be a UI element if the above information is not displayed but there is an area where feedback can be performed according to user input. In one example, the UI element may be the above-described application identification information. In addition, the UI element may be information provided to the user in accordance with the occurrence of the event.

Also, in the embodiment of the present invention, the window may be a divided screen. For example, "two windows" can be understood as one screen divided into two.

Also, as used in the description and the claims, "simultaneously" can be interpreted as having " temporally overlapping intervals ".

Hereinafter, a configuration of a mobile terminal and an application execution method according to an embodiment of the present invention will be described with reference to the following drawings. It should be noted that the configuration of the mobile terminal and the method of executing the application according to the embodiment of the present invention are not limited to or limited to the following description, and thus can be applied to various embodiments based on the following embodiments.

.

1 is a diagram showing an example of a portable terminal having a cover and a bendable display according to an embodiment of the present invention.

1, a mobile terminal includes a main body 200 to which the bendable display 100 and the bendable display 100 are seated, and a main body 200, which is formed in the main body 200, And the like. 1, the additional device may include a speaker 301, a microphone (not shown), a sensor module (in particular, an illuminance sensor 303, a front camera module 305, etc.), a physical button (not shown) .

The bendable display 100 is a display device that can be bent, and is characterized in that it can bend, bend or speak without damaging through a thin and flexible substrate, such as paper. Since the bendable display 100 uses a plastic substrate instead of a glass substrate that is generally used, it can be formed using a low-temperature manufacturing processor without using a conventional manufacturing processor in order to prevent damage to the substrate. The bendable display 100 may be a liquid crystal display (LCD), a light emitting diode (LED), an organic light emitting diode (OLED), an active matrix organic light emitting diode (OLED) The plastic substrate can be replaced with a plastic film to give flexibility to be folded and unfolded. The bent display 100 is advantageous in that it is thin and light as well as resistant to impact, and can be bent or bent as described above, and can be manufactured in various forms.

In the exemplary embodiment of the present invention, the bended display 100 may include an active matrix screen of a specific screen size (for example, 3 inches, 4 inches, 4.65 inches, 5 inches, 6.5 inches, 8.4 inches, matrix screen and extends to at least one side (e.g., at least one side of the left, right, upper, and lower sides) of the portable terminal, so that the bendable display 100 can operate in a radius of curvature For example, a radius of curvature of 5 cm, 1 cm, 7.5 mm, 5 mm, 4 mm, etc.). In the present invention, a display area appearing on the front surface of the vended display 100 is referred to as a front display area 110, and is bent from at least one side of the main body 200 to extend from the front display area, The display region appearing on the side surface of the display region 200 will be referred to as a side display region 120. [

The front display area 110 and the side display area 120 are divided for the convenience of description of the present invention. The front display area 110 and the side display area 120 may include at least one The bendable shape of the end can be realized by a single bended display 100 in which at least one end that is bent extends to at least one side of the portable terminal. In addition, it can be realized by a single bent display 100 in which at least one end bent is extended to the rear surface of the portable terminal.

Therefore, in the present specification, the front area formed on the plane with reference to the front side of the portable terminal is referred to as a front display area 110, and the display area formed on the side with respect to the front side of the portable terminal is referred to as a side display area 120 . That is, the present invention is embodied by a single bend display 100 having a front display area 110 on the front of the portable terminal and a side display area 120 on the side of the portable terminal, which are configured as an "integral type".

Also, in this embodiment, if the portable terminal is in multi tasking, the mobile terminal can display the execution screen of the application being multitasking by using the front display area 110 and the side display area 120. [

For example, when the web browser application and the music player application are executed by multitasking, a web browsing screen can be displayed in the front display area 110, and a control for controlling the reproduction of the music player can be displayed in the side display area 120 The button 120a and the title 120b of the music being reproduced can be displayed. Accordingly, the user can increase the volume of the currently playing music by using the side display area 120 while listening to music, or change the music being played back to another one. Also, the user can browse the web using the front display area 110 while listening to music.

In addition, when the gallery application and the music player application are executed by multi-tasking, a picture may be displayed in the front display area 110 and a control button for controlling reproduction of the music player may be displayed in the side display area 120 . Accordingly, the user can increase the volume of the currently playing music by using the side display area 120 while listening to music, or change the music being played back to another one. In addition, the user can view the photograph displayed on the front display area 110 while listening to music.

1, the bendable display 100 can be divided into a front display area 110 on the front side and a side display area 120 on the side. The portable terminal can provide a UI element (User Interface Element) using the side display area 120. The UI element may include an icon for executing the application and graphics and characters for providing information to the user.

According to the embodiment of the present invention, the execution screen of the application can be displayed in the front display area 110 in the portable terminal. Further, the portable terminal can display UI elements related to the application, for example, icons 381, 383, 385, 387, and 389 for executing applications in the side display area. In addition, the portable terminal can display a notification message when a notification event occurs in the side display area.

The cover 800 is detachably coupled to the portable terminal and can be opened or closed by a user. The cover may cover the front display area. When the cover is closed, the front display area is not exposed to the outside, but the side display area can be exposed to the outside. When the cover is closed, the portable terminal can receive the user input in the side display area not covered by the cover and display a certain function or information in response to the user input in the side display area. The lower drawing of Fig. 1 shows a state in which the cover 800 is covered. When the cover 800 is covered, the portable terminal displays various UI elements 381, 383, 385, 387, and 389 on the side display area 120. Although the UI element is shown as an icon in FIG. 1, the UI element is not necessarily limited to this. The user can touch a UI element displayed in the side display area to execute a desired application or perform a desired application function.

When the cover is opened or closed, the value of the electric signal output from the sensor module may be changed, and the controller may determine the 'open' or 'closed' state of the cover from the value of the electric signal output from the sensor module. For example, a value of "1" may be output from the sensor module when the cover is open, and a value of "0" may be output from the sensor module when the cover is closed. The opening and closing of the cover can be detected by the illuminance sensor 305, the proximity sensor (not shown) and / or the hall sensor (not shown). When the cover has a magnet, the portable terminal can detect the opening / closing degree of the cover and the opening / closing degree using the hall sensor.

2 is a view schematically showing a configuration of a portable terminal according to an embodiment of the present invention. Referring to FIG. 2, the communication module 310, the vended display 100, the sensor module 330, the storage unit 350, and the control unit 390 are included. In addition, the portable terminal may include an audio processing unit including a microphone and a speaker, a digital broadcasting module for receiving digital broadcasting (e.g., mobile broadcasting such as DMB (Digital Multimedia Broadcasting) or DVB (Digital Video Broadcasting)), And communication functions based on short-range wireless communication such as camera module for dynamic image capture, Bluetooth (BLUETOOTH) communication, IrDA (Infrared Data Association) communication, RFID (Radio Frequency Identification) communication and NFC And a battery for supplying power to the above-described components. However, the present invention is not limited thereto, and the present invention is not limited thereto. Description and illustration are omitted.

The communication module 310 supports communication with an external server or another portable terminal through a communication network. In the present invention, the communication module 100 may include a radio frequency (RF) module for supporting mobile communication services such as voice call, video call, and data communication based on mobile communication. In addition, the communication module 100 may support Internet communication services such as IP (Internet Protocol) based voice call, video call, and data communication. In particular, the communication module 100 may receive a notification event from an external server or another portable terminal. In the present invention, the communication module 100 is not limited to a specific communication module or a communication method, but may be implemented by various types of communication modules that allow a portable terminal to communicate with an external server or another portable terminal .

The vended display 100 may display a screen related to an operation state of the portable terminal. For example, the vended display 100 may include a home screen of a mobile terminal, a menu screen, a call origination / reception screen, a message creation / reception screen, a chat screen, Can be displayed.

The bendable display 100 is divided into a front display area 110 and a side display area 120 and can display the UI elements through the side display area 120. The UI element may be event information according to a notification event such as call reception, message reception, information reception according to the push service, information reception according to the SNS, and the like. The UI element may be an icon for executing an application and a part of an execution screen according to an execution result of the application. An operation example of operating the side display area 120 of the vended display 100 will be described later.

As the bendable display 100, an LCD is generally used, but other display devices such as LED, OLED, AMOLED and the like may be used. In addition, the vended display 100 may include an interface for supporting a touch-based input. For example, the bendable display 100 supports a variety of touch-based user input by a touch-screen configuration, generates an input signal according to a user input, and transmits the input signal to the controller 390 . In addition, when the various displays as described above are displayed, the bendied display 100 displays a screen in a horizontal mode, a screen in a vertical mode, a horizontal mode, and a vertical mode according to the rotation direction It is possible to support the adaptive screen switching display according to the change between the modes.

The sensor module 330 detects a change depending on the opening / closing degree and / or the degree of the cover, and can transmit a corresponding value, that is, an electrical signal to the controller 390. Also, the sensor module 330 may detect at least one of various changes such as a posture change, an illumination change, an acceleration change, etc. of the portable terminal, and may transmit a corresponding value, that is, an electric signal to the controller 390.

In the present invention, the sensor module 330 may be composed of various sensors. When the portable terminal is driven (or user setting), power is supplied to at least one sensor set under the control of the controller 390, And / or < / RTI >

The sensor module 330 may include at least one of all types of sensing devices capable of detecting a state change of the portable terminal depending on whether the cover is opened and closed and / . For example, the sensor module 330 may include a Hall sensor, an Acceleration sensor, a Gyro sensor, an illuminance sensor, a proximity sensor, a pressure sensor, a sensor, a sensor, a noise sensor (e.g., a microphone), a video sensor (e.g., a camera module), and a timer.

A state in which the front display area 110 is obscured by the cover 800 of the portable terminal in the embodiment of the present invention) may be detected by a combination of at least one of an illuminance sensor, a proximity sensor and a hall sensor The operation is explained as an example.

That is, in the example of the present invention, one or more sensors can be used to detect whether the cover is open or closed and / or the degree of accuracy.

Here, it is assumed that the sensor module 330 is the illuminance sensor, and the operation of detecting the opening / closing degree and / or the degree of the cover will be described with reference to FIG. Referring to FIG. 2, the sensor module 330 is supplied with power under the control of the controller 390 and may output different values according to whether the cover is opened and closed and / or the degree of the cover.

The storage unit 350 stores various applications and data processed and processed by the mobile terminal, and may be constituted by one or more nonvolatile memories and volatile memories. The storage unit 350 may be a ROM (Read Only Memory), a flash memory, a RAM (Random Access Memory), an internal hard disk (HDD), an external hard disk, As shown in FIG. The storage unit 350 stores programs and data related to the operating system of the portable terminal, the display control operation of the vender display 100, the degree of opening / closing of the cover 800 using the sensor module 330, It is possible to continuously or temporarily store a program and data related to the state detection of the portable terminal and the control operation corresponding thereto. In particular, the storage unit 350 may store configuration information 370 related to the operation of the front display area 110 and the side display area 120 of the vended display 100.

.

The control unit 390 controls the overall operation of the mobile terminal. In particular, the control unit 390 can display an application execution screen in the front display area and the side display area according to whether the cover is opened and closed and / or the accuracy in the embodiment of the present invention. The application execution screen may be a screen displayed according to the execution result of the application.

 The controller 390 controls the display area of the front display area 110 and the side display area 120 so that the front display area of the bendable display is covered with the cover, Lt; RTI ID = 0.0 > UI < / RTI > That is, only one UI element may be displayed in the side display area, or a plurality of UI elements may be displayed. Also, the control unit may detect a touch in at least one UI element among the UI elements, and may execute an application corresponding to the at least one UI element in which the touch is sensed according to opening of the cover. Further, the control unit 390 may control the vended display to display an execution screen of the application on the front display area. The UI element may be an icon for executing an application.

The control unit may execute a plurality of applications corresponding to the plurality of UI elements in which the touch is sensed when detecting touch of a plurality of UI elements among the UI elements and detecting opening of the cover, Can be displayed on the front display area. The execution screens of the plurality of applications may be displayed in a plurality of windows, respectively.

In addition, when the first application is running before the cover is opened, the control unit displays the execution screen of the second application corresponding to the UI element in which the touch is sensed and the execution screen of the first application being executed in the front display area The bendable display can be controlled to be displayed simultaneously.

When the first application is running before the cover is opened in the portable terminal, the control unit displays the execution screen of the first application being executed in the side display area, and the second application corresponding to the selected UI element The control unit may control the bend display to display the execution screen in the front display area.

Further, the control unit displays the execution screen of the first application in the front display area of the vended display including the front display area and the side display area, displays the UI element corresponding to the application in the side display area of the vended display The control unit may detect that the front display area is covered with the cover and control the vended display to display the first UI element corresponding to the first application on the side display area.

Also, the control unit displays the UI elements in the side display area in the time sequence in which the applications are executed, and controls the vended display to arrange the first UI elements in chronological order .

In addition, when the touch is detected in one UI element, the controller detects the duration of the touch, and when the duration of the touch is longer than a predetermined time, the controller displays a menu item of the application corresponding to the detected UI element The bendable display can be controlled so as to be displayed on the side display area.

Here, the UI elements may be arranged and displayed in the side display area in the time sequence in which the applications are executed, and the first UI elements may be sorted and displayed in the most recently executed order.

As described above, the control unit 390 can control the overall operation of the functional operation of the present invention, and detailed control operations of the control unit 390 will be described with reference to the operation example of the portable terminal and the control method thereof, Will be. In addition to the functions described above, the controller 390 may control various operations related to the normal functions of the mobile terminal.

For example, the control unit 390 can control its operation and screen display when executing a specific application. Also, the controller 390 may receive an input signal corresponding to various touch interaction inputs supported by the touch-based input interface, and control the function operation accordingly. Also, the controller 390 can control transmission / reception of various data based on a wired communication or a wireless communication.

The portable terminal of FIG. 2 may include all information communication devices, multimedia devices, and application devices supporting the functions of the present invention. For example, the mobile terminal may include a mobile communication terminal operating based on communication protocols corresponding to various communication systems, a tablet PC (personal computer), a smart phone, a digital camera, A portable multimedia player (PMP), a media player, a portable game terminal, and a PDA (Personal Digital Assistant).

FIGS. 3 to 10 are diagrams showing a user interaction in a side display area of a mobile terminal having a bended display and a method of executing an application according to the open / closed state of the cover.

Referring to FIG. 3, a front display area of the bendable display of the portable terminal 200 is covered with a cover 800, and a side display area 120 is exposed to the outside. At least one UI element 381, 383, 385, 387, 389 corresponding to the application may be displayed in the side display area 120. The UI element may be an icon for executing an application. Alternatively, the UI element may be graphics and text representing information about the execution result of the application. Or the UI element may be a notification message. In the following description, it is assumed that a plurality of UI elements displayed in the side display area are displayed. However, even when one UI element is displayed in the side display area, the embodiment of the present invention can be similarly applied.

The UI elements 381, 383, 385, 387, and 389 corresponding to the application can be displayed in the side display area 120 of the vender display while the front display area of the vender display is covered with the cover. In other words, a plurality of UI elements 381, 383, 385, 387, and 389 may be displayed in the side display area 120. The UI elements 381, 383, 385, 387, and 389 displayed in the side display area 120 may be UI elements corresponding to the previously executed application. A, B, C, D, and E, for example, when the applications "A", "B", "C", "D" May be an icon corresponding to "

When the user selects at least one UI element among the UI elements 381, 383, 385, 387, and 389 displayed in the side display area 120 and opens the cover, the control unit performs a touch operation on at least one UI element among the UI elements And sense the opening of the cover.

The user can select the UI element by touching the UI element of one of the UI elements 381, 383, 385, 387, and 389. [ That is, when the user selects one UI element, the control unit can detect the touch in one UI element.

When the user selects two UI elements, the control unit can detect the touch on the two UI elements. The control unit can execute the application corresponding to the UI element 381 selected by the user and control the vended display so that the execution screen of the application is displayed in the front display area 110. [

The user can select the UI element 381 by touching the UI element 381 displayed in the side display area. When the user touches the UI element 381, the controller senses the touch in the side display area 120 and determines whether to execute the application corresponding to the UI element 381 according to whether the cover is open or closed. Whether the cover is open or closed indicates two states of the cover "open" or "close". The degree of opening / closing of the cover means the extent to which the cover is opened. The opening and closing degree of the cover can be expressed by an angle. For example, the cover can be opened 30 degrees with respect to the front display area, and 80 degrees with respect to the front display area.

The control unit receives an electrical signal from the sensor module according to the opening and closing of the cover, and thereby determines whether the cover is opened and closed and / or the degree.

For example, when the cover is closed, the sensor module can output an electric signal corresponding to the value of "0 " to the control unit. With the cover open, the sensor module can output an electrical signal corresponding to the value of "1 " to the control unit. The control unit can determine that the cover is closed when an electric signal corresponding to "0" is received in the sensor module. The control unit can determine that the cover is opened when an electric signal corresponding to "1" is received in the sensor module. Here, the electric signals corresponding to "0" and "1"

If the sensor module is an illuminance sensor, an electrical signal corresponding to "0" may be output if the cover is closed. When the cover is opened, an electric signal corresponding to "1" can be outputted.

When the cover is closed, the control unit can display the UI display elements corresponding to the application in the side display area 120 and the front display area of the vender display turn off the screen, and the UI display part 120 displays the UI elements 381, 383, 385, 387 and 389 corresponding to the application. The UI elements 381, 383, 385, 387, and 389 corresponding to the application may be icons for executing the application. The UI element 381 is an icon that executes the application "A", the UI element 383 is an icon that executes the application "B", the UI element 385 is an icon that executes the application "C" The icon 387 is an icon that executes the application "D", and the UI element 389 is an icon that executes the application "E".

When the user touches and selects at least one UI element 381 among the UI elements 381, 383, 385, 387 and 389 displayed in the side display area and opens the cover, the application "A" corresponding to the UI element 381 is selected. And the execution screen of the application "A" can be displayed in the front display area 110. [

The control unit receives the coordinates of where the touch is detected, and can determine which UI element corresponds to the coordinates. That is, the control unit can determine what the UI element is selected by the user based on the touch input of the user, and can execute the application corresponding to the UI element. Further, the control unit may control the vended display so that the execution screen of the application is displayed in the front display area.

4, the front display area 110 of the bendable display of the portable terminal 200 is covered with a cover 800, and the side display area 120 is exposed to the outside. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed in the side display area 120. [ The UI elements 381, 383, 385, 387, and 389 may be icons for executing an application. The UI element may also be a graphic and text representing information about the result of executing the application.

A plurality of UI elements 381, 383, 385, 387, and 389 may be displayed in the UI display, that is, the side display area 120, in the side display area 120. [ The UI element displayed in the side display area 120 may be an icon corresponding to an application that has been executed previously.

The user can simultaneously touch and select two or more UI elements among the UI elements displayed in the side display area 120. [ When the user opens the cover 800 with the plurality of UI elements 381 and 385 selected among the UI elements 381, 383, 385, 387 and 389 displayed in the side display area 120, The application corresponding to the elements 381 and 385 is executed and the execution screen of the application can be displayed in the front display area 110. [ At this time, a plurality of windows 110a and 110b may be displayed in the front display area 110, and an execution screen of the application may be displayed in each window. A window can be a split screen.

The execution window of the application corresponding to the UI element 381 is displayed in one window 110a of the plurality of windows 110a and 110b and the execution window of the application corresponding to the UI element 385 is displayed in the other window 110b. An execution screen may be displayed. Each application can be run with multitasking.

In addition, when three UI elements are selected and the cover is opened, three windows can be displayed in the front display area. As another example, when three UI elements are selected and the cover is opened, two windows are displayed in the front display area, and two applications can be displayed in each window. The other one application can be displayed in the side display area.

For example, when the user selects two UI elements out of the UI elements displayed in the side display area 120 and opens the cover, two applications corresponding to the selected two UI elements are executed, and two application execution screens Can be displayed on the front display area. The two applications can be displayed in two windows. That is, the front display area can be divided into two screens of up and down or right and left, and can be displayed on each divided screen (window).

When the user selects three UI elements among the UI elements displayed in the side display area 120 and opens the cover, three applications corresponding to the selected three UI elements are executed, and three application execution screens are displayed in the front display area Can be displayed. Three applications can be displayed in three windows. That is, the front display area is divided into three screens of up and down or left and right, and can be displayed on each divided screen (window).

The control unit receives information on the opening / closing degree and / or the degree of the cover from the sensor module, and thus determines whether the cover is opened / closed and / or the degree. For example, when the cover is closed, the sensor module can output an electric signal corresponding to the value of "0 " to the control unit. With the cover open, the sensor module can output an electrical signal corresponding to the value of "1 " to the control unit. The control unit can determine that the cover is closed when an electrical signal corresponding to "1" is received in the sensor module. The control unit can determine that the cover is opened when an electric signal corresponding to "1" is received in the sensor module.

The controller may turn off the front display area of the vender display and display the UI elements 381, 383, 385, 387, and 389 corresponding to the application in the side display area 120. In this case, The UI element 381 is an icon for executing the application "A", the UI element 383 is an icon for executing the application "B", the UI element 385 is an icon for executing the application "C" The icon 387 is an icon that executes the application "D", and the UI element 389 is an icon that executes the application "E".

The user touches and selects a plurality of UI elements 381 and 385 out of one or more UI elements 381, 383, 385, 387 and 389 displayed in the side display area and opens the cover to correspond to the UI elements 381 and 385 A " and " C "are executed, and the execution screens of the applications" A " and "C"

At this time, two windows 110a and 110b are displayed in the front display area 110, and an execution screen of the application can be displayed in each window. That is, the execution screen of the application "A" can be displayed in the window 110a, and the execution screen of the application "C" can be displayed in the window 110b.

For example, if the music player icon and the gallery icon displayed on the side display area are selected while the cover of the portable terminal is closed and the cover is opened, two windows can be displayed on the top and bottom of the screen in the front display area. In the upper window, the music player execution screen is displayed, and in the lower window, the execution image of the gallery application can be displayed.

5, the side display area 120 is exposed to the outside in a state where the front display area 110 of the bendable display of the portable terminal 200 is covered with the cover 800. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed in the side display area 120. [ The UI element may be an icon for executing an application. The UI element may also be a graphic and text representing information about the execution result of the application. The UI element may also be a notification message.

One or more UI elements 381, 383, 385, 387, and 389 are displayed in the side display area 120 while the first application is being executed while the cover is closed. The first application may be already running before any one of the displayed UI elements is selected.

 The UI element 381 is an icon that executes the application "A", the UI element 383 is an icon that executes the application "B", the UI element 385 is an icon that executes the application "C" The icon 387 is an icon that executes the application "D", and the UI element 389 is an icon that executes the application "E".

The first application is running before the cover is opened in the portable terminal. The execution screen of the second application corresponding to the selected UI element and the execution screen of the first application being executed can be simultaneously displayed in the front display area.

That is, when the first application is already running before the cover is opened in the portable terminal, in this state, the UI of one of the UI elements 381, 383, 385, 387, and 389 displayed in the side display area 120 When the element 383 is selected and the cover is opened, two windows 110a and 110b may be displayed in the front display area 110. [ An execution screen of the first application already running may be displayed in the window 110a and an execution screen of the second application corresponding to the UI element 383 may be displayed in the window 110b.

For example, when the music application is being executed while the cover 800 is closed, if the user touches the UI element corresponding to the gallery application in the side display area 120 and the cover is opened while the touch is maintained, An execution screen of the music application and an execution screen of the gallery application can be displayed. The Music application and the Gallery application can be displayed in two windows, respectively. The execution screen of the already running music application is displayed in the upper window and the execution screen of the gallery application executed later can be displayed in the lower window.

That is, the application executed before the cover is opened can be displayed in the upper window, and the application executed while the cover is opened can be displayed in the lower window. The opposite is also possible. For example, an application executed before the cover is opened can be displayed in the lower window, and an application executed while the cover is opened can be displayed in the upper window.

The control unit receives information on the opening / closing degree and / or the degree of the cover from the sensor module, and thus determines whether the cover is opened / closed and / or the degree. For example, when the cover is closed, the sensor module can output an electric signal corresponding to the value of "0 " to the control unit. With the cover open, the sensor module can output an electrical signal corresponding to the value of "1 " to the control unit. The control unit can determine that the cover is closed when an electrical signal corresponding to a value of "0 " is received in the sensor module. The control unit can determine that the cover is opened when an electrical signal corresponding to the value of "1 " is received in the sensor module.

The controller may turn off the front display area of the vender display and display the UI elements 381, 383, 385, 387, and 389 corresponding to the application in the side display area 120. [

When the user touches the UI element 383 of one or more UI elements 381, 383, 385, 387, and 389 displayed in the side display area to select and open the cover, the control unit determines whether an existing application exists do. If the first application is running, the control unit can divide the execution screen of the first application and the execution screen of the second application corresponding to the UI element 383 into two windows in the front display area and simultaneously display them. The control unit may display the execution screen of the first application in the upper window 110a and the execution screen of the second application in the lower window 110b.

Referring to FIG. 6, the side display area 120 is exposed to the outside while the front display area 110 of the bent display of the portable terminal 200 is covered with the cover 800. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed in the side display area 120. [ The UI elements 381, 383, 385, 387, and 389 may be icons for executing an application. Or the UI element may be a graphic and text representing information about the execution result of the application. Or the UI element may be a notification message.

When the first application is running before the cover is opened in the mobile terminal, the execution screen of the first application being executed is displayed in the side display area as the cover is opened, and the execution screen of the second application corresponding to the selected UI element is displayed on the front And can be displayed in the display area.

The UI elements 381, 383, 385, 387, and 389 are displayed in the side display area 120 with the cover closed. When the user selects one of the UI elements 381, 383, 385, 387, and 389 displayed in the side display area and opens the cover, the second application corresponding to the selected UI element 381 And an execution screen of the second application can be displayed in the front display area 110. [ At this time, if there is a first application which is being executed before the cover is opened, the first application may be displayed in the side display area 120. [

For example, if the user touches the UI element 381 corresponding to the second application among the UI elements displayed in the side display area while the first application is running while the cover is closed, The execution screen of the second application can be displayed on the front display area and the execution screen of the first application can be displayed on the side display area. Since the display area of the side display area is relatively smaller than that of the front display area, the execution screen of the first application can be displayed in abbreviated form in the side display area.

If the first application is a music application, the title of the song being reproduced can be displayed while being scrolled in the side display area. If the first application is a gallery application, a thumbnail image and a title may be displayed in the side display area.

If there is a first application running in the closed state of the cover, the control unit detects the user input for selecting the UI element in the side display area where the UI element is displayed and the opening of the cover, The execution screen of the second application corresponding to the UI element is displayed and the execution screen of the first application which has been executed before the cover is opened can be displayed in the side display area. At this time, the abbreviated execution screen of the first application can be displayed in the side display area.

7, the execution screen of the first application is displayed in the front display area 110 in a state that the cover 800 of the portable terminal 200 is open. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed in the side display area 120. [ The UI element may be an icon for executing an application. Or the UI element may be a graphic and text representing information about the execution result of the application. Or the UI element may be a notification message.

The UI elements 381, 383, 385, 387, and 389 may be icons corresponding to previously executed applications, and may be displayed in the side display area by being arranged in the order of execution. For example, on the right side of the side display area in the order in which they were most recently executed. The UI element 383, the UI element 385, the UI element 387, and the UI element 389 in the order of the UI element 381, the UI element 383, the UI element 385, and the UI element 389 based on the right side of the side display area. The UI element 381 was executed most recently and the UI element 389 was executed the last time.

When the user closes the cover in the state that the cover 800 is open and the execution screen of the first application is displayed in the front display area 110, the execution screen of the first application displayed in the front display area 110 Can be displayed in the side display area 120. [ Specifically, the UI element 380 corresponding to the first application can be displayed in the side display area 120. At this time, the first application can be continuously executed in the background. Also, the UI elements 381, 383, 385, and 387 displayed in the side display area are shifted leftward one by one, so that the UI element 389 disappears from the side display area. The UI element 380 corresponding to the first application displayed in the front display area 110 can be displayed on the rightmost side in the side display area. In other words, the UI element 380 corresponding to the first application can be sorted and displayed as the most recently executed UI in chronological order. The UI element 380 is displayed on the rightmost side of the side display area 120 as the cover is closed and the UI element 381, the UI element 383, the UI element 385, and the UI element 387 are displayed on the left side . ≪ / RTI > The UI element 389 may disappear from the side display area.

The opposite is also possible depending on the design specification. For example, the UI element 380 corresponding to the first application displayed in the front display area may be displayed on the leftmost side in the side display area, and the UI elements 381, 383, 385, and 387 may be displayed in order.

Also, the UI elements 381, 383, 385, and 387 displayed in the side display area according to the design specification can be displayed in the order of the recently executed order.

The control unit may determine whether to display the execution screen of the first application or the UI element corresponding to the first application in the side display area when the cover is closed according to the attribute of the first application.

When the first application is a vision-oriented application, the control unit stops the execution of the first application as the cover is closed, and controls the vended display to display the UI element corresponding to the first application in the side display area 120 .

If the first application is a hearing-oriented application, the control unit may control the vended display to display the execution screen of the first application in the side display area 120 as the cover is closed. At this time, a UI element for controlling auditory information, for example, a volume control button, a play and a stop button may be displayed in the side display area 120. [

When the first application is a visual / auditory center-based application, the control unit displays the execution screen of the first application on the side display area 120 as the cover is closed, the processing on the visual information is limited to some extent, It is possible to control the bend display so as to be in the side display area centered on the UI element.

The application attribute information about whether the application is visual-centered or auditory-centered or visual / auditory-centered can be stored in advance in the application and can be provided at the time of application execution. In addition, the user can change and add application attribute information.

Examples of vision-based applications include news applications, weather applications, web browsers, and gallery applications.

An example of an audio-centric application is a music player application.

An example of a visual / auditory-focused application is a video playback application.

For example, when the web browser is running while the cover is open, if the user closes the cover, the execution of the web browser is stopped and a UI element corresponding to the web browser can be displayed in the side display area 120. [

As another example, if the music player application is running while the cover is open, if the user closes the cover, the screen of the front display area 110 is turned off, but the music player application continues to be executed. In the side display area 120, , A stop button, a forward button, a backward button, a volume control button, and information on music currently being played.

As another example, if the moving picture reproducing application is running while the cover is open, if the user closes the cover, the screen of the front display area 110 is turned off and the processing for the time information is stopped, but the processing for the audible information continues The side display area 120 may display information on a play button, a stop button, a forward button, a back button, a volume control button, and a file currently being played back.

Referring to FIG. 8, the side display region 120 is exposed to the outside while the front display region 110 of the bent display of the portable terminal 200 is covered with the cover 800. UI elements 801, 803, and 805 may be displayed in the side display area 120. [

The UI element 801 may be a notification message. The UI element 803 may be a UI element corresponding to the first application associated with the notification message. The UI element 805 may be a UI element corresponding to a second application associated with the notification message. For example, if the alert message 801 is email, the UI element 803 may be a UI element corresponding to an application that can open attachments (e.g., images, moving images, and documents) of the alert message. The UI element 805 may be a UI element corresponding to an application capable of sending a reply mail in response to the notification message.

When the notification message arrives with the cover 800 closed, the summary information 801 of the notification message can be displayed on the side auxiliary display. The summary information can be scrolled from left to right or from right to left. At this time, if the notification message includes an attachment file, the UI element 803 corresponding to the attachment file may be displayed. When the user opens the cover with the UI element 803 being touched, the attached file can be displayed in an open state in the front display area 110. [ If the attached file is an image file, the UI element 803 corresponding to the image file may be displayed in the side display area 120. When the UI element 803 is touched and the cover 800 is opened while the touch is maintained, the image viewer application is executed and the image is displayed in the front display area 110. [ If the attached file is a video file, the UI element 803 corresponding to the video file can be displayed in the side display area 120. If the cover is opened while the UI element 803 is touched and the touch is maintained, The moving picture file can be reproduced on the display unit 110. If the attached file is a text document, the UI element 803 corresponding to the text document can be displayed in the side display area, and when the cover is opened while the UI element 803 is touched and the touch is maintained, The document can be displayed.

The UI element 805 may be an icon corresponding to another application associated with the notification message. For example, a contact phone number and an email address that are associated with the notification message. When the cover is opened with the UI element 805 being touched, a screen capable of making a call in the front display area 110 can be displayed. Also, when the cover is opened while the UI element 805 is touched, a screen for transmitting mail to the front display area 110 may be displayed.

9, the side display region 120 is exposed to the outside in a state where the front display region of the bendable display of the portable terminal 200 is covered with the cover 800. [ UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed in the side display area 120. [ The UI element may be an icon for executing an application. The UI element may also be a graphic and text representing information about the execution result of the application. The UI element may also be a notification message.

One or more UI elements 381, 383, 385, 387, 389 may be displayed in the side display area 120 with the cover 800 closed. The UI element 381 is an icon for executing the application "A", the UI element 383 is an icon for executing the application "B", the UI element 385 is an icon for executing the application "C" The icon 387 is an icon that executes the application "D", and the UI element 389 is an icon that executes the application "E".

When the user touches one UI element 381 of the UI elements 381, 383, 385, 387, and 389 displayed in the side display area by long touching, the child of the application corresponding to the UI element 381 The menu can be displayed immediately. The long touch is a touch that is continuously touched for a predetermined period of time. For example, the touch may last for 1 to 2 seconds when touched.

When the application "A" corresponding to the UI element 381 has a hierarchical structure menu, the UI element 381 displayed in the side display area 110 is touched for a long time, Can be moved between menus. A menu having a hierarchical structure may have at least one sub menu or a higher menu.

10 is a diagram showing a menu having a hierarchical structure. The menu having the hierarchical structure may include a first hierarchical menu 1001, a second hierarchical menu 1011, 1013, 1015, .., and a third hierarchical menu 1021, 1023, .... The first layer menu 1001 may include 'Item 1', 'Item 2', 'Item 3', 'Item 4', and 'Item 5'.

'Item 1' may have a second hierarchical menu 1011. 'Item 2' may have a second hierarchical menu 1013. 'Item 3' may have a second hierarchical menu 1015.

The second layer menu 1011 may include 'Item 1-1' to 'Item 1-5'. The second layer menu 1013 may include 'Item 2-1' to 'Item 2-5'. The second layer menu 1015 may include 'Item 3-1' to 'Item 3-5'.

The 'Item 1-1' of the second hierarchy menu 1011 may include third hierarchy menus 1021 and 1023. The third hierarchy menus 1021 and 1023 may be sub menus of the second hierarchy menus 1011, 1013, and 1015. The third layer menu 1021 may include 'Item 1-1-1' to 'Item 1-1-5'. The third layer menu 1032 may include 'items 1-2-1' through 'items 1-2-5'.

Referring again to FIG. 9, when the user touches one UI element 381 of the UI elements displayed in the side display area 120 in the closed state, the UI element 381 UI elements 381a, 381b, 381c, 381d, and 381e capable of selecting menu items of the application "A" For example, UI elements 381a, 381b, 381c, 381d, and 381e that can select menu items 1 to 5 corresponding to the first hierarchical menu 1001 of FIG. 10 may be displayed.

Item 1 'of the first layer menu 1001 can be selected by touching the UI element 381a. When the UI element 381b is touched, 'Item 2' of the first hierarchical menu 1001 can be selected. Item 3 'of the first layer menu 1001 can be selected by touching the UI element 381c. Item 4 'of the first layer menu 1001 can be selected by touching the UI element 381d. When the UI element 381e is touched, 'Item 5' of the first layer menu 1001 can be selected.

 In this state, if the user touches the UI element 381a for a long time, the UI elements 381f, 381g, 381h, 381i, and 381j corresponding to the lower menu of the UI element 381a may be displayed in the side display area 120 .

When the UI element 381f is touched, 'Item 1-1' of the first hierarchical menu 1011 can be selected. When the UI element 381g is touched, 'Item 1-2' of the first layer menu 1011 can be selected. When the UI element 381h is touched, 'Item 1-3' of the first layer menu 1011 can be selected. When the UI element 381 i is touched, 'Item 1-4' of the first hierarchical menu 1011 can be selected. When the UI element 381j is touched, 'Item 1-5' of the first hierarchical menu 1011 can be selected.

In this state, the user touches and selects the UI element 381f displayed in the side auxiliary display area 120. When the cover is opened, the function corresponding to the UI element 381f is executed and the execution screen is displayed on the front display area 110 ). ≪ / RTI >

For example, when the application corresponding to the UI element 381 is an e-book, when the UI element 381 is touched with a long touch, UI elements 381a, 381b, 381c, and 381d , 381e can be displayed in the side display area 120. [ When the user again touches the UI element 381a again, the UI elements 381f, 381g, 381h, 381i, and 381j corresponding to the sub-menu of the UI element 381a may be displayed in the side display area 120 .

When the user touches and selects the UI element 381f, the user can move to 'chapter 1'. If the user touches and selects the UI element 381g, the user can move to 'chapter 2'. If the UI element 381h is touched and selected, the user can move to 'chapter 3'. When the user touches the UI element 381i and selects it, the user can move to 'chapter 4'. If the user touches and selects the UI element 381j, the user can move to 'chapter 5'.

When the user opens the cover with the UI element 381f touched, the user can move to the corresponding chapter 1 and the page can be displayed in the front display area. That is, the control unit can receive the touch input from the UI element 381f, and control the bodied display so that the page corresponding to chapter 1 is displayed in the front display area based on the touch input.

When the user opens the cover with the UI element 381g touched, the user can move to the corresponding chapter 2 and the page can be displayed in the front display area. That is, the control unit receives the touch input from the UI element 381g, and controls the bodied display so that the page corresponding to chapter 2 is displayed in the front display area based on the touch input.

When the user opens the cover with the UI element 381h touched, the user can move to the corresponding chapter 3 and the page can be displayed in the front display area. That is, the control unit can receive the touch input from the UI element 381h, and control the bodied display so that the page corresponding to chapter 3 is displayed in the front display area based on the touch input.

When the user opens the cover with the UI element 381i touched, the user can move to the corresponding chapter 4 and the page can be displayed in the front display area. That is, the control unit receives the touch input from the UI element 381i, and controls the bodied display so that the page corresponding to chapter 4 is displayed in the front display area based on the touch input.

When the user opens the cover with the UI element 381j touched, the user can move to the corresponding chapter 5 and the page can be displayed in the front display area. That is, the control unit can receive the touch input from the UI element 381j, and control the bodied display so that the page corresponding to the chapter 5 is displayed in the front display area based on the touch input.

In the above embodiment, the input of the user is divided into a touch and a long touch to perform a function corresponding to the UI element, or the sub menu item is displayed in the side display area. However, the input of the user is not limited to the touch and long touch, and the touch and long touch can be replaced by other user inputs such as a flick gesture, a drag gesture, a tap, and a double tap.

When the UI element is an icon for executing an application, the control unit distinguishes the user input that is input to the UI element, thereby executing an application corresponding to the UI element, or when the menu item of the application corresponding to the UI element is a side The bendable display can be controlled to be displayed in the display area 120. [

In addition, when the UI element is a menu item, the control unit may distinguish user input input to the UI element, thereby selecting a function corresponding to the UI element, or selecting a sub menu item corresponding to the UI element from the side display area 120 ) To be displayed on the display.

11 to 12 are flowcharts illustrating a process of executing an application by detecting the opening of the UI element and the cover displayed in the side display area.

Referring to FIG. 11, a portable terminal having a vender display including a front display area and a side display area includes a front display area of a vender display covered with a cover, a side display area of a vender display, The corresponding one or more UI elements may be displayed (step S1101). The UI element may be an icon for executing an application.

The controller 390 receives an electrical signal from the sensor module in accordance with the opening and closing of the cover, and thus determines whether the cover is open or closed. When the front display area of the bendable display is covered with the cover, an electric signal corresponding to "0" The control unit can determine whether the cover is opened or closed based on the electric signal output from the sensor module.

At least one, that is, one or more UI elements corresponding to the application may be displayed in the side display area of the bend display. The UI element may be an icon corresponding to an application that has been executed previously. The UI elements may be displayed in the side display area in the order in which they were executed.

The portable terminal can detect touching of at least one UI element among the UI elements and opening of the cover (step S1103). When a touch is detected in the UI element displayed in the side display area, the control unit receives the coordinates of the location where the touch is sensed, and determines the UI element corresponding to the coordinates.

When the cover is opened, an electric signal corresponding to "1" The controller may detect opening of the cover based on the electrical signal output from the sensor module.

When the opening of the cover is detected in a state in which a touch is detected in the UI element, the portable terminal can execute an application corresponding to the UI element in which the touch is detected and display the execution screen of the application in the front display area of the vended display (Step S1105). When a touch is detected in a plurality of UI elements among the UI elements and opening of the cover is detected, the control unit executes a plurality of applications corresponding to the plurality of UI elements in which the touch is detected, Can be displayed on the front display area. An execution screen of a plurality of applications can be displayed in each of a plurality of windows.

When the first application is running before the cover is opened in the mobile terminal, the execution screen of the second application corresponding to the UI element in which the touch is sensed and the execution screen of the first application being executed can be simultaneously displayed in the front display area.

When the first application is running before the cover is opened in the mobile terminal, the execution screen of the first application being executed is displayed in the side display area, and the execution screen of the second application corresponding to the UI element in which the touch is detected is displayed on the front side Area. ≪ / RTI >

The mobile terminal can display a menu item of the application corresponding to the UI element in which the touch is detected on the side display area when a touch is detected in one UI element and the duration of the touch is longer than a predetermined time.

The mobile terminal may receive a user input for selecting one of the menu items, detect the opening of the cover, and perform the function of the application corresponding to the item based on the opening of the cover.

Referring to FIG. 12, a mobile terminal having a vender display including a front display area and a side display area can display an execution screen of a first application in a front display area of a vender display (step S1201). At this time, the portable terminal can display at least one UI element corresponding to an application executed in the side display area of the vended display.

The portable terminal detects that the front display area is covered with the cover (step S1203), and displays the first UI element corresponding to the first application on the side display area based on the detection result (step S1205) . At this time, at least one UI element corresponding to the previously executed application is arranged and displayed in the side display area in accordance with the application execution time order, and the first UI element is further sorted in a chronological order, .

The method of executing an application of the portable terminal having the bendable display of the present invention as described above may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable recording medium. At this time, the computer readable recording medium may include a program command, a data file, a data structure, or the like, alone or in combination. On the other hand, the program instructions recorded on the recording medium may be those specially designed and configured for the present invention or may be available to those skilled in the art of computer software.

The computer readable recording medium may be an optical recording medium such as a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc) ), A magneto-optical medium such as a Floptical Disk, and a storage medium such as a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, Hardware devices. The program instructions also include machine language code, such as those generated by the compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. Accordingly, the scope of the present invention should be construed as being included in the scope of the present invention, all changes or modifications derived from the technical idea of the present invention.

100: Bended display
110: front display area
120: side display area
200:
301: Speaker
303: Illumination sensor
305: Front camera module
310: Communication module
330: Sensor module
350:
390:

Claims (20)

A method for executing an application in a mobile terminal having a bendable display including a front display area and a side display area,
Displaying a UI element corresponding to an application in a side display area of the bendable display in a state that a front display area of the bendable display is covered with a cover;
Sensing touch of at least one UI element among the UI elements and opening of the cover; And
And displaying an execution screen of the application on the front display area by executing an application corresponding to the UI element on which the touch is sensed based on the opening of the cover. The method according to claim 1,
Wherein the UI element is an icon for executing the application. 3. The method of claim 2,
Wherein,
When a touch of a plurality of UI elements among the UI elements is detected and when opening of the cover is detected, a plurality of applications corresponding to the plurality of UI elements in which the touch is detected are executed, And displaying on the front display area. The method of claim 3,
And the execution screens of the plurality of applications are displayed in a plurality of windows, respectively. The method according to claim 1,
Wherein,
When the opening of the cover is detected while the first application is being executed in the portable terminal, the execution screen of the second application corresponding to the UI element in which the touch is sensed and the execution screen of the first application being executed, And displaying the same on the display area at the same time. The method according to claim 1,
Wherein,
When the opening of the cover is detected while the first application is running in the portable terminal, the execution screen of the first application being executed is displayed on the side display area, and the execution screen of the second application is displayed on the side display area, And the execution screen of the application is displayed in the front display area. A method for executing an application in a mobile terminal having a bendable display including a front display area and a side display area,
Displaying an execution screen of the first application in a front display area of the vended display;
Sensing that the front display area is covered with a cover; and
And displaying a first UI element corresponding to the first application on the side display area based on covering of the cover. 8. The method of claim 7,
Wherein,
At least one UI element corresponding to an application that has been executed is arranged and displayed in the side display area according to an application execution time order, and the first UI element is displayed in a chronological order, The method of claim 1, 8. The method of claim 7,
When a touch is detected in one of the UI elements displayed in the side display area and the touch is continued for a predetermined time, the menu item of the application corresponding to the detected UI element is displayed on the side display area The method of claim 1, further comprising: 10. The method of claim 9,
Sensing touch of an item of the menu item and opening of the cover; And
And performing the function of the application corresponding to the item based on the opening of the cover. A bendable display including a front display area and a side display area; And
A UI display unit for displaying a UI element corresponding to an application in a side display area of the bendable display in a state in which a front display area of the bendable display is covered with a cover and a touch for at least one UI element among the UI elements, And a control unit for executing the application corresponding to at least one UI element in which the touch is sensed and controlling the bend display so that an execution screen of the application is displayed in the front display area, Device. 12. The method of claim 11,
And the UI element is an icon for executing the application. 13. The method of claim 12,
Wherein,
A plurality of applications corresponding to a plurality of UI elements detected by the touch are detected when a touch of a plurality of UI elements among the UI elements and an opening of the cover are detected, And controls the bendable display so that the bendable display is displayed in the area. 14. The method of claim 13,
And the execution screen of the plurality of applications is displayed in each of the plurality of windows. 12. The method of claim 11,
Wherein,
When the cover is opened while the first application is running, the execution screen of the second application corresponding to the UI element in which the touch is sensed and the execution screen of the first application being executed are displayed in the front display area The control unit controls the bendable display to display the bendable display at the same time. 12. The method of claim 11,
Wherein,
When the cover is opened while the first application is running, the execution screen of the first application being executed is displayed in the side display area according to the opening of the cover, and the execution screen of the second application corresponding to the selected UI element Controls the bendable display to display in the front display area. A bendable display including a front display area and a side display area; And
Wherein when the front display area is covered with the cover, the first UI element corresponding to the first application is displayed on the side display area in the front display area of the bent display, And a control unit for controlling the dead display. 18. The method of claim 17,
Wherein,
At least one UI element corresponding to a previously executed application is arranged and displayed in the side display area in accordance with an application execution time order,
Wherein the first UI element controls the vended display to additionally sort and display the most recently executed UI in chronological order. 18. The method of claim 17,
Wherein,
When the touch is detected in one UI element and the touch is continued for a predetermined time, the bendable display is controlled to display the menu item of the application corresponding to the UI element in which the touch is detected on the side display area . 20. The method of claim 19,
Wherein,
Wherein the function of the application corresponding to the item is performed when the opening of the cover is detected in a state that a touch is sensed by one of the menu items.

Images