KR102121374B1 - Method and portable terminal having bended display unit and cover for executing application - Google Patents

Abstract

A portable terminal device is disclosed. The apparatus displays a UI element corresponding to an application on a side display area of a bend display, while the bend display including the front display area and the side display area and the front display area of the bend display are covered with a UI The bend is configured to detect a touch on at least one UI element among elements, execute an application corresponding to at least one UI element on which a touch is detected as the cover is opened, and display an execution screen of the application on the front display area. Includes a control unit that controls the display

Description

A portable terminal with a bendable display and a cover and an application execution method {METHOD AND PORTABLE TERMINAL HAVING BENDED DISPLAY UNIT AND COVER FOR EXECUTING APPLICATION}

The present invention relates to a portable terminal having a bend display and a cover and a method for executing the application, in particular, selecting a UI element displayed on the side display area in a bended display including a front display area and a side display area, It relates to a method and apparatus for detecting an opening of a cover and executing an application corresponding to a selected UI element.

Recently, with the development of digital technology, various mobile terminals capable of processing communication and personal information while moving, such as mobile communication terminals, PDAs (Personal Digital Assistants), electronic notebooks, smart phones, and tablet PCs, have been released. . These mobile terminals include voice calls, SMS (Short Message Service)/MMS (Multimedia Message Service), and video transmission, electronic notebook, shooting, email sending and receiving, broadcast playback, Internet, music playback, schedule management, social network services. Various functions such as (SNS, Social Networking Service), messenger, dictionary, game, etc. are provided.

Recently, a cover for protecting a display unit is mounted on a portable terminal. In this case, the display area of the display unit may be turned on or off depending on whether the cover is opened or closed.

However, in a state in which the display portion of the mobile terminal is covered with the cover, the user has to open the cover and select and execute the related application in order to execute the application of the mobile terminal.

An object of the present invention is to provide a portable terminal capable of extending a display area to a side as well as a front side by implementing a bended display and a control method for displaying the screen.

Another object of the present invention is to divide the bend display into a front display area and a side display area in a portable terminal having a bend display, and simultaneously display execution screens of two or more different applications using the front display area and the side display area. To provide a multitasking method.

Another object of the present invention is to provide a method for providing a cover capable of covering a front display area of a bent display, and executing an application according to whether a cover is opened or closed and user interaction in a side display area of the bend display.

Method according to an embodiment of the present invention for achieving the above object, in a mobile terminal having a bend display including a front display area and a side display area, the front display area of the bend display is covered with a cover In a state, displaying a UI element corresponding to an application on a side display area of the bent display; Detecting a touch on at least one of the UI elements and an opening of the cover; And an execution step of executing an application corresponding to the touch-sensitive UI element and displaying an execution screen of the application on the front display area based on the opening of the cover. Here, the UI element may be an icon for executing the application.

In the execution step, when a touch on a plurality of UI elements among the UI elements is detected, and the opening of the cover is detected, a plurality of applications corresponding to the plurality of UI elements on which the touch is detected are executed, and the plurality of applications are executed. The execution screen of can be displayed on the front display area. Here, the execution screens of the plurality of applications may be respectively displayed in a plurality of windows.

In the execution step, when the opening of the cover is detected while the first application is being executed in the mobile terminal, the execution screen of the second application and the execution screen of the running first application corresponding to the touched UI element are detected. Can be simultaneously displayed on the front display area.

In addition, in the execution step, when the opening of the cover is detected while the first application is being executed in the mobile terminal, the execution screen of the first application being executed is displayed on the side display area, and the UI element where the touch is detected is detected. The execution screen of the second application corresponding to may be displayed on the front display area.

In addition, when a touch is detected in one of the UI elements displayed on the side display area, and the touch continues for a certain time, a menu item of an application corresponding to the touched UI element is displayed on the side display area In addition, it is possible to detect a touch on one of the menu items and the opening of the cover, and perform a function of the application corresponding to the item based on the opening of the cover.

According to another embodiment of the present invention, a portable terminal having a bend display including a front display area and a side display area displays a running screen of a first application on the front display area of the bend display. step; Detecting that the front display area is covered with a cover; And an execution step of displaying a first UI element corresponding to the first application on the side display area based on the covering of the cover. Here, at least one UI element corresponding to the previously executed application is arranged and displayed in the side display area according to an application execution time order, and the first UI element is additionally arranged and displayed as being the most recently executed in chronological order. Can be.

A portable terminal according to another embodiment of the present invention includes a bend display including a front display area and a side display area; And a front display area of the bent display is covered with a cover, displaying a UI element corresponding to an application in a side display area of the bend display, and touching and covering at least one UI element among the UI elements. When the open is detected, the control unit for executing the application corresponding to the at least one UI element that the touch is sensed, and controlling the bend display so that the execution screen of the application is displayed on the front display area; may include have.

Here, the UI element may be an icon for executing the application. In addition, when the touch of a plurality of UI elements among the UI elements and the opening of the cover are detected, the controller executes a plurality of applications corresponding to the plurality of UI elements where the touch is detected, and executes the plurality of applications. The bent display may be controlled to display a screen on the front display area. The execution screens of the plurality of applications may be respectively displayed in a plurality of windows.

In addition, when the cover is opened while the first application is being executed, the control unit executes a screen of a second application corresponding to a UI element in which the touch is detected in response to the opening of the cover and a screen of execution of the first application being executed. The bent display may be controlled to simultaneously display in the front display area.

In addition, when the cover is opened while the first application is being executed, the control unit displays the execution screen of the first application being executed on the side display area in response to the cover being opened, and the first UI element corresponding to the selected UI element. 2 The bend display can be controlled to display the execution screen of the application on the front display area. In addition, when a touch is detected in one UI element and the touch continues for a certain period of time, the control unit displays the bend display to display a menu item of an application corresponding to the touched UI element on the side display area. Can be controlled. In addition, the control unit may perform a function of the application corresponding to the item when the opening of the cover is sensed while a touch is detected on one of the menu items.

A portable terminal according to another embodiment of the present invention includes a bent display including a front display area and a side display area; And displaying the execution screen of the first application on the front display area of the bend display, and when the front display area is covered with a cover, display the first UI element corresponding to the first application on the side display area. It may include a control unit for controlling the bend display. The control unit displays at least one UI element corresponding to an application that has been previously executed, arranged in the side display area according to an application execution time order, and the first UI element is the most recently executed time order. The bent display can be controlled to display in alignment.

As described above, according to various embodiments of the present invention, the display area can be expanded more easily by constructing the bent display with one end bent to the side of the mobile terminal. In addition, the bent display may be divided into a front display area and a side display area, and a notification event may be supported using the side display area. Through this, in various embodiments of the present invention, it is possible to support the user to more intuitively check event information based on the side display area even when the user cannot utilize the front display area.

Further, according to various embodiments of the present invention, when a notification event occurs, the state of the mobile terminal may be checked, and event information output of the generated notification event may be processed in a mode corresponding to the checked state. For example, when responding to various situations that do not use the main display area of the bend display, that is, when responding to the manner notification mode, the event information according to the notification event is output using the side display area of the bend display, and the main display area is used. That is, when responding to the normal mode, event information according to a notification event may be output through at least one display area based on a user setting among the main display area and the side display area. Through this, it is possible to improve various user conveniences by responding to various notification events such as call reception, message reception, push service reception, and SNS notification reception.

Various embodiments of the present invention can be implemented in all types of portable terminals and various devices corresponding thereto. In addition, according to various embodiments of the present invention, it is possible to implement an optimal environment for outputting event information for each state of the portable terminal, thereby contributing to improving usability, convenience, and competitiveness of the portable terminal.

1 is a view showing an example of a mobile terminal having a cover and a bend display according to an embodiment of the present invention.
2 is a view schematically showing the configuration of a mobile terminal according to an embodiment of the present invention.
3 to 10 are diagrams illustrating a method of executing an application according to a user interaction in a side display area of a portable terminal having a bend display and an open/close state of a cover.
11 to 12 are flowcharts illustrating a process of executing an application by detecting an opening of a UI element and a cover displayed on a side display area.

Terms used in this specification will be briefly described, and the present disclosure will be described in detail.

Terms used in the embodiments of the present invention, while considering the functions in the present disclosure, while selecting general terms that are currently widely used as possible, it may vary depending on the intention or precedent of a person skilled in the art or the appearance of new technologies. . In addition, in certain cases, some terms are arbitrarily selected by the applicant, and in this case, their meanings will be described in detail in the description of the applicable invention. Therefore, the terms used in the present disclosure should be defined based on the meaning of the terms and the contents of the present invention, rather than simply the names of the terms.

Embodiments of the present invention can be applied to a variety of transformations and can have a number of embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiments, it should be understood to include all transformations, equivalents, or substitutes included in the disclosed spirit and scope of technology. In the description of the embodiments, when it is determined that the detailed description of the related known technology may obscure the subject matter, the detailed description is omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from other components.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, terms such as “comprises” or “consist of” are intended to indicate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, one or more other It should be understood that features or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance.

In an embodiment of the present invention, the'module' or'unit' performs at least one function or operation, and may be implemented by hardware or software, or a combination of hardware and software. In addition, a plurality of'modules' or a plurality of'units' are integrated into at least one module except for a'module' or a'unit' that needs to be implemented with specific hardware to be implemented with at least one processor (not shown). Can be.

In an embodiment of the present invention, when a part is said to be "connected" to another part, it is not only "directly connected", but also "electrically connected" with another element in between. Also includes. Also, when a part “includes” a certain component, this means that other components may be further included, rather than excluding other components, unless otherwise specified.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present disclosure pertains can easily implement them. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present disclosure in the drawings, parts irrelevant to the description are omitted, and like reference numerals are assigned to similar parts throughout the specification.

In an embodiment of the present invention, the cover may be an object or device for protecting the display by covering part or all of the display area of the portable terminal. The cover may be electrically or non-electrically connected to the mobile terminal. In addition, the cover may be communicatively connected to the portable terminal in some cases. In addition, the cover is detachable from the portable terminal and may be sold separately, or may be sold in combination with the portable terminal.

Further, in an embodiment of the present invention, the user input may include at least one of a touch input, a bending input, a voice input, a button input, and a multimodal input, but is not limited thereto.

In addition, in an embodiment of the present invention, "touch input" means a touch gesture or the like performed by a user on a display or cover to control a device. Also, the “touch input” may include a touch (eg, floating or hovering) that is not contacted on the display and is spaced over a certain distance. For touch input, touch & hold gesture, tap gesture to release after touch, double tap gesture, panning gesture, flick gesture, touch & drag to move in one direction after touch There may be a gesture, a pinch gesture, etc., but is not limited thereto.

In addition, in the embodiment of the present invention, "button input" means an input for controlling a device by using a physical button attached to the device by a user.

In addition, in the embodiment of the present invention, "motion input" means a motion that a user applies to the device to control the device. For example, motion input may include input by a user to rotate the device, tilt the device, or move the device up, down, left, and right.

In addition, in an embodiment of the present invention, "multiple input" means that at least two or more input methods are combined. For example, the device may receive a user's touch input and motion input, or may receive a user's touch input and voice input.

In addition, in the embodiment of the present invention, "application" refers to a set of computer programs designed to perform a specific task. In an embodiment of the invention, the application may be varied. For example, there may be a game application, a video playback application, a map application, a memo application, a calendar application, a phone book application, a broadcast application, an exercise support application, a payment application, a photo folder application, but is not limited thereto.

In addition, in an embodiment of the present invention, "application identification information" may be unique information for distinguishing an application from other applications. For example, the identification information of the application may be icons, index items, link information, etc., but is not limited thereto.

In addition, in an embodiment of the present invention, a UI (User Interaction) element means an element capable of interacting with a user, such as visual, audible and olfactory feedback according to a user input. The UI element may be expressed as at least one of images, text, and videos, or if the above-described information is not displayed but there is one area capable of feedback according to user input, this area may be referred to as a UI element. For example, the UI element may be the application identification information described above. Also, the UI element may be information provided to the user according to an event.

Also, in an embodiment of the present invention, the window may mean a divided screen. For example, "two windows" can be understood as one screen being divided into two.

Also, "simultaneously" used in the description and claims may be interpreted as "having temporally overlapping intervals."

Hereinafter, a configuration and application execution method of a mobile terminal according to an embodiment of the present invention will be described with reference to the following drawings. It should be noted that the configuration and application execution method of the mobile terminal according to the embodiment of the present invention are not limited or limited to the contents described below, and thus can be applied to various embodiments based on the following embodiments.

.

1 is a view showing an example of a mobile terminal having a cover and a bend display according to an embodiment of the present invention.

As illustrated in FIG. 1, the portable terminal is formed on the bend display 100 and the bend display 100 to be seated and fastened, and is formed on the main body 200 to perform functions of the portable terminal. For additional devices. In FIG. 1, the additional device may include a speaker 301, a microphone (not shown), a sensor module (especially, an illuminance sensor 303, a front camera module 305, etc.), a physical button (not shown), and the like. .

The bent display 100 indicates a display device that can be bent, and is characterized by being able to bend, bend, or roll without damage through a thin and flexible substrate like paper. Since the bent display 100 uses a plastic substrate rather than a glass substrate that is generally used, it may be formed using a low-temperature manufacturing processor without using an existing manufacturing processor to prevent damage to the substrate. The bent display 100 is a liquid crystal in a liquid crystal display (LCD, Liquid Emitting Diode), an organic light emitting diode (OLED), and an active OLED (AMOLED, Active Matrix OLED). Substituting the plastic substrate for the glass substrate surrounding it gives flexibility to fold and unfold. The bendable display 100 is not only thin and light, it is also strong against impact, and also has the advantage of being able to bend or bend and produce in various forms.

In an embodiment of the present invention, the bent display 100 is an active matrix screen (active, etc.) of a specific screen size (eg, 3 inches, 4 inches, 4.65 inches, 5 inches, 6.5 inches, 8.4 inches, etc.) according to the size of the mobile terminal. It has a matrix screen, and extends to at least one side of the mobile terminal (e.g., at least one of left, right, top, and bottom sides), so that the bend display 100 can operate a radius of curvature ( For example, it may be folded to a radius of curvature of 5 cm, 1 cm, 7.5 mm, 5 mm, 4 mm or less) and fastened to the side surface of the main body 200. Hereinafter, in the present invention, the display area appearing on the front surface of the bent display 100 is referred to as the front surface display area 110 and extends from the front display area and is bent toward at least one side surface of the main body 200. The display area appearing on the side of (200) will be referred to as the side display area (120).

Here, the front display area 110 and the side display area 120 are separated for convenience of description of the present invention, and the front display area 110 and the side display area 120 are at least one. The end has a bent shape, and at least one bent end may be implemented by one bent display 100 extending to at least one side of the mobile terminal. In addition, at least one bent end may be implemented by one bent display 100 extending to the back of the mobile terminal.

Therefore, in this specification, a front area formed of a flat surface based on the front portion of the mobile terminal is referred to as a front display area 110, and a display area formed on a side surface based on the front portion of the portable terminal is referred to as a side display area 120. . That is, the present invention is implemented by a single bend display 100 configured as a "one-piece" in the front display area 110 on the front of the portable terminal and the side display area 120 on the side of the portable terminal.

In addition, in the present embodiment, when the mobile terminal is in multi tasking, the mobile terminal can display the execution screen of the application being multitasked using the front display area 110 and the side display area 120.

For example, when the web browser application and the music player application are executed by multitasking, a web browsing screen may be displayed on the front display area 110 and a control for controlling playback of a music player on the side display area 120 The button 120a and the title 120b of the music being played may be displayed. Accordingly, while listening to music, the user can increase the volume of the currently playing music or change the playing music to another song using the side display area 120. In addition, the user can browse the web using the front display area 110 while listening to music.

In addition, when the gallery application and the music player application are executed as multitasking, a picture may be displayed on the front display area 110 and a control button for controlling playback of the music player may be displayed on the side display area 120. . Accordingly, while listening to music, the user can increase the volume of the currently playing music or change the playing music to another song using the side display area 120. In addition, the user can view a picture displayed on the front display area 110 while listening to music.

According to FIG. 1, the bent display 100 may be divided into a front display area 110 on the front side and a side display area 120 on the side. The mobile terminal may provide a user interface element (UI) using the side display area 120. The UI element may include icons for executing an application and graphics and characters for providing information to a user.

According to an embodiment of the present invention, an execution screen of an application may be displayed on the front display area 110 of the portable terminal. Further, the mobile terminal may display UI elements related to the application, for example, icons 381, 383, 385, 387, and 389 on the side display area. Also, the portable terminal may display a notification message when a notification event occurs in a display area on the side.

The cover 800 is detachably coupled to the mobile terminal and can be opened or closed by the user. The cover may cover the front display area. While the cover is closed, the front display area is not exposed to the outside, but the side display area may be exposed to the outside. When the cover is closed, the mobile terminal may receive user input from the side display area not covered by the cover and display predetermined functions or information in response to the user input on the side display area. 1 is a state in which the cover 800 is covered. When the cover 800 is covered, the mobile terminal displays various UI elements 381, 383, 385, 387, and 389 on the side display area 120. Although the UI element is illustrated as an icon in FIG. 1, the present invention is not limited thereto. The user may touch the UI element displayed on the side display area to execute a desired application or perform a desired application function.

When the cover is opened or closed, the value of the electrical signal output from the sensor module may be changed, and the control unit may determine the'open'or'closed' state of the cover from the value of the electrical signal output from the sensor module. For example, a value of “1” may be output from the sensor module when the cover is open, and a value of “0” may be output from the sensor module when the cover is closed. Opening and closing of the cover may be detected by an illuminance sensor 305, a proximity sensor (not shown) and/or a hall sensor (not shown). When the cover has a magnet, the portable terminal can detect whether the cover is opened or closed using a hall sensor.

2 is a view schematically showing the configuration of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 2, a communication module 310, a bent display 100, a sensor module 330, a storage unit 350, and a control unit 390 are included. In addition, the portable terminal includes an audio processing unit having a microphone and a speaker, a digital broadcasting module for receiving digital broadcasting (for example, mobile broadcasting such as Digital Multimedia Broadcasting (DMB) or Digital Video Broadcasting (DVB)), and static images of subjects And support for communication functions based on short-range wireless communication such as camera module for dynamic image shooting, Bluetooth (BLUETOOTH) communication, infrared (Infrared Data Association) communication, RFID (Radio Frequency Identification) communication, NFC (Near Field Communication), etc. At least one short-range communication module for, a hard key (Hard key)-based input for supporting the input, and may further include a configuration such as a battery (battery) for supplying power to the above configurations, but for them Descriptions and illustrations are omitted.

The communication module 310 supports communication with an external server or other portable terminal through a communication network. In the present invention, the communication module 100 may include a radio frequency (RF) module for supporting mobile communication services such as voice communication, video call, and data communication based on mobile communication. In addition, the communication module 100 may support Internet communication services such as voice communication, video call, and data communication based on IP (Internet Protocol). In particular, the communication module 100 may receive a notification event from an external server or other portable terminal. In addition, in the present invention, the communication module 100 is not limited to a specific communication module or communication method, and may be implemented by various types of communication modules that are provided to allow a mobile terminal to communicate with an external server or other mobile terminal. Can be.

The bent display 100 may display a screen related to the operating state of the portable terminal. For example, the bendable display 100 is a mobile terminal's home screen, menu screen, call origination/reception screen, message creation/reception screen, chat screen, and application execution, respectively. Can display the execution screen.

The bent display 100 is divided into a front display area 110 and a side display area 120, and a UI element can be displayed through the side display area 120. The UI element may be event information according to a notification event such as call reception, message reception, information reception according to a push service, and information reception according to an SNS. Also, the UI element may be a part of an execution screen according to an icon for executing an application and an execution result of the application. An example of the operation of operating the side display area 120 of the bent display 100 will be described later.

In addition, although the LCD is generally used as the bent display 100, other display devices such as LED, OLED, and AMOLED may be used. In addition, the bent display 100 may be configured to include an interface supporting touch-based input. For example, the bent display 100 supports a variety of touch-based user inputs through a touch-screen configuration, and generates an input signal according to the user input and transmits it to the control unit 390. . In addition, when displaying various screens as described above, the bent display 100 displays a screen in a landscape mode, a screen display in a portrait mode, and a landscape mode and a portrait in accordance with a rotation direction (or a laid direction) of the mobile terminal. It is possible to support adaptive screen switching display according to changes between modes.

The sensor module 330 may detect a change according to whether the cover is opened and/or opened, and transmit a corresponding value, that is, an electrical signal, to the control unit 390. In addition, the sensor module 330 may detect at least one of various changes such as a posture change, change in illuminance, acceleration change, etc. of the portable terminal, and transmit a corresponding value, that is, an electrical signal to the control unit 390.

In the present invention, the sensor module 330 may be made of various sensors, and when the portable terminal is driven (or based on user settings), power is supplied to at least one sensor set under the control of the control unit 390 to open and close the cover. The state change according to whether and/or the degree can be detected.

The sensor module 330 may be configured to include at least one device among all types of sensing devices capable of detecting a state change of the portable terminal according to whether the cover is opened and/or closed. . For example, the sensor module 330 includes a Hall sensor, an Acceleration sensor, a Gyro sensor, an illumination sensor, a proximity sensor, and a pressure sensor. sensor, a noise sensor (eg, a microphone), a video sensor (eg, a camera module), and a timer, and the like, and may include at least one of various sensing devices.

In an embodiment of the present invention, as part of detecting the front display area 110 is blocked by the cover 800 of the mobile terminal, the combination of at least one of an illuminance sensor, a proximity sensor and a hall sensor, etc. Operation will be described as an example.

That is, in the example of the present invention, it is possible to detect whether the cover is opened or closed and/or the degree of state using one or more sensors.

Here, it is assumed that the sensor module 330 is the illuminance sensor, and the operation of detecting whether the cover is opened and/or closed will be described with reference to FIG. 2. Referring to FIG. 2, the sensor module 330 is supplied with power under the control of the control unit 390, and may output different values depending on whether the cover is opened and/or closed.

The storage unit 350 stores various applications and data processed and processed in the portable terminal, and may be composed of one or more nonvolatile memory and volatile memory. In the present invention, the storage unit 350 is ROM (Read Only Memory), flash memory (flash memory), RAM (Random Access Memory), internal hard disk (HDD, Hard Disk Drive), external hard disk, external storage medium, etc. It may be composed of at least one. And the storage unit 350 is the operating system of the portable terminal, the program and data related to the display control operation of the bend display 100, whether the cover 800 using the sensor module 330 is opened and closed, and the degree of opening and closing, It is possible to continuously or temporarily store programs and data related to the state detection of the mobile terminal and the control operation accordingly. In particular, the storage unit 350 may store setting information 370 related to the operation of the front display area 110 and the side display area 120 of the bent display 100.

.

The control unit 390 controls the overall operation of the mobile terminal. In particular, the control unit 390 may display the application execution screen in the front display area and the side display area according to whether the cover is opened or closed and/or the degree state in the embodiment of the present invention. The application execution screen may be a screen displayed according to an execution result of the application.

The control unit 390 is a front display area of the bend display including the front display area 110 and the side display area 120 is covered with a cover, at least one corresponding to the application to the side display area of the bend display The bent display may be controlled to display the UI element of. That is, only one UI element may be displayed on the side display area, or a plurality of UI elements may be displayed. In addition, the control unit may detect a touch on at least one UI element among the UI elements, and execute an application corresponding to at least one UI element on which the touch is detected as the cover is opened. In addition, the control unit 390 may control the bent display to display the execution screen of the application on the front display area. Here, the UI element may be an icon for executing an application.

In addition, when the controller detects a touch on a plurality of UI elements among the UI elements and detects the opening of the cover, the controller executes a plurality of applications corresponding to the plurality of UI elements on which the touch is detected, and the plurality of applications The bent display may be controlled to display the execution screen of the screen on the front display area. Here, the execution screens of the plurality of applications may be respectively displayed in a plurality of windows.

In addition, when the first application is running before the cover is opened, the control unit displays an execution screen of a second application corresponding to the UI element where the touch is detected and an execution screen of the running first application on the front display area. The bent display can be controlled to be displayed simultaneously.

In addition, when the first application is running before the cover is opened in the portable terminal, the control unit displays an execution screen of the first application being executed on the side display area, and a second application corresponding to the selected UI element. The bend display can be controlled to display the execution screen on the front display area.

In addition, the control unit displays the execution screen of the first application on the front display area of the bend display including the front display area and the side display area, and displays a UI element corresponding to the application on the side display area of the bend display. The bend display may be controlled to sense that the front display area is covered with a cover and to display a first UI element corresponding to the first application on the side display area.

In addition, the control unit may control the bend display such that the UI elements are aligned and displayed in the side display area in the order in which the application was executed, and the first UI elements are sorted as the most recently executed in chronological order. Can be.

In addition, when a touch is detected in one UI element, the controller detects the duration of the touch, and when the duration of the touch is equal to or greater than a predetermined time, displays a menu item of an application corresponding to the UI element where the touch is detected. The bent display can be controlled to be displayed in the side display area.

Here, the UI elements may be arranged and displayed in the side display area in the order of time in which the application was executed, and the first UI elements may be arranged and displayed as being executed most recently in chronological order.

As such, the control unit 390 can control the overall operation of the function operation of the present invention, and the detailed control operation of the control unit 390 is described in the operation example of the mobile terminal and the control method thereof with reference to the drawings described below. Will be. In addition, the control unit 390 may control various operations related to the normal functions of the portable terminal in addition to the functions described above.

For example, the controller 390 may control its operation and screen display when a specific application is executed. In addition, the control unit 390 may receive input signals corresponding to various touch interaction inputs supported by a touch-based input interface and control function operation accordingly. In addition, the control unit 390 may control transmission and reception of various data based on wired communication or wireless communication.

The portable terminal of FIG. 2 may include all information communication devices, multimedia devices, and application devices for supporting the functions of the present invention. For example, the mobile terminal includes a mobile communication terminal operating based on communication protocols corresponding to various communication systems, a tablet PC (Personal Computer), a smart phone, a digital camera, It may include a device such as a portable multimedia player (PMP), a media player (Media Player), a portable game terminal and a personal digital assistant (PDA).

3 to 10 are diagrams illustrating a method of executing an application according to a user interaction in a side display area of a portable terminal having a bend display and an open/close state of a cover.

Referring to FIG. 3, the front display area of the bent display of the portable terminal 200 is covered with the cover 800, and the side display area 120 is exposed to the outside. At least one UI element 381, 383, 385, 387, 389 corresponding to an application may be displayed on the side display area 120. The UI element may be an icon for running the application. Alternatively, the UI elements may be graphics and text representing information on the execution result of the application. Alternatively, the UI element may be a notification message. In the following description, for example, a plurality of UI elements displayed on the side display area will be described. However, even when one UI element is displayed on the side display area, the embodiment of the present invention may be equally applied.

While the front display area of the bend display is covered with a cover, UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed on the side display area 120 of the bend display. That is, a plurality of UI elements 381, 383, 385, 387, and 389 may be displayed on the side display area 120. The UI elements 381, 383, 385, 387, and 389 displayed on the side display area 120 may be UI elements corresponding to previously executed applications. For example, if the existing applications "A", "B", "C", "D" and "E" have been executed, the UI elements are applications "A", "B", "C", "D" and "E It may be an icon corresponding to ".

When the user selects at least one UI element among the UI elements 381, 383, 385, 387, and 389 displayed on the side display area 120, and opens the cover, the control unit touches at least one of the UI elements And detecting the opening of the cover.

The user can select the UI element by touching one of the UI elements 381, 383, 385, 387, and 389. That is, when the user selects one UI element, the control unit can detect a touch in one UI element.

When the user selects two UI elements, the controller can detect a touch on the two UI elements. The control unit may execute an application corresponding to the UI element 381 selected by the user, and control the bend display so that the execution screen of the application is displayed on the front display area 110.

The user may select the UI element 381 by touching the UI element 381 displayed on the side display area. When the user touches the UI element 381, the controller detects a touch in the side display area 120, and determines whether to execute the application corresponding to the UI element 381 according to whether the cover is opened and/or the degree. Whether the cover is opened or closed indicates two states of "open" or "closed" the cover. The degree of opening and closing of the cover means how much the cover is opened. The degree of opening and closing of the cover may be displayed at an angle. For example, the cover can be opened 30 degrees relative to the front display area, and can be opened 80 degrees relative to the front display area.

The control unit may receive an electrical signal according to the opening and closing of the cover from the sensor module, and accordingly may determine whether and/or the degree of opening and closing of the cover.

For example, in the closed state, the sensor module may output an electrical signal corresponding to the value of “0” to the control unit. In the state that the cover is open, the sensor module may output an electrical signal corresponding to the value of "1" to the control unit. The control unit may determine that the cover is closed when the electric signal corresponding to “0” is received from the sensor module. The control unit may determine that the cover is opened when the electric signal corresponding to "1" is received from the sensor module. Here, the electric signals corresponding to "0" and "1" can be replaced with electric signals of different values as an example.

When the sensor module is an illuminance sensor, an electrical signal corresponding to "0" may be output when the cover is closed. When the cover is opened, an electrical signal corresponding to “1” may be output.

When the cover is closed, the control unit may turn off the screen of the front display area of the bend display and display UI elements 381, 383, 385, 387, and 389 corresponding to the application on the side display area 120. The UI elements 381, 383, 385, 387, and 389 corresponding to the application may be icons for executing the application. The UI element 381 is an icon for launching the application "A", the UI element 383 is an icon for launching the application "B", the UI element 385 is an icon for launching the application "C", and the UI element 387 is an icon that executes the application "D", and the UI element 389 may be an icon that executes the application "E".

When the user touches and selects at least one UI element 381 among the UI elements 381, 383, 385, 387, and 389 displayed on the side display area, and opens the cover, the application "A" corresponding to the UI element 381 Is executed, and the execution screen of the application "A" may be displayed on the front display area 110.

The control unit may receive coordinates of a place where a touch is detected, and determine what UI element corresponds to the coordinates. That is, the control unit may determine what UI element is selected by the user based on the user's touch input, and execute an application corresponding to the UI element. In addition, the control unit may control the bent display so that the execution screen of the application is displayed on the front display area.

Referring to FIG. 4, the front display area 110 of the bent display of the portable terminal 200 is covered with the cover 800, and the side display area 120 is exposed to the outside. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed on the side display area 120. The UI elements 381, 383, 385, 387, and 389 may be icons for executing an application. In addition, the UI elements may be graphics and text representing information on application execution results.

In the closed state, a UI element may be displayed on the side display area 120, that is, a plurality of UI elements 381, 383, 385, 387, and 389 may be displayed on the side display area 120. The UI element displayed on the side display area 120 may be an icon corresponding to the previously executed application.

The user may select two or more UI elements simultaneously displayed on the side display area 120 by touching them. When the user selects a plurality of UI elements 381 and 385 among the UI elements 381, 383, 385, 387, and 389 displayed on the side display area 120, when the cover 800 is opened, the selected plurality of UIs Applications corresponding to the elements 381 and 385 are executed, and an execution screen of the application may be displayed on the front display area 110. At this time, a plurality of windows 110a and 110b are displayed on the front display area 110, and an execution screen of an application may be displayed on each window. The window may be a divided screen.

The execution screen of the application corresponding to the UI element 381 is displayed on one of the windows 110a and 110b, and the application of the UI element 385 is displayed on the other window 110b. An execution screen can be displayed. Each application can be run with multitasking.

Also, if the cover is opened while three UI elements are selected, three windows may be displayed on the front display area. As another example, when the cover is opened while three UI elements are selected, two windows may be displayed on the front display area, and two applications may be displayed on each window. Another one application may be displayed on the side display area.

For example, when a user selects two UI elements from the UI elements displayed on the side display area 120 and opens the cover, two applications corresponding to the two selected UI elements are executed, and two application execution screens are displayed. It can be displayed on the front display area. The two applications can be displayed in two windows. That is, the front display area is divided into two screens, top and bottom or left and right, and can be displayed on each divided screen (window).

When the user selects three UI elements from the UI elements displayed on the side display area 120 and opens the cover, three applications corresponding to the selected three UI elements are executed, and three application execution screens are displayed on the front display area. Can be displayed. The three applications can be displayed in three windows. That is, the front display area is divided into three screens: top, bottom, left and right, and can be displayed on each divided screen (window).

The control unit may receive information about whether the cover is opened and/or extent from the sensor module, and accordingly may determine whether the cover is opened and closed and/or the degree. For example, in the closed state, the sensor module may output an electrical signal corresponding to the value of “0” to the control unit. In the state that the cover is open, the sensor module may output an electrical signal corresponding to the value of "1" to the control unit. The control unit may determine that the cover is closed when the electric signal corresponding to "1" is received from the sensor module. The control unit may determine that the cover is opened when the electric signal corresponding to "1" is received from the sensor module.

When the cover is closed, the control unit may turn off the front display area of the bend display and display the UI elements 381, 383, 385, 387, 389 corresponding to the application on the side display area 120. The UI element 381 is an icon that launches the application "A", the UI element 383 is an icon that launches the application "B", and the UI element 385 is an icon that launches the application "C", and the UI element 387 is an icon for launching the application "D", and the UI element 389 may be an icon for launching the application "E".

When the user touches and selects a plurality of UI elements 381 and 385 among the one or more UI elements 381, 383, 385, 387, and 389 displayed on the side display area, and opens the cover, corresponding to the UI elements 381 and 385 The applications "A" and "C" are executed, and the execution screens of the applications "A" and "C" may be displayed on the front display area 110.

At this time, two windows 110a and 110b are displayed on the front display area 110, and an execution screen of the application may be displayed on each window. That is, the execution screen of the application "A" may be displayed on the window 110a, and the execution screen of the application "C" may be displayed on the window 110b.

For example, if the music player icon and gallery icon displayed on the side display area are selected while the cover of the mobile terminal is closed and the cover is opened, two windows may be displayed on the top and bottom of the screen in the front display area. The music player execution screen may be displayed in the upper window, and the execution screen of the gallery application may be displayed in the lower window.

Referring to FIG. 5, the side display area 120 is exposed to the outside while the front display area 110 of the bend display of the portable terminal 200 is covered with the cover 800. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed on the side display area 120. The UI element may be an icon for running the application. In addition, the UI elements may be graphics and text representing information on the execution result of the application. Also, the UI element may be a notification message.

The first application is being executed while the cover is closed, and one or more UI elements 381, 383, 385, 387, and 389 are displayed on the side display area 120. The first application may already be running before any one of the UI elements displayed on the side is selected.

The UI element 381 is an icon for launching the application "A", the UI element 383 is an icon for launching the application "B", the UI element 385 is an icon for launching the application "C", and the UI element 387 is an icon that executes the application "D", and the UI element 389 may be an icon that executes the application "E".

When the first application is running before the cover is opened on the mobile terminal. The execution screen of the second application corresponding to the selected UI element and the execution screen of the first application being executed may be simultaneously displayed on the front display area.

That is, if the first application is already running before the cover is opened on the mobile terminal, in this state, one of the UI elements 381, 383, 385, 387, 389 displayed on the side display area 120 When the element 383 is selected and the cover is opened, two windows 110a and 110b may be displayed on the front display area 110. The execution screen of the first application that is already being executed may be displayed on the window 110a, and the execution screen of the second application corresponding to the UI element 383 may be displayed on the window 110b.

For example, when the music application is running while the cover 800 is closed, when the user touches a UI element corresponding to the gallery application in the side display area 120 and opens the cover while maintaining the touch, the front display area The execution screen of the music application and the execution screen of the gallery application may be displayed in. The music application and the gallery application can be displayed in two windows, respectively. The execution screen of the music application that is already running may be displayed in the upper window, and the execution screen of the gallery application that is executed later may be displayed in the lower window.

That is, an application executed before the cover is opened may be displayed in the upper window, and an application executed while the cover is opened may be displayed in the lower window. The opposite is also possible. For example, an application executed before the cover is opened may be displayed in the lower window, and an application executed while the cover is opened may be displayed in the upper window.

The control unit may receive information about whether the cover is opened and/or extent from the sensor module, and accordingly may determine whether the cover is opened and closed and/or the degree. For example, in the closed state, the sensor module may output an electrical signal corresponding to the value of “0” to the control unit. In the state that the cover is open, the sensor module may output an electrical signal corresponding to the value of "1" to the control unit. The control unit may determine that the cover is closed when the electric signal corresponding to the value of “0” is received from the sensor module. The control unit may determine that the cover is opened when the electric signal corresponding to the value of "1" is received from the sensor module.

When the cover is closed, the controller may turn off the front display area of the bend display and display the UI elements 381, 383, 385, 387, 389 corresponding to the application on the side display area 120.

When the user touches and selects one of the UI elements 383 among the one or more UI elements 381, 383, 385, 387, and 389 displayed on the side display area, and opens the cover, the control unit determines whether an existing running application exists. do. When the first application is being executed, the controller may divide the execution screen of the first application and the execution screen of the second application corresponding to the UI element 383 into two windows on the front display area and display them simultaneously. The controller may display the execution screen of the first application in the upper window 110a and the execution screen of the second application in the lower window 110b.

Referring to FIG. 6, the side display area 120 is exposed to the outside while the front display area 110 of the bend display of the portable terminal 200 is covered with the cover 800. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed on the side display area 120. The UI elements 381, 383, 385, 387, and 389 may be icons for executing an application. Alternatively, the UI element may be graphics and text representing information on an execution result of the application. Alternatively, the UI element may be a notification message.

When the first application is running before the cover is opened on the mobile terminal, the execution screen of the first application being executed is displayed on the side display area when the cover is opened, and the execution screen of the second application corresponding to the selected UI element is front. It can be displayed in the display area.

With the cover closed, UI elements 381, 383, 385, 387, and 389 are displayed on the side display area 120. When the user selects one UI element 381 among the UI elements 381, 383, 385, 387, and 389 displayed on the side display area, and opens the cover, the second application corresponding to the selected UI element 381 This is executed, and the execution screen of the second application may be displayed on the front display area 110. At this time, if there is a first application that was running before the cover was opened, the first application may be displayed on the side display area 120.

For example, in a state in which the first application is being executed while the cover is closed, the user touches the UI element 381 corresponding to the second application among the UI elements displayed on the side display area and maintains the touch. When opened, the execution screen of the second application may be displayed on the front display area and the execution screen of the first application may be displayed on the side display area. Since the display area of the side display area is relatively smaller than that of the front display area, the execution screen of the first application may be displayed on the side display area in a reduced form.

When the first application is a music application, the title of the song being played may be scrolled and displayed on the side display area. When the first application is a gallery application, thumbnail images and titles may be displayed on the side display area.

When there is a first application running in a state in which the cover is closed, the control unit detects a user input for selecting the UI element in the side display area where the UI element is displayed and the opening of the cover and accordingly selected in the front display area 110 The execution screen of the second application corresponding to the UI element may be displayed, and the execution screen of the first application that was running before the cover was opened may be displayed in the side display area. At this time, the reduced execution screen of the first application may be displayed on the side display area.

Referring to FIG. 7, when the cover 800 of the mobile terminal 200 is opened, the execution screen of the first application is displayed on the front display area 110. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed on the side display area 120. The UI element may be an icon for running the application. Alternatively, the UI element may be graphics and text representing information on an execution result of the application. Alternatively, the UI element may be a notification message.

The UI elements 381, 383, 385, 387, and 389 may be icons corresponding to the previously executed application, and may be displayed in the side display area, arranged in the order of execution time. For example, it may be displayed on the right side of the side display area in the most recently executed order. That is, the UI elements 381, the UI elements 383, the UI elements 385, the UI elements 387, and the UI elements 389 may be displayed based on the right side of the side display area. The UI element 381 was executed most recently, and the UI element 389 was executed last.

When the cover 800 is open and the execution screen of the first application is displayed on the front display area 110, when the user closes the cover, the execution screen of the first application displayed on the front display area 110 It may be displayed on the side display area 120. Specifically, the UI element 380 corresponding to the first application may be displayed on the side display area 120. At this time, the first application may be continuously executed in the background. Also, as the UI elements 381, 383, 385, and 387 displayed on the side display area are shifted to the left one by one, the UI elements 389 disappear from the side display area. The UI element 380 corresponding to the first application displayed on the front display area 110 may be displayed on the rightmost side in the side display area. That is, the UI elements 380 corresponding to the first application may be arranged and displayed as being executed most recently in chronological order. As the cover is closed, the UI element 380 is displayed on the rightmost side of the side display area 120, and on the left, the UI elements 381, UI elements 383, UI elements 385, and UI elements 387 are in order. It can be displayed as. The UI element 389 may disappear from the side display area.

The reverse is also possible depending on the design specifications. For example, the UI element 380 corresponding to the first application displayed on the front display area may be displayed on the leftmost side in the side display area, and the UI elements 381, 383, 385, and 387 may be sequentially displayed.

In addition, UI elements 381, 383, 385, and 387 displayed on the side display area according to the design specification may be displayed in the order of recently executed order.

The controller may determine whether to display the execution screen of the first application or the UI element corresponding to the first application in the side display area when the cover is closed according to the properties of the first application.

When the first application is a vision-oriented application, as the cover is closed, the control unit stops execution of the first application and controls the bend display to display the UI element corresponding to the first application on the side display area 120. Can be.

When the first application is an auditory-oriented application, as the cover is closed, the controller may control the bend display to display the execution screen of the first application on the side display area 120. At this time, a UI element for controlling auditory information, such as a volume control button and a play and stop button, may be displayed on the side display area 120.

When the first application is a visual/hearing-oriented application, as the cover is closed, the control unit displays the execution screen of the first application on the side display area 120, but partially limits processing of visual information and responds to the auditory information. The bend display can be controlled to be in the side display area centered on the UI element.

The application attribute information on whether the application is visually centered or auditoryly centered or visually or auditoryly centered may be stored in the application in advance, and may be provided when the application is executed. In addition, the user can change and add application attribute information.

Examples of visually oriented applications include news applications, weather applications, web browsers, and gallery applications.

An example of a hearing-oriented application is a music player application.

An example of a visual/audience-oriented application is a video playback application.

For example, when the web browser is running while the cover is open, when the user closes the cover, execution of the web browser is stopped, and a UI element corresponding to the web browser can be displayed on the side display area 120.

As another example, when the music player application is running while the cover is open, when the user closes the cover, the screen of the front display area 110 is turned off, but the music player application is continuously executed, and the play button is displayed in the side display area 120. , Stop button, forward button, reverse button, volume control button and information about the currently playing music can be displayed.

As another example, when a video playback application is being executed while the cover is open, when the user closes the cover, the screen of the front display area 110 is turned off and processing of visual information is stopped, but processing of auditory information continues. In the side display area 120, information about a play button, a stop button, a forward button, a reverse button, a volume control button, and a file currently being played may be displayed.

Referring to FIG. 8, the side display area 120 is exposed to the outside while the front display area 110 of the bend display of the portable terminal 200 is covered with the cover 800. UI elements 801, 803, and 805 may be displayed on the side display area 120.

The UI element 801 may be a notification message. The UI element 803 may be a UI element corresponding to the first application related to the notification message. The UI element 805 may be a UI element corresponding to the second application related to the notification message. For example, when the notification message 801 is an email, the UI element 803 may be a UI element corresponding to an application that can open an attachment (eg, image, video, and document) of the notification message. The UI element 805 may be a UI element corresponding to an application capable of sending a reply mail in response to a notification message.

When the notification message arrives while the cover 800 is closed, summary information 801 of the notification message may be displayed on the side auxiliary display. Summary information can be scrolled from left to right or from right to left. At this time, if the notification message includes an attachment, a UI element 803 corresponding to the attachment may be displayed. When the user opens the cover while the UI element 803 is touched, the attached file may be displayed on the front display area 110 in an open state. When the attached file is an image file, a UI element 803 corresponding to the image file may be displayed on the side display area 120. When the UI element 803 is touched and the cover 800 is opened while the touch is maintained, an image viewer application is executed and an image may be displayed on the front display area 110. When the attached file is a video file, the UI element 803 corresponding to the video file may be displayed on the side display area 120, and when the UI element 803 is touched and the cover is opened while the touch is maintained, the front display area A video file may be played at 110. When the attachment is a text document, the UI element 803 corresponding to the text document may be displayed on the side display area, and when the UI element 803 is touched and the cover is opened while the touch is maintained, the front display area 110 The document can be displayed.

The UI element 805 may be an icon corresponding to another application related to the notification message. For example, it may be a contact phone number and an email address related to the notification message. When the cover is opened while the UI element 805 is touched, a screen for making a call may be displayed on the front display area 110. In addition, when the cover is opened while the UI element 805 is touched, a screen for transmitting a mail may be displayed on the front display area 110.

Referring to FIG. 9, the side display area 120 is exposed to the outside while the front display area of the bent display of the portable terminal 200 is covered with the cover 800. UI elements 381, 383, 385, 387, and 389 corresponding to the application may be displayed on the side display area 120. The UI element may be an icon for running the application. In addition, the UI elements may be graphics and text representing information on the execution result of the application. Also, the UI element may be a notification message.

When the cover 800 is closed, one or more UI elements 381, 383, 385, 387, and 389 may be displayed on the side display area 120. The UI element 381 is an icon that launches the application "A", the UI element 383 is an icon that launches the application "B", and the UI element 385 is an icon that launches the application "C", and the UI element 387 is an icon for launching the application "D", and the UI element 389 may be an icon for launching the application "E".

When the user long touches one of the UI elements 381 among the UI elements 381, 383, 385, 387, and 389 displayed on the side display area, a lower part of the application corresponding to the UI element 381 The menu can be displayed immediately. The long touch is to continuously touch the touch for a certain period of time, for example, it may be one or two seconds in the touched state.

When the application "A" corresponding to the UI element 381 has a hierarchical structure menu, the hierarchical structure of the application "A" by long touching the UI element 381 displayed on the side display area 110 You can move between menus. A menu having a hierarchical structure may have at least one lower menu or higher menu.

10 is a diagram showing a menu having a hierarchical structure. The menu having a hierarchical structure may include a first hierarchical menu 1001, a second hierarchical menu 1011, 1013, 1015, .. and a third hierarchical menu 1021, 1023, .. The first hierarchical menu 1001 may include'Item 1','Item 2','Item 3','Item 4', and'Item 5'.

'Item 1'may have a second layer menu 1011. 'Item 2'may have a second hierarchical menu 1013. 'Item 3'may have a second hierarchical menu 1015.

The second layer menu 1011 may include'items 1-1' to'items 1-5'. The second hierarchical menu 1013 may include items 2-1 to 2-5. The second layer menu 1015 may include'items 3-1' to'items 3-5'.

The'item 1-1' of the second hierarchical menu 1011 may include third hierarchical menus 1021 and 1023. The third hierarchical menus 1021 and 1023 may be sub-menus of the second hierarchical menus 1011, 1013, and 1015. The third hierarchical menu 1021 may include'items 1-1-1' to'items 1-1-5'. The third hierarchical menu 1032 may include'items 1-2-1' to'items 1-2-5'.

Referring back to FIG. 9, when a user touches one UI element 381 of one of the UI elements displayed on the side display area 120 while the cover is closed, the UI element 381 is displayed on the side display area 120. ), a UI element 381a, 381b, 381c, 381d, 381e that can select a menu item of the application "A" may be displayed. For example, UI elements 381a, 381b, 381c, 381d, and 381e that can select menu items 1 to 5 corresponding to the first hierarchical menu 1001 of FIG. 10 may be displayed.

When the UI element 381a is touched,'Item 1'of the first hierarchical menu 1001 may be selected. When the UI element 381b is touched,'Item 2'of the first hierarchical menu 1001 may be selected. When the UI element 381c is touched,'Item 3'of the first hierarchical menu 1001 may be selected. When the UI element 381d is touched,'Item 4'of the first hierarchical menu 1001 may be selected. When the UI element 381e is touched,'Item 5'of the first hierarchical menu 1001 may be selected.

In this state, when the user long touches the UI element 381a, the UI elements 381f, 381g, 381h, 381i, and 381j corresponding to the sub-menu of the UI element 381a may be displayed on the side display area 120. .

When the UI element 381f is touched,'Item 1-1' of the first hierarchical menu 1011 may be selected. When the UI element 381g is touched,'Item 1-2' of the first layer menu 1011 may be selected. When touching the UI element 381h,'item 1-3' of the first hierarchical menu 1011 may be selected. When touching the UI element 381i,'item 1-4' of the first hierarchical menu 1011 may be selected. When touching the UI element 381j,'item 1-5' of the first hierarchical menu 1011 may be selected.

In this state, when the user touches and selects the UI element 381f displayed on the side auxiliary display area 120 and opens the cover, a function corresponding to the UI element 381f is executed and the execution screen is displayed on the front display area 110 ).

For example, when the application corresponding to the UI element 381 is an e-book, when the UI element 381 is long-touched, the UI elements 381a, 381b, 381c, 381d corresponding to the table of contents of the sub-book of the e-book , 381e) may be displayed on the side display area 120. When the user touches the UI element 381a again, the UI elements 381f, 381g, 381h, 381i, and 381j corresponding to the chapter that is a sub-menu of the UI element 381a may be displayed on the side display area 120. .

If you select by touching the UI element 381f, you can move to'Chapter 1'. Touch and select the UI element 381g to move to'Chapter 2'. Touch and select the UI element 381h to go to'Chapter 3'. Touch and select the UI element 381i to move to'Chapter 4'. If you select the UI element 381j by touching it, you can move to'Chapter 5'.

If the cover is opened while the user touches the UI element 381f, the page moves to the corresponding chapter 1 and the corresponding page can be displayed on the front display area. That is, the control unit may receive a touch input from the UI element 381f, and control a bend display such that a page corresponding to chapter 1 is displayed on the front display area based on the touch input.

When the user opens the cover while the UI element 381g is touched, the screen moves to the corresponding chapter 2 and the corresponding page can be displayed on the front display area. That is, the control unit may receive a touch input from the UI element 381g, and control the bend display so that a page corresponding to chapter 2 is displayed on the front display area based on the touch input.

If the user opens the cover while the UI element 381h is touched, the page moves to the corresponding chapter 3 and the corresponding page can be displayed on the front display area. That is, the control unit may receive a touch input from the UI element 381h, and control the bend display so that a page corresponding to chapter 3 is displayed on the front display area based on the touch input.

If the user opens the cover while the UI element 381i is touched, the page moves to the corresponding chapter 4 and the corresponding page can be displayed on the front display area. That is, the control unit may receive a touch input from the UI element 381i, and control the bend display such that a page corresponding to chapter 4 is displayed on the front display area based on the touch input.

When the user opens the cover while the UI element 381j is touched, the screen moves to the corresponding chapter 5 and the corresponding page can be displayed on the front display area. That is, the control unit may receive a touch input from the UI element 381j, and control the bend display so that a page corresponding to chapter 5 is displayed on the front display area based on the touch input.

In the above embodiment, it has been described that a user's input is divided into touch and long touch to execute a function corresponding to a UI element or to display a sub-menu item on the side display area. However, the user's input is not limited to touch and long touch, and the touch and long touch can be replaced by other user inputs, such as a flick gesture, a drag gesture, a tap, and a double tap.

When the UI element is an icon for executing an application, the control unit distinguishes user input input to the UI element, and accordingly executes an application corresponding to the UI element or a menu item of the application corresponding to the UI element The bend display can be controlled to be displayed on the display area 120.

In addition, when the UI element is a menu item, the controller classifies the user input input to the UI element, and accordingly selects a function corresponding to the UI element or a sub-menu item corresponding to the UI element is a side display area 120 ), the bent display can be controlled.

11 to 12 are flowcharts illustrating a process of executing an application by detecting an opening of a UI element and a cover displayed on a side display area.

Referring to FIG. 11, a portable terminal having a bent display including a front display area and a side display area is applied to an application on the side display area of the bend display while the front display area of the bend display is covered with a cover. One or more corresponding UI elements may be displayed (step S1101). The UI element may be an icon for running the application.

The control unit 390 may receive an electrical signal according to the opening and closing of the cover from the sensor module, and accordingly determine whether and/or the degree of opening and closing of the cover. When the front display area of the bend display is covered with a cover, an electrical signal corresponding to “0” may be output from the sensor module. The control unit may determine whether to open or close the cover based on the electrical signal output from the sensor module.

At least one, ie, one or more UI elements corresponding to an application may be displayed on the side display area of the bent display. The UI element may be an icon corresponding to the previously executed application. The UI elements may be displayed on the side display area in the order of time they were executed.

The mobile terminal may detect a touch on at least one UI element among the UI elements and the opening of the cover (step S1103). When a touch is detected in the UI element displayed on the side display area, the control unit may receive coordinates where the touch is detected, and determine what UI element corresponds to the coordinates.

When the cover is opened, an electrical signal corresponding to "1" may be output from the sensor module. The control unit may detect the opening of the cover based on the electrical signal output from the sensor module.

When the opening of the cover is detected while the touch is detected in the UI element, the mobile terminal may execute an application corresponding to the touch-detected UI element and display the execution screen of the application on the front display area of the bend display. There is (step S1105). In addition, when a touch is detected from a plurality of UI elements among the UI elements and an open of the cover is detected, the mobile terminal executes a plurality of applications corresponding to the plurality of UI elements where the touch is detected, and the execution screen of the plurality of applications Can be displayed on the front display area. The execution screens of the plurality of applications may be displayed in a plurality of windows, respectively.

When the first application is running before the cover is opened on the mobile terminal, the execution screen of the second application and the execution screen of the running first application corresponding to the touched UI element may be simultaneously displayed on the front display area.

In addition, when the first application is running before the cover is opened on the mobile terminal, the execution screen of the first application being executed is displayed on the side display area, and the execution screen of the second application corresponding to the UI element where the touch is detected is displayed on the front. Area.

When a touch is detected in one UI element and the duration of the touch is equal to or greater than a certain time, the mobile terminal may display a menu item of an application corresponding to the touched UI element in the side display area.

The mobile terminal may receive a user input for selecting one item from the menu items, detect the opening of the cover, and perform a function of the application corresponding to the item based on the opening of the cover.

Referring to FIG. 12, a portable terminal having a bend display including a front display area and a side display area may display an execution screen of the first application on the front display area of the bend display (step S1201). At this time, the mobile terminal may display at least one UI element corresponding to the previously executed application in the side display area of the bend display.

The mobile terminal may detect that the front display area is covered with the cover (step S1203), and display a first UI element corresponding to the first application on the side display area based on the detection result (step S1205). . At this time, at least one UI element corresponding to the previously executed application is arranged and displayed in the side display area according to the application execution time order, and the first UI element is additionally sorted and displayed as the most recently executed chronological order. Can be.

The method of executing an application of a portable terminal having a bend display of the present invention as described above is implemented in a form of program instructions that can be executed through various computer means and can be recorded in a computer-readable recording medium. In this case, the computer-readable recording medium may include program instructions, data files, data structures, or the like alone or in combination. Meanwhile, the program instructions recorded on the recording medium may be specially designed and configured for the present invention or may be known and usable by those skilled in computer software.

The computer-readable recording medium includes optical media such as magnetic media such as hard disks, floppy disks, and magnetic tapes, compact disc read only memory (CD-ROM), and digital versatile discs (DVD). ), specially configured to store and perform program instructions such as magneto-optical media (Floptical Disk), and program instructions such as read only memory (ROM), random access memory (RAM), flash memory, etc. Hardware devices are included. In addition, the program instructions include not only machine language codes produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

In addition, the embodiments of the present invention disclosed in the specification and drawings are merely intended to easily describe the technical content of the present invention and to provide specific examples to help understanding of the present invention, and are not intended to limit the scope of the present invention. Therefore, the scope of the present invention should be interpreted as including all the modified or modified forms derived on the basis of the technical spirit of the present invention in addition to the embodiments disclosed herein.

100: bendd display
110: front display area
120: side display area
200: main body
301: speaker
303: illuminance sensor
305: front camera module
310: communication module
330: sensor module
350: storage unit
390: control

Claims (20)

In the application execution method of a mobile terminal having a bend display including a front display area and a side display area,
Displaying a UI element corresponding to an application on a side display area of the bend display, while a front display area of the bend display is covered with a cover;
Detecting a touch on at least one of the UI elements and an opening of the cover; And
And executing an application corresponding to the touch-sensitive UI element based on the opening of the cover, and displaying an execution screen of the application on the front display area. According to claim 1,
The UI element is an application execution method of a mobile terminal, characterized in that the icon for executing the application. According to claim 2,
The execution step,
When a touch on a plurality of UI elements among the UI elements is detected, and the opening of the cover is detected, a plurality of applications corresponding to the plurality of UI elements on which the touch is detected is executed, and an execution screen of the plurality of applications is displayed. A method of executing an application of a portable terminal, characterized in that it is displayed on the front display area. According to claim 3,
The execution method of the plurality of applications is displayed on a plurality of windows, respectively, characterized in that the application execution method of the mobile terminal. According to claim 1,
The execution step,
When the opening of the cover is sensed while the first application is being executed in the mobile terminal, the execution screen of the second application and the execution screen of the running first application corresponding to the touched UI element are detected. A method of executing an application of a mobile terminal, characterized in that it is simultaneously displayed on a display area. According to claim 1,
The execution step,
When the opening of the cover is detected while the first application is being executed in the mobile terminal, the execution screen of the first application being executed is displayed on the side display area, and the second corresponding to the UI element where the touch is detected is displayed. A method for executing an application of a mobile terminal, characterized in that the execution screen of the application is displayed on the front display area. In the application execution method of a mobile terminal having a bend display including a front display area and a side display area,
Displaying an execution screen of a first application on a front display area of the bend display;
Detecting that the front display area is covered with a cover while the execution screen of the first application is displayed on the front display area: and
An execution step of displaying at least one UI element related to the first application on the side display area based on the covering of the cover; And
And when one of the at least one UI element is touched and the opening of the cover is sensed, executing a function corresponding to the touched UI element. The method of claim 7,
The execution step,
The at least one UI element is the most recently executed in chronological order and is further sorted and displayed. delete delete A bent display including a front display area and a side display area; And
While the front display area of the bent display is covered with a cover, a UI element corresponding to an application is displayed on a side display area of the bend display, and touch of at least one UI element among the UI elements and the cover And a control unit that executes an application corresponding to the touch-detected UI element and controls the bend display such that an execution screen of the application is displayed on the front display area when an open is detected. The method of claim 11,
The UI element is a mobile terminal device, characterized in that the icon for executing the application. The method of claim 12,
The control unit,
When a touch on a plurality of UI elements among the UI elements and the opening of the cover are detected, a plurality of applications corresponding to the plurality of UI elements on which the touch is detected are executed, and the execution screen of the plurality of applications is displayed on the front side. And controlling the bent display to display in an area. The method of claim 13,
A portable terminal device characterized in that the execution screens of the plurality of applications are respectively displayed in a plurality of windows. The method of claim 11,
The control unit,
When the cover is opened while the first application is running, the execution screen of the second application corresponding to the touch-detected UI element and the execution screen of the running first application are displayed in the front display area when the cover is opened. The portable terminal device, characterized in that for controlling the bend display to display at the same time. The method of claim 11,
The control unit,
When the cover is opened while the first application is running, the execution screen of the running first application is displayed on the side display area according to the opening of the cover, and the second application corresponding to the UI element where the touch is detected. The execution screen of the portable terminal device, characterized in that for controlling the bend display to be displayed on the front display area. A bent display including a front display area and a side display area; And
The execution screen of the first application is displayed on the front display area of the bent display,
If the front display area is covered with a cover while the execution screen of the first application is displayed on the front display area, the bent display is displayed to display at least one UI element related to the first application on the side display area. Control,
And a control unit executing a function corresponding to the touched UI element when one of the at least one UI element is touched and the opening of the cover is detected. The method of claim 17,
The control unit,
And wherein the at least one UI element controls the bend display to be further sorted and displayed as the most recently executed in chronological order. delete delete

Images