WO2019246295A1 - Method and apparatus of integrating slide and touch on an input device - Google Patents

Method and apparatus of integrating slide and touch on an input device Download PDF

Info

Publication number
WO2019246295A1
WO2019246295A1 PCT/US2019/038032 US2019038032W WO2019246295A1 WO 2019246295 A1 WO2019246295 A1 WO 2019246295A1 US 2019038032 W US2019038032 W US 2019038032W WO 2019246295 A1 WO2019246295 A1 WO 2019246295A1
Authority
WO
WIPO (PCT)
Prior art keywords
type
input
touch
physical
touch motion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2019/038032
Other languages
French (fr)
Inventor
Jiang Ai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FutureWei Technologies Inc
Original Assignee
FutureWei Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FutureWei Technologies Inc filed Critical FutureWei Technologies Inc
Priority to CN202211081423.1A priority Critical patent/CN115562502B/en
Priority to CN201980040527.8A priority patent/CN112313609B/en
Publication of WO2019246295A1 publication Critical patent/WO2019246295A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0227Cooperation and interconnection of the input arrangement with other functional units of a computer
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/043Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547Touch pads, in which fingers can move on a surface
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033Indexing scheme relating to G06F3/033
    • G06F2203/0339Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys

Definitions

  • the present disclosure relates generally to a system and method for the use of function input devices on a handheld device and, in particular embodiments, to a system and method for integrating slide and touch functionality on an input of on a handheld device.
  • Handheld devices such as cell phones, tablets, iPads, etc.
  • Various technologies including software and hardware, have been developed to enable and facilitate the use of the handheld devices over the time in the past, and new technologies continue to be developed such that a handheld device can be operated in a more convenient way.
  • a device that includes a physical input, configured to activate a first function of the device when a first type of touch motion is detected on the physical input, and an ultrasonic sensor comprising an ultrasonic transmitter and a first ultrasonic receiver.
  • the physical input can be in the form of, for example, a depressible or laterally-displaceable button or knob.
  • the ultrasonic sensor can be disposed underneath the physical input and configured to detect a second type of touch motion on the physical input and activate a second function of the device when the second type of touch motion is detected on the physical input.
  • the second type of touch motion can be of a different force or motion from the first type of touch motion.
  • the forgoing aspect enables integration of two different types of touch motions on the same physical input, which activate different functions on the device, respectively. This allows users to operate the same physical input and activate different functions. This greatly simplifies the users’ operations for activating the different functions and operating the device, especially when the users have already been familiar to the location of the physical inputs on the device.
  • the forgoing aspect thus improves user experience.
  • the second function comprises starting an application program on the device.
  • the second function comprises activating a hardware on the device.
  • the second function comprises performing an operation on a touch screen of the device.
  • the first type of touch motion and the second type of touch motion have different gestures on the physical input.
  • the first type of touch motion comprises depressing the physical input
  • the second type of touch motion comprises a sliding touch on the physical input
  • the first type of touch motion and the second type of touch motion have different touch forces on the physical input.
  • the physical input is a volume input of the device.
  • the physical input is a power input of the device.
  • the physical input is a key for inputting information into the device.
  • the device further comprises: a touch screen for displaying information.
  • the device further comprises: a second ultrasonic receiver, disposed underneath the physical button.
  • a method that includes: detecting, by a device using an ultrasonic sensor disposed underneath a physical component of the device, a first type of touch motion applied on the physical component, the ultrasonic sensor comprising an ultrasonic transmitter and an ultrasonic receiver, and being configured to detect the first type of touch motion on the physical component, and activating, by the device, a first function on the device upon detection of the first type of touch motion applied on the physical component, the first function being associated with the detection of the first type of touch motion on the physical component.
  • the method further comprises: detecting, by the device using the physical component, a second type of touch motion applied on the physical component that is different than the first type of touch motion, and activating, by the device, a second function on the device upon detection of the second type of touch motion applied on the physical component, the second function associated with detection of the second type of touch motion on the physical component and different than the first function.
  • the first type of touch motion and the second type of touch motion have different gestures on the physical component.
  • the first type of touch motion and the second type of touch motion have different touch forces on the physical component.
  • the first type of touch motion comprises a touch on the physical component
  • the second type of touch motion comprises depressing the physical component
  • the physical component is a physical button or key.
  • the physical component is a volume button of the device.
  • the physical component is a power button of the device.
  • the physical component is a key for entering information.
  • the first function comprises starting an application program on the device.
  • the first function comprises activating a hardware on the device.
  • the first function comprises performing an operation on a touch screen of the device.
  • a device that comprises a physical component that is accessible for using the device, and an ultrasonic sensor comprising an ultrasonic transmitter and an ultrasonic receiver, the ultrasonic sensor disposed underneath the physical component, and configured to detect a first type of touch motion applied on the physical component and activate a first function of the device upon detection of the first type of touch motion on the physical component.
  • the forgoing aspect enables use of an existing physical component of a device that activates a function on the device when a touch motion is detected on the physical component. This greatly simplifies users’ operations for activating the function and operating the device, especially when the users have already been familiar to the location of the physical component. The forgoing aspect thus improves user experience.
  • the physical component is configured to activate a second function of the device upon detecting, by the physical component, a second type of touch motion applied on the physical component that is different than the first type of touch motion.
  • the first type of touch motion and the second type of touch motion have different gestures on the physical component.
  • the first type of touch motion and the second type of touch motion have different touch forces on the physical component.
  • the first type of touch motion comprises a touch on the physical component
  • the second type of touch motion comprises depressing the physical component
  • the physical component is a physical button of the device.
  • the physical component is a volume button of the device.
  • the physical component is a power button of the device.
  • the physical button is a key for entering information.
  • the first function comprises starting an application program on the device.
  • the first function comprises activating a hardware on the device.
  • the first function comprises performing an operation on a touch screen of the device.
  • FIG. l illustrates a diagram of an embodiment cell phone
  • FIG. 2 illustrates a diagram of an embodiment volume input of a cell phone assembled in a chassis of the cell phone
  • FIG. 3 illustrates a diagram of another embodiment volume input with an ultrasonic sensor attached underneath
  • FIG. 4 illustrates a flowchart of an embodiment method showing operations of a handheld device
  • FIG. 5 illustrates a block diagram of a processing system
  • FIG. 6 illustrates a block diagram of a processing system.
  • Embodiments of the present disclosure make use of an existing physical component of a handheld device and ultrasonic sensing techniques to provide one or more functions for operating the handheld device.
  • an ultrasonic sensor including an ultrasonic transmitter and an ultrasonic receiver, is disposed underneath a physical input, such as a volume button, or a power button.
  • the physical input is configured to activate a first function of the handheld device when a first type of touch motion, e.g., a depressing (or“click”) motion, is applied on the physical input.
  • the ultrasonic sensor is configured to detect a second type of touch motion on the physical input and activate a second function of the device when the second type of touch motion, e.g., a slide touch or a non-slide touch, on the physical input is detected by the ultrasonic sensor.
  • the touch force on the physical input that is detectable by the ultrasonic sensor can be less than 20 grams, and is adjustable, while the depressing motion on the physical input may require a touch force more than 200 grams.
  • the touch motion can be performed on the physical input without interfering with the existing depressing motion (or press, or rock) configured for the physical input.
  • Embodiments in the following of the present disclosure will be described with respect to a cell phone. The embodiments, however, may also be applied to other handheld devices, such as a handheld tablet or iPad, without departing from the spirit of the present disclosure.
  • FIG. 1 illustrates a diagram of an embodiment cell phone too.
  • the cell phone may be a smart phone.
  • the cell phone too includes a screen 102 for displaying information, a volume input 104 used to adjust (increase or decrease) volumes, and a power input 106 used to power on or power off the cell phone too.
  • the screen 102 may be a touch screen or a multi-touch screen.
  • the volume input and the power input are located on the perimeter (or sides) of a cell phone.
  • FIG. 1 shows that the volume input 104 is located on the left side of the cell phone too, and the power input 106 is located on the right side of the cell phone too.
  • the volume input 104 or the power button 106 may be positioned in locations different than what is shown in FIG.
  • FIG. 1 also shows a hand 110 of a user holding the cell phone too, which does not lose generality of holding handheld cell phones by many users.
  • the fingers of the user are holding the perimeter of the cell phone too.
  • the thumb 112 of the user is holding the cell phone too at one side (the right side as shown), and the other four fingers are holding the cell phone too at the other side (the left side as shown). Holding the cell phone too in this way, the user may operate the power input 06 with his/her thumb 112, and operate the volume input 104 with his/her other fingers, such as using the index finger 114 or middle finger 116.
  • An interaction with the screen may include performing an operation on the screen.
  • interaction with the screen may include making selection on the screen (e.g., of an option or notification), making confirmation on the screen (e.g., of an option or notification), launching or closing applications, browsing web pages, moving an item displayed on the screen, etc.
  • the user may be able to use his/her thumb 112 to interact with the screen 102 in a limited way, such as swiping or touch within a region on the screen that the thumb 112 can reach.
  • the user may interact with the screen 102 using only the hand 110 while the hand 110 is holding the perimeter of the cell phone too.
  • the user may have to stretch the thumb 112 on touch the screen while holding the perimeter of the cell phone too, or the thumb 112 needs to reach the upper half of the screen 102, which may be hard or impossible to do.
  • Embodiments of the present disclosure provide methods that make use of an existing physical input on a handheld device and an ultrasonic sensing technology to provide one or more functions for operating the handheld device.
  • an embodiment may integrate slide and/or light touch motions on the top of a physical input of a handheld device (such as a volume or power input, which is intuitive to find and register) by use of the ultrasonic sensing technology.
  • Examples of a function that may be provided may include interacting with a screen of the handheld device (such as making selection on the screen, making confirmation on the screen, launching or closing applications, browsing web pages, moving an item displayed on the screen, or other applicable interaction), starting and closing an application or a hardware (such as turning on and off a flashlight, or starting and closing a camera program, a voice assistant, making a screenshot, enabling or disabling Wi-Fi, etc.), receiving emails, messages or notifications, and other applicable functions.
  • a“physical input” of a handheld device refers to a tangible component of the handheld device that is visible to users and accessible by users.
  • Examples of a physical input may include a volume button or key, a power button or key, a lock key, a keyboard key (e.g., for entering information, such as typing a letter or a number), or any other button or key.
  • a volume button or key e.g., a volume button or key
  • a power button or key e.g., a power button or key
  • a lock key e.g., a keyboard key
  • keyboard key e.g., for entering information, such as typing a letter or a number
  • any other button or key e.g., for entering information, such as typing a letter or a number
  • Ultrasonic sensing is a technology that measures the distance to an object using sound waves. This is typically done by an ultrasonic sensor, which may also be called an ultrasonic transducer (e.g., a piezo ceramic transducer) or transceiver.
  • An ultrasonic sensor may be configured to serve as an ultrasonic transmitter and/or ultrasonic receiver, e.g., through control by a driver IC.
  • An ultrasonic transmitter generates and transmits (as a transmitter) high frequency sound waves, and an ultrasonic receiver receives the sound waves that are bounced back from an object. The time interval between transmitting the sound waves and receiving the sound waves that are bounced back is calculated to determine the distance from the object.
  • the technology may be used to detect any object touching a surface with high accuracy, where an ultrasonic transceiver is attached on the back-side of the surface.
  • the technology may be used to detect a touch position, a touch area, and a touch force for touch points on a surface.
  • the touch force on the surface that detectable by an ultrasonic sensor can be less than 50 grams or even to grams, and is adjustable.
  • an ultrasonic sensor may include one or more transmitters and one or more receivers.
  • one or more ultrasonic sensors may be placed underneath a physical input of a handheld device, and configured to detect a touch motion performed on the physical input.
  • an ultrasonic sensor may be attached on the back side (or back surface) of the physical input.
  • the ultrasonic sensor may be connected to a main printed circuit board (PCB) by a flexible PCB.
  • PCB main printed circuit board
  • the ultrasonic sensor is placed underneath the input such that a touch on the input may be detectable by the ultrasonic sensor. This also facilitates manufacturing, where the ultrasonic sensor may be attached to a surface of the input facing inwardly.
  • the input e.g., an existing input of the handheld device
  • the input may have been configured to detect a first type of operating motion on the input, and detection of the first type of operating motion may be configured to activate a first function of the handheld device.
  • the first type of operating motion may be a depressing motion that has conventionally been configured for the input, such as a pushing (or pressing) down motion, a rotating motion or a rocking motion.
  • the depressing motion requires an activation force greater than 200 grams.
  • the ultrasonic sensor may be configured to detect a second type of operating motion on the input, and detection of the second type of operating motion may be configured to activate a second function of the handheld device that is different from the first function activated by the depressing motion.
  • the second type of operating motion does not move the input, e.g., does not depress the physical input.
  • the second type of operating motion may be a touch motion that is detectable by the ultrasonic sensor.
  • the touch motion may include a slide touch on the input or a non-slide touch on the input. In this way, the touch motion and the depressing motion are integrated on the input. Multiple functions may be activated by use of the input and the ultrasonic sensor.
  • Users may adjust the sensitivity of the touch motion on the input that may be detected by the ultrasonic sensor. Users may also adjust the type of functions that may be activated upon detection of the touch motion on the input. Adjustment of the sensitivity and the type of functions may be performed by configuring settings of the handheld device.
  • a user may perform a slide touch on the input surface lightly (i.e., compared with the depressing motion on the input), and the ultrasonic sensor detects the location of one or more fingers (e.g., the forefinger 114 or the thumb 112, depending on which finger is performing the touch and where the input is located on the handheld device), and converts the detection of the slide touch to a function (e.g., activating the function) for selecting from various options, such as selecting to launch one of multiple most used applications, e.g., messages, camera, facetime, or emails.
  • the cell phone may display the selectable options on the screen.
  • the user may then touch (non-slide touch detectable by the ultrasonic sensor instead of the input) the input (the surface of the input) to make a selection of the options (e.g., selecting one application to launch).
  • a touch motion on the input may be used to perform an operation that used to be performed by a user with additional touches on the screen.
  • Configuration of the second function activated by the second type of operating motion on the input that is detected by the ultrasonic sensor has little or no impact on the existing function of the physical input because of the light force motion that is detectable by the ultrasonic sensor.
  • the touch force on the surface that is detectable by an ultrasonic sensor can be less than 20 grams, and is adjustable, while the depressing motion may require a touch force more than 200 grams.
  • the touch motion can be performed on the input without interfering with an existing depressing motion (or press, or rock) configured for the input.
  • the configuration of the second function that is enabled by use of the ultrasonic sensor makes it possible for the user to use a single hand maneuver to operate the handheld device, with no need to stretch the fingers (e.g., the thumb 112) back and forth frequently on the screen for performing multiple interactions with the screen.
  • FIG. 2 illustrates a diagram of an embodiment volume input 200 of a cell phone assembled in a chassis 220 of the cell phone.
  • the volume input 200 has a top (or front) surface 210, which is the surface that is exposed outside of the cell phone and that will be touched by a user to adjust the volume, and a bottom (or back) surface 212 that is inside the cell phone and not touchable by the user.
  • the volume input 200 is configured to adjust volumes of the cell phone. Specifically, depressing (“clicking”) on a top portion 214 of the top surface 210 of the volume input 200 increases the volume, and depressing
  • the volume input 200 also includes two legs 202 and 204 protruding from the bottom surface 212 away from the top surface 210, each connecting to a contact tactile switch 206 and a contact tactile switch 208, respectively.
  • the push down motion on the top portion 214 of the volume input 200 switches the contact tactile switch 206, and activates increasing of the volume.
  • the push down motion on the bottom portion 216 of the volume input 200 switches the contact tactile switch 208, and activates decreasing of the volume.
  • An ultrasonic sensor may be embedded underneath the volume input 200.
  • the ultrasonic sensor may be attached (e.g., glued) to the bottom surface 212, as shown in FIG. 2.
  • the ultrasonic sensor in this example, includes an ultrasonic transmitter 232 and two ultrasonic receivers 234 and 236.
  • the ultrasonic transmitter 232 and the ultrasonic receivers 234 and 236 are connected to a PCB in the chassis 220. Based on transmitted and received ultrasonic signals, it can be determined whether there is a touch motion performed on the volume input 200 and what type of touch motion it is, e.g., a slide touch or a non-slide touch.
  • a depressing motion on the volume input 210 that switches the contact tactile switch 206 or 208 activates the functions of increasing or decreasing the volume, as configured
  • a touch motion on the volume input 210 that is detectable by the ultrasonic sensor may be configured to activate a different function, such as launching an application, or making a selection on a screen, or any function as discussed above. Because the activation force (e.g., generally more than 200 grams) required for switching the contact tactile switch 206 or 208 is much greater than the touch (or contact) force (e.g., less than 50 grams or even 10 grams) required by the ultrasonic sensor, configuration may be made such that the conventional function of the volume input is not impacted by the touch motion on the volume input detectable by the ultrasonic sensor.
  • the ultrasonic sensor may be configured such that it does not activate any function when detecting that a force greater than a threshold, e.g., 150 grams, is applied on the volume input.
  • a threshold e.g. 150 grams
  • the volume input 210 is pressed down in a conventional way, which switches the contact tactile switches, the user adjusts the volume.
  • the user performs a slide touch or a lightly contact touch on the volume input 210, which is detectable by the ultrasonic sensor, the user activates a different function that may be configurable by the user.
  • a circuit may be designed to covert a detection result of the ultrasonic sensor to activation of a function on the cell phone.
  • Activating a function based on a sensor detection result is a well-known technique to those of ordinary skill in the art and thus is not described herein.
  • FIG. 2 illustrates that one ultrasonic transmitter 232 and two ultrasonic receivers 234 and 236 are placed underneath the volume input 200, for illustrative purposes.
  • the volume input 200 may have one or more ultrasonic transmitters and one or more ultrasonic receivers attached on its bottom surface.
  • the volume input 200 may have one transmitter and one receiver embedded, or one transmitter and three receiver embedded, or two transmitters and two receivers.
  • the number of the ultrasonic transmitters and receivers that may be embedded underneath the volume input may be determined based on the size of the volume input and the sizes of the ultrasonic transmitters and receivers.
  • the locations of the ultrasonic transmitters and receivers on the bottom surface 212 may also vary, e.g., based on the sizes of the volume input and the ultrasonic transmitters and receivers, and/ or the locations of the structure of the volume input, e.g., the legs 202 and 204.
  • the ultrasonic transmitters and receivers may be evenly spaced on the bottom surface 212.
  • the transmitter 232 is placed between the two legs 202 and 204.
  • One receiver 234 is placed between the leg 202 and one end of the volume input 200
  • the other receiver 236 is placed between the leg 204 and the other end of the volume input 200.
  • FIG. 3 illustrates a diagram of another embodiment volume input 300 with an ultrasonic sensor attached underneath.
  • the volume input 300 includes a top surface 312, a bottom surface 314, and two legs 316 and 318 for switching on contact tactile switches.
  • An ultrasonic transmitter 322 and an ultrasonic receiver 324 are attached on the bottom surface 314, between the two legs 316 and 318.
  • the volume input has a length Li.
  • the ultrasonic transmitter 322 and the ultrasonic receiver 324 have the same length L2.
  • the distance between the two legs 316 and 318 is L3.
  • the number and locations of ultrasonic transmitters and receivers may be determined. For example, in a case where Li is 20mm, L2 is 2.5mm, and L3 is 12mm, one transmitter and one receiver may be placed between the two legs 316 and 318 (as shown in FIG. 3), or, one transmitter and two receivers may be placed, e.g., evenly, between the two legs 316 and 318 (not shown).
  • a predetermined number of the ultrasonic transmitters and receivers may be attached (e.g., glued) to the bottom surface (e.g., 212 or 314) of a predetermined input at predetermined locations.
  • the input may then be assembled on a chassis.
  • the distances from each of the ultrasonic transmitters and receivers to the top surface (e.g., 210 or 312) of the input may be the same or about the same with a difference satisfying a threshold.
  • the embodiments above may be applied to any applicable inputs that are on the perimeter of a handheld device.
  • the embodiments may also be applied to other physical components of a handheld device that are accessible for operating or using the handheld device.
  • a physical component may be removable from the handheld device, or accessible by users of the handheld device, or may be separated from chassis of the handheld device, such that one or more ultrasonic sensors may be attached to the component before the physical component being assembled in the chassis of the handheld device in manufacturing, and may be conveniently connected to a PCB.
  • the ultrasonic sensor may be configured to detection a touch motion on the physical component.
  • Examples of a physical component may include a SIM card door, or a rear camera trim, or other applicable component.
  • an ultrasonic sensor may be attached to the back of a glass cover (for cosmetic purposes) of a cell phone. A touch on the glass cover surface may be detected by the ultrasonic sensor and activates a function.
  • the embodiments make use of an existing physical component of a handheld device and one or more ultrasonic sensors or an ultrasonic array to provide more functions for using or operating the handheld device.
  • the functions may be used to enable single hand operation of the handheld device, or further facilitate operations of the handheld device.
  • users do not need to learn and remember new positions one the handheld device for using a new function, and the exterior appearance of the handheld device remains unaffected.
  • the embodiments improve user experience without adding additional burden on users.
  • FIG. 4 illustrates a flowchart of an embodiment method 400 showing operations of a device.
  • the device detects, using an ultrasonic sensor disposed underneath a physical component of the device, a first type of touch motion applied on the physical component, where the ultrasonic sensor includes an ultrasonic transmitter and an ultrasonic receiver, and is configured to detect the first type of touch motion on the physical component.
  • the device activates a first function on the device upon detection of the first type of touch motion applied on the physical component, where the first function is associated with the detection of the first type of touch motion on the physical component.
  • FIG. 5 is a block diagram of a processing system 500 that may be used for implementing the devices and methods disclosed herein.
  • the processing system may comprise a processing unit equipped with one or more input/output devices, such as a speaker, microphone, mouse, touchscreen, keypad, keyboard, printer, display, and the like.
  • the processing unit may include a central processing unit (CPU), memory, a mass storage device, a video adapter, and an I/O interface connected to a bus.
  • the bus may be one or more of any type of several bus architectures including a memory bus or memory controller, a peripheral bus, video bus, or the like.
  • the CPU may comprise any type of electronic data processor.
  • the memory may comprise any type of non-transitory system memory such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), read-only memory (ROM), a combination thereof, or the like.
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous DRAM
  • ROM read-only memory
  • the memory may include ROM for use at boot-up, and DRAM for program and data storage for use while executing programs.
  • the mass storage device may comprise any type of non-transitory storage device configured to store data, programs, and other information and to make the data, programs, and other information accessible via the bus.
  • the mass storage device may comprise, for example, one or more of a solid state drive, hard disk drive, a magnetic disk drive, an optical disk drive, or the like.
  • the video adapter and the I/O interface provide interfaces to couple external input and output devices to the processing unit.
  • input and output devices include the display coupled to the video adapter, and the
  • USB Universal Serial Bus
  • the processing unit also includes one or more network interfaces, which may comprise wired links, such as an Ethernet cable or the like, and/or wireless links to access nodes or different networks.
  • the network interface allows the processing unit to communicate with remote units via the networks.
  • the network interface may provide wireless communication via one or more transmitters/transmit antennas and one or more receivers/receive antennas.
  • the processing unit is coupled to a local-area network or a wide-area network for data processing and communications with remote devices, such as other processing units, the Internet, remote storage facilities, or the like.
  • FIG. 6 illustrates a block diagram of another embodiment processing system 600 that may be used for implementing the devices and methods disclosed herein, which may be installed in a host device.
  • the processing system 600 includes a processor 604, a memory 606, and interfaces 610-614, which may (or may not) be arranged as shown in the figure.
  • the processor 604 may be any component or collection of components adapted to perform computations and/ or other processing related tasks
  • the memory 606 may be any component or collection of components adapted to store programming and/or instructions for execution by the processor 604.
  • the memory 606 includes a non- transitory computer readable medium.
  • the interfaces 610, 612, 614 may be any component or collection of components that allow the processing system 600 to communicate with other devices/components and/or a user.
  • one or more of the interfaces 610, 612, 614 may be adapted to communicate data, control, or management messages from the processor 604 to applications installed on the host device and/or a remote device.
  • one or more of the interfaces 610, 612, 614 may be adapted to allow a user or user device (e.g., personal computer (PC), etc.) to interact/communicate with the processing system 600.
  • the processing system 600 may include additional components not depicted in the figure, such as long term storage (e.g., non-volatile memory, etc.).
  • the processing system 600 is in a user-side device accessing a wireless or wireline telecommunications network, such as a mobile station, a user equipment (UE), a personal computer (PC), a tablet, a wearable communications device (e.g., a smartwatch, etc.), or any other handheld device.
  • the user-side device may be adapted to access a telecommunications network.
  • one or more of the interfaces 610, 612, 614 connects the processing system 600 to a transceiver adapted to transmit and receive signaling over the telecommunications network.
  • a signal may be transmitted by a transmitting unit or a transmitting module.
  • a signal may be received by a receiving unit or a receiving module.
  • a signal may be processed by a processing unit or a processing module.
  • Other steps may be performed by a detecting unit/module, an activating unit/module, and/or an inputting unit/module.
  • the respective units/modules may be hardware, software, or a combination thereof.
  • one or more of the units/modules may be an integrated circuit, such as field programmable gate arrays (FPGAs) or application- specific integrated circuits (ASICs).
  • FPGAs field programmable gate arrays
  • ASICs application- specific integrated circuits

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A device may include a physical input configured to activate a first function of the device when a first type of touch motion on the physical input is detected by the physical input. The device may also include an ultrasonic sensor that includes an ultrasonic transmitter and a first ultrasonic receiver. The ultrasonic sensor is disposed underneath the physical input, and configured to detect a second type of touch motion on the physical input, and activate a second function of the device upon detection of the second type of touch motion on the physical input by the ultrasonic sensor. Thus, different functionalities can be accommodated in a single physical implement by enabling different functions responsive to different touch forces and/or touch motions.

Description

METHOD AND APPARATUS OF INTEGRATING SLIDE AND TOUCH ON AN
INPUT DEVICE
The application claims priority of U.S. Provisional Application No. 62/687,796, entitled “Method of Integrating Slide and Touch on Buttons” filed on June 20, 2018.
TECHNICAL FIELD
The present disclosure relates generally to a system and method for the use of function input devices on a handheld device and, in particular embodiments, to a system and method for integrating slide and touch functionality on an input of on a handheld device.
BACKGROUND
Handheld devices, such as cell phones, tablets, iPads, etc., have greatly facilitated and enriched people’s daily life. Various technologies, including software and hardware, have been developed to enable and facilitate the use of the handheld devices over the time in the past, and new technologies continue to be developed such that a handheld device can be operated in a more convenient way.
SUMMARY
According to one aspect of the present disclosure, there is provided a device that includes a physical input, configured to activate a first function of the device when a first type of touch motion is detected on the physical input, and an ultrasonic sensor comprising an ultrasonic transmitter and a first ultrasonic receiver. The physical input can be in the form of, for example, a depressible or laterally-displaceable button or knob. The ultrasonic sensor can be disposed underneath the physical input and configured to detect a second type of touch motion on the physical input and activate a second function of the device when the second type of touch motion is detected on the physical input. The second type of touch motion can be of a different force or motion from the first type of touch motion.
The forgoing aspect enables integration of two different types of touch motions on the same physical input, which activate different functions on the device, respectively. This allows users to operate the same physical input and activate different functions. This greatly simplifies the users’ operations for activating the different functions and operating the device, especially when the users have already been familiar to the location of the physical inputs on the device. The forgoing aspect thus improves user experience.
Optionally, in any one of preceding aspects, the second function comprises starting an application program on the device. Optionally, in any one of preceding aspects, the second function comprises activating a hardware on the device.
Optionally, in any one of preceding aspects, the second function comprises performing an operation on a touch screen of the device.
Optionally, in any one of preceding aspects, the first type of touch motion and the second type of touch motion have different gestures on the physical input.
Optionally, in any one of preceding aspects, the first type of touch motion comprises depressing the physical input, and the second type of touch motion comprises a sliding touch on the physical input.
Optionally, in any one of preceding aspects, the first type of touch motion and the second type of touch motion have different touch forces on the physical input.
Optionally, in any one of preceding aspects, the physical input is a volume input of the device.
Optionally, in any one of preceding aspects, the physical input is a power input of the device.
Optionally, in any one of preceding aspects, the physical input is a key for inputting information into the device.
Optionally, in any one of preceding aspects, the device further comprises: a touch screen for displaying information.
Optionally, in any one of preceding aspects, the device further comprises: a second ultrasonic receiver, disposed underneath the physical button.
According to another aspect of the present disclosure, there is provided a method that includes: detecting, by a device using an ultrasonic sensor disposed underneath a physical component of the device, a first type of touch motion applied on the physical component, the ultrasonic sensor comprising an ultrasonic transmitter and an ultrasonic receiver, and being configured to detect the first type of touch motion on the physical component, and activating, by the device, a first function on the device upon detection of the first type of touch motion applied on the physical component, the first function being associated with the detection of the first type of touch motion on the physical component.
The forgoing aspect enables use of an existing physical component of a device to activate a function on the device by applying a touch motion on the physical component. This greatly simplifies users’ operations for activating the function, especially when the users have already been familiar to the location of the physical component. The forgoing aspect thus improves user experience. Optionally, in any one of preceding aspects, the method further comprises: detecting, by the device using the physical component, a second type of touch motion applied on the physical component that is different than the first type of touch motion, and activating, by the device, a second function on the device upon detection of the second type of touch motion applied on the physical component, the second function associated with detection of the second type of touch motion on the physical component and different than the first function.
Optionally, in any one of preceding aspects, the first type of touch motion and the second type of touch motion have different gestures on the physical component.
Optionally, in any one of preceding aspects, the first type of touch motion and the second type of touch motion have different touch forces on the physical component.
Optionally, in any one of preceding aspects, the first type of touch motion comprises a touch on the physical component, and the second type of touch motion comprises depressing the physical component.
Optionally, in any one of preceding aspects, the physical component is a physical button or key.
Optionally, in any one of preceding aspects, the physical component is a volume button of the device.
Optionally, in any one of preceding aspects, the physical component is a power button of the device.
Optionally, in any one of preceding aspects, the physical component is a key for entering information.
Optionally, in any one of preceding aspects, the first function comprises starting an application program on the device.
Optionally, in any one of preceding aspects, the first function comprises activating a hardware on the device.
Optionally, in any one of preceding aspects, the first function comprises performing an operation on a touch screen of the device.
According to another aspect of the present disclosure, there is provided a device that comprises a physical component that is accessible for using the device, and an ultrasonic sensor comprising an ultrasonic transmitter and an ultrasonic receiver, the ultrasonic sensor disposed underneath the physical component, and configured to detect a first type of touch motion applied on the physical component and activate a first function of the device upon detection of the first type of touch motion on the physical component. The forgoing aspect enables use of an existing physical component of a device that activates a function on the device when a touch motion is detected on the physical component. This greatly simplifies users’ operations for activating the function and operating the device, especially when the users have already been familiar to the location of the physical component. The forgoing aspect thus improves user experience.
Optionally, in any one of preceding aspects, the physical component is configured to activate a second function of the device upon detecting, by the physical component, a second type of touch motion applied on the physical component that is different than the first type of touch motion.
Optionally, in any one of preceding aspects, the first type of touch motion and the second type of touch motion have different gestures on the physical component.
Optionally, in any one of preceding aspects, the first type of touch motion and the second type of touch motion have different touch forces on the physical component.
Optionally, in any one of preceding aspects, the first type of touch motion comprises a touch on the physical component, and the second type of touch motion comprises depressing the physical component.
Optionally, in any one of preceding aspects, the physical component is a physical button of the device.
Optionally, in any one of preceding aspects, the physical component is a volume button of the device.
Optionally, in any one of preceding aspects, the physical component is a power button of the device.
Optionally, in any one of preceding aspects, the physical button is a key for entering information.
Optionally, in any one of preceding aspects, the first function comprises starting an application program on the device.
Optionally, in any one of preceding aspects, the first function comprises activating a hardware on the device.
Optionally, in any one of preceding aspects, the first function comprises performing an operation on a touch screen of the device. BRIEF DESCRIPTION OF THE DRAWINGS
For a more complete understanding of the present disclosure, and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:
FIG. l illustrates a diagram of an embodiment cell phone;
FIG. 2 illustrates a diagram of an embodiment volume input of a cell phone assembled in a chassis of the cell phone;
FIG. 3 illustrates a diagram of another embodiment volume input with an ultrasonic sensor attached underneath;
FIG. 4 illustrates a flowchart of an embodiment method showing operations of a handheld device;
FIG. 5 illustrates a block diagram of a processing system; and
FIG. 6 illustrates a block diagram of a processing system.
DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS
The structure, manufacture and use of the presently preferred embodiments are discussed in detail below. It should be appreciated, however, that the present disclosure provides many applicable novel concepts that can be embodied in a wide variety of specific contexts. The specific embodiments discussed are merely illustrative of specific ways to make and use the embodiments, and do not limit the scope of the disclosure.
Various technologies have been development and utilized on handheld devices to facilitate operation of the handheld devices, e.g., facilitating single hand maneuver of a handheld device. Embodiments of the present disclosure make use of an existing physical component of a handheld device and ultrasonic sensing techniques to provide one or more functions for operating the handheld device.
In some embodiments, an ultrasonic sensor, including an ultrasonic transmitter and an ultrasonic receiver, is disposed underneath a physical input, such as a volume button, or a power button. The physical input is configured to activate a first function of the handheld device when a first type of touch motion, e.g., a depressing (or“click”) motion, is applied on the physical input. The ultrasonic sensor is configured to detect a second type of touch motion on the physical input and activate a second function of the device when the second type of touch motion, e.g., a slide touch or a non-slide touch, on the physical input is detected by the ultrasonic sensor. The touch force on the physical input that is detectable by the ultrasonic sensor can be less than 20 grams, and is adjustable, while the depressing motion on the physical input may require a touch force more than 200 grams. Thus, the touch motion can be performed on the physical input without interfering with the existing depressing motion (or press, or rock) configured for the physical input.
By use of the existing physical input and the ultrasonic sensor, different touch motions on the same physical input may activate different functions. This greatly simplifies users’ operations for activating the different functions, especially when the users have already been familiar to the location of the physical input on the handheld device. The embodiments thus improve user experience without adding much additional burden on the users. Details of the embodiments will be provided in the following.
Embodiments in the following of the present disclosure will be described with respect to a cell phone. The embodiments, however, may also be applied to other handheld devices, such as a handheld tablet or iPad, without departing from the spirit of the present disclosure.
Cell phones are becoming more and more popular for their powerful functions and high portability. With technologies that have been developed, cell phones have evolved from having a considerable number of physical inputs, keys and/or switches, and a small screen to having a few physical inputs and a large screen. Among the a few physical inputs are a volume button and a power button, which are still provided on many current cell phones. Many users have already got familiar with positions of the physical volume button and power button on a cell phone. It is easy for them to find and operate these buttons. Users are able to get a tactile feeling, and hear a crisp“click” sound when operating these buttons, and this gives them confidence in use of the cell phone.
FIG. 1 illustrates a diagram of an embodiment cell phone too. The cell phone may be a smart phone. As shown, the cell phone too includes a screen 102 for displaying information, a volume input 104 used to adjust (increase or decrease) volumes, and a power input 106 used to power on or power off the cell phone too. The screen 102 may be a touch screen or a multi-touch screen. Generally, the volume input and the power input are located on the perimeter (or sides) of a cell phone. FIG. 1 shows that the volume input 104 is located on the left side of the cell phone too, and the power input 106 is located on the right side of the cell phone too. The volume input 104 or the power button 106 may be positioned in locations different than what is shown in FIG. 1, and can be configured as a number of different types of input devices, such as switches, depressible buttons, and the like. For example, the volume input 104 may be on the right side and the power input 106 may be on the left side. In another example, the volume input 104 may be on the top side of the cell phone too. FIG. 1 also shows a hand 110 of a user holding the cell phone too, which does not lose generality of holding handheld cell phones by many users. The fingers of the user are holding the perimeter of the cell phone too. The thumb 112 of the user is holding the cell phone too at one side (the right side as shown), and the other four fingers are holding the cell phone too at the other side (the left side as shown). Holding the cell phone too in this way, the user may operate the power input 06 with his/her thumb 112, and operate the volume input 104 with his/her other fingers, such as using the index finger 114 or middle finger 116.
While the user holding the cell phone too with the hand 110, he/she may use the other hand to interact with the screen 102, i.e., interacting with the cell phone too on the screen. An interaction with the screen may include performing an operation on the screen. For example, interaction with the screen may include making selection on the screen (e.g., of an option or notification), making confirmation on the screen (e.g., of an option or notification), launching or closing applications, browsing web pages, moving an item displayed on the screen, etc. The user may be able to use his/her thumb 112 to interact with the screen 102 in a limited way, such as swiping or touch within a region on the screen that the thumb 112 can reach. However, it is generally inconvenient for the user to interact with the screen 102 using only the hand 110 while the hand 110 is holding the perimeter of the cell phone too. For example, the user may have to stretch the thumb 112 on touch the screen while holding the perimeter of the cell phone too, or the thumb 112 needs to reach the upper half of the screen 102, which may be hard or impossible to do. It is desirable to provide an intuitive and convenient way for the user to interact with on-screen information using a single hand.
There are phones currently in the market that use a virtual input to enable a squeeze-based selection. However, it is hard to adjust the squeeze force. Further, by use of a virtual input instead of a physical input, user experience degrades because it is difficult to find the location of the virtual input, develop a tactile feeling, and hear the crisp“click” sound users have come to expect when operating a physical input, such as a button.
Embodiments of the present disclosure provide methods that make use of an existing physical input on a handheld device and an ultrasonic sensing technology to provide one or more functions for operating the handheld device. Specifically, an embodiment may integrate slide and/or light touch motions on the top of a physical input of a handheld device (such as a volume or power input, which is intuitive to find and register) by use of the ultrasonic sensing technology. Examples of a function that may be provided may include interacting with a screen of the handheld device (such as making selection on the screen, making confirmation on the screen, launching or closing applications, browsing web pages, moving an item displayed on the screen, or other applicable interaction), starting and closing an application or a hardware (such as turning on and off a flashlight, or starting and closing a camera program, a voice assistant, making a screenshot, enabling or disabling Wi-Fi, etc.), receiving emails, messages or notifications, and other applicable functions. As used herein, a“physical input” of a handheld device refers to a tangible component of the handheld device that is visible to users and accessible by users. Examples of a physical input may include a volume button or key, a power button or key, a lock key, a keyboard key (e.g., for entering information, such as typing a letter or a number), or any other button or key. A benefit of the embodiments making use of existing physical inputs is that the existing physical inputs have become components familiar to users, and they are intuitive and convenient to find and register by users. The terms of“physical input” and“input” will be used interchangeably throughout the disclosure.
Ultrasonic sensing is a technology that measures the distance to an object using sound waves. This is typically done by an ultrasonic sensor, which may also be called an ultrasonic transducer (e.g., a piezo ceramic transducer) or transceiver. An ultrasonic sensor may be configured to serve as an ultrasonic transmitter and/or ultrasonic receiver, e.g., through control by a driver IC. An ultrasonic transmitter generates and transmits (as a transmitter) high frequency sound waves, and an ultrasonic receiver receives the sound waves that are bounced back from an object. The time interval between transmitting the sound waves and receiving the sound waves that are bounced back is calculated to determine the distance from the object. The technology may be used to detect any object touching a surface with high accuracy, where an ultrasonic transceiver is attached on the back-side of the surface. The technology may be used to detect a touch position, a touch area, and a touch force for touch points on a surface. The touch force on the surface that detectable by an ultrasonic sensor can be less than 50 grams or even to grams, and is adjustable.
In the present disclosure, the terms of“ultrasonic transmitter” and“transmitter” are used interchangeably, the terms of“ultrasonic receiver” and“receiver” are used interchangeably, and the terms of“ultrasonic transceiver” and“transceiver” are used interchangeably. As used in the present disclosure, an ultrasonic sensor (or ultrasonic transceiver or transducer) may include one or more transmitters and one or more receivers.
In some embodiments, one or more ultrasonic sensors may be placed underneath a physical input of a handheld device, and configured to detect a touch motion performed on the physical input. For example, an ultrasonic sensor may be attached on the back side (or back surface) of the physical input. The ultrasonic sensor may be connected to a main printed circuit board (PCB) by a flexible PCB. The ultrasonic sensor is placed underneath the input such that a touch on the input may be detectable by the ultrasonic sensor. This also facilitates manufacturing, where the ultrasonic sensor may be attached to a surface of the input facing inwardly. The input, e.g., an existing input of the handheld device, may have been configured to detect a first type of operating motion on the input, and detection of the first type of operating motion may be configured to activate a first function of the handheld device. The first type of operating motion may be a depressing motion that has conventionally been configured for the input, such as a pushing (or pressing) down motion, a rotating motion or a rocking motion. Typically, the depressing motion requires an activation force greater than 200 grams.
The ultrasonic sensor may be configured to detect a second type of operating motion on the input, and detection of the second type of operating motion may be configured to activate a second function of the handheld device that is different from the first function activated by the depressing motion. The second type of operating motion does not move the input, e.g., does not depress the physical input. The second type of operating motion may be a touch motion that is detectable by the ultrasonic sensor. The touch motion may include a slide touch on the input or a non-slide touch on the input. In this way, the touch motion and the depressing motion are integrated on the input. Multiple functions may be activated by use of the input and the ultrasonic sensor. Users may adjust the sensitivity of the touch motion on the input that may be detected by the ultrasonic sensor. Users may also adjust the type of functions that may be activated upon detection of the touch motion on the input. Adjustment of the sensitivity and the type of functions may be performed by configuring settings of the handheld device.
In one example, a user may perform a slide touch on the input surface lightly (i.e., compared with the depressing motion on the input), and the ultrasonic sensor detects the location of one or more fingers (e.g., the forefinger 114 or the thumb 112, depending on which finger is performing the touch and where the input is located on the handheld device), and converts the detection of the slide touch to a function (e.g., activating the function) for selecting from various options, such as selecting to launch one of multiple most used applications, e.g., messages, camera, facetime, or emails. In response to the slide touch, the cell phone may display the selectable options on the screen. The user may then touch (non-slide touch detectable by the ultrasonic sensor instead of the input) the input (the surface of the input) to make a selection of the options (e.g., selecting one application to launch). Thus, a touch motion on the input may be used to perform an operation that used to be performed by a user with additional touches on the screen.
Configuration of the second function activated by the second type of operating motion on the input that is detected by the ultrasonic sensor has little or no impact on the existing function of the physical input because of the light force motion that is detectable by the ultrasonic sensor. The touch force on the surface that is detectable by an ultrasonic sensor can be less than 20 grams, and is adjustable, while the depressing motion may require a touch force more than 200 grams. The touch motion can be performed on the input without interfering with an existing depressing motion (or press, or rock) configured for the input. The configuration of the second function that is enabled by use of the ultrasonic sensor makes it possible for the user to use a single hand maneuver to operate the handheld device, with no need to stretch the fingers (e.g., the thumb 112) back and forth frequently on the screen for performing multiple interactions with the screen.
Taking a volume input of a cell phone as an illustrative example, an ultrasonic sensor may be embedded underneath the volume input, such that different operating motions performed on the volume input may be applied and detected, and configured to activate different functions on the cell phone. FIG. 2 illustrates a diagram of an embodiment volume input 200 of a cell phone assembled in a chassis 220 of the cell phone. The volume input 200 has a top (or front) surface 210, which is the surface that is exposed outside of the cell phone and that will be touched by a user to adjust the volume, and a bottom (or back) surface 212 that is inside the cell phone and not touchable by the user. The volume input 200 is configured to adjust volumes of the cell phone. Specifically, depressing (“clicking”) on a top portion 214 of the top surface 210 of the volume input 200 increases the volume, and depressing
(“clicking”) the bottom portion 216 of the top surface 210 of the volume input 200 decreases the volume. The volume input 200 also includes two legs 202 and 204 protruding from the bottom surface 212 away from the top surface 210, each connecting to a contact tactile switch 206 and a contact tactile switch 208, respectively. The push down motion on the top portion 214 of the volume input 200 switches the contact tactile switch 206, and activates increasing of the volume. The push down motion on the bottom portion 216 of the volume input 200 switches the contact tactile switch 208, and activates decreasing of the volume.
An ultrasonic sensor may be embedded underneath the volume input 200. For example, the ultrasonic sensor may be attached (e.g., glued) to the bottom surface 212, as shown in FIG. 2. The ultrasonic sensor, in this example, includes an ultrasonic transmitter 232 and two ultrasonic receivers 234 and 236. The ultrasonic transmitter 232 and the ultrasonic receivers 234 and 236 are connected to a PCB in the chassis 220. Based on transmitted and received ultrasonic signals, it can be determined whether there is a touch motion performed on the volume input 200 and what type of touch motion it is, e.g., a slide touch or a non-slide touch.
A depressing motion on the volume input 210 that switches the contact tactile switch 206 or 208 activates the functions of increasing or decreasing the volume, as configured
conventionally. A touch motion on the volume input 210 that is detectable by the ultrasonic sensor may be configured to activate a different function, such as launching an application, or making a selection on a screen, or any function as discussed above. Because the activation force (e.g., generally more than 200 grams) required for switching the contact tactile switch 206 or 208 is much greater than the touch (or contact) force (e.g., less than 50 grams or even 10 grams) required by the ultrasonic sensor, configuration may be made such that the conventional function of the volume input is not impacted by the touch motion on the volume input detectable by the ultrasonic sensor. For example, the ultrasonic sensor may be configured such that it does not activate any function when detecting that a force greater than a threshold, e.g., 150 grams, is applied on the volume input. Thus, when the volume input 210 is pressed down in a conventional way, which switches the contact tactile switches, the user adjusts the volume. When the user performs a slide touch or a lightly contact touch on the volume input 210, which is detectable by the ultrasonic sensor, the user activates a different function that may be configurable by the user. A circuit may be designed to covert a detection result of the ultrasonic sensor to activation of a function on the cell phone.
Activating a function based on a sensor detection result is a well-known technique to those of ordinary skill in the art and thus is not described herein.
FIG. 2 illustrates that one ultrasonic transmitter 232 and two ultrasonic receivers 234 and 236 are placed underneath the volume input 200, for illustrative purposes. The volume input 200 may have one or more ultrasonic transmitters and one or more ultrasonic receivers attached on its bottom surface. For example, the volume input 200 may have one transmitter and one receiver embedded, or one transmitter and three receiver embedded, or two transmitters and two receivers. The number of the ultrasonic transmitters and receivers that may be embedded underneath the volume input may be determined based on the size of the volume input and the sizes of the ultrasonic transmitters and receivers. The locations of the ultrasonic transmitters and receivers on the bottom surface 212 may also vary, e.g., based on the sizes of the volume input and the ultrasonic transmitters and receivers, and/ or the locations of the structure of the volume input, e.g., the legs 202 and 204. For example, the ultrasonic transmitters and receivers may be evenly spaced on the bottom surface 212. In another example, as shown in FIG. 2, the transmitter 232 is placed between the two legs 202 and 204. One receiver 234 is placed between the leg 202 and one end of the volume input 200, and the other receiver 236 is placed between the leg 204 and the other end of the volume input 200. The number and locations of the ultrasonic transmitters and receivers may be determined at the design stage of the handheld devices. In some embodiments, when there are multiple inputs available on the handheld device, a longer or bigger input may be selected to have an ultrasonic sensor embedded underneath for integrating a slide/touch motion and a depressing motion on the input. Connection of the ultrasonic sensor to a PCB may also be considered when selecting a input. FIG. 3 illustrates a diagram of another embodiment volume input 300 with an ultrasonic sensor attached underneath. The volume input 300 includes a top surface 312, a bottom surface 314, and two legs 316 and 318 for switching on contact tactile switches. An ultrasonic transmitter 322 and an ultrasonic receiver 324 are attached on the bottom surface 314, between the two legs 316 and 318. The volume input has a length Li. The ultrasonic transmitter 322 and the ultrasonic receiver 324 have the same length L2. The distance between the two legs 316 and 318 is L3. Based on Li, L2 and L3, the number and locations of ultrasonic transmitters and receivers may be determined. For example, in a case where Li is 20mm, L2 is 2.5mm, and L3 is 12mm, one transmitter and one receiver may be placed between the two legs 316 and 318 (as shown in FIG. 3), or, one transmitter and two receivers may be placed, e.g., evenly, between the two legs 316 and 318 (not shown).
In manufacturing, a predetermined number of the ultrasonic transmitters and receivers may be attached (e.g., glued) to the bottom surface (e.g., 212 or 314) of a predetermined input at predetermined locations. The input may then be assembled on a chassis. For accurately detecting the touch motion on the input, it would be desirable that the distances from each of the ultrasonic transmitters and receivers to the top surface (e.g., 210 or 312) of the input may be the same or about the same with a difference satisfying a threshold.
The embodiments above may be applied to any applicable inputs that are on the perimeter of a handheld device. The embodiments may also be applied to other physical components of a handheld device that are accessible for operating or using the handheld device. Such a physical component may be removable from the handheld device, or accessible by users of the handheld device, or may be separated from chassis of the handheld device, such that one or more ultrasonic sensors may be attached to the component before the physical component being assembled in the chassis of the handheld device in manufacturing, and may be conveniently connected to a PCB. Thus, the ultrasonic sensor may be configured to detection a touch motion on the physical component. Examples of a physical component may include a SIM card door, or a rear camera trim, or other applicable component. For example, an ultrasonic sensor may be attached to the back of a glass cover (for cosmetic purposes) of a cell phone. A touch on the glass cover surface may be detected by the ultrasonic sensor and activates a function.
The embodiments make use of an existing physical component of a handheld device and one or more ultrasonic sensors or an ultrasonic array to provide more functions for using or operating the handheld device. The functions may be used to enable single hand operation of the handheld device, or further facilitate operations of the handheld device. By use of the existing physical components, users do not need to learn and remember new positions one the handheld device for using a new function, and the exterior appearance of the handheld device remains unaffected. Thus, the embodiments improve user experience without adding additional burden on users.
FIG. 4 illustrates a flowchart of an embodiment method 400 showing operations of a device. As shown, at step 402, the device detects, using an ultrasonic sensor disposed underneath a physical component of the device, a first type of touch motion applied on the physical component, where the ultrasonic sensor includes an ultrasonic transmitter and an ultrasonic receiver, and is configured to detect the first type of touch motion on the physical component. At step 404, the device activates a first function on the device upon detection of the first type of touch motion applied on the physical component, where the first function is associated with the detection of the first type of touch motion on the physical component. FIG. 5 is a block diagram of a processing system 500 that may be used for implementing the devices and methods disclosed herein. Specific devices may utilize all of the components shown, or only a subset of the components, and levels of integration may vary from device to device. Furthermore, a device may contain multiple instances of a component, such as multiple processing units, processors, memories, transmitters, receivers, etc. The processing system may comprise a processing unit equipped with one or more input/output devices, such as a speaker, microphone, mouse, touchscreen, keypad, keyboard, printer, display, and the like. The processing unit may include a central processing unit (CPU), memory, a mass storage device, a video adapter, and an I/O interface connected to a bus.
The bus may be one or more of any type of several bus architectures including a memory bus or memory controller, a peripheral bus, video bus, or the like. The CPU may comprise any type of electronic data processor. The memory may comprise any type of non-transitory system memory such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), read-only memory (ROM), a combination thereof, or the like. In an embodiment, the memory may include ROM for use at boot-up, and DRAM for program and data storage for use while executing programs.
The mass storage device may comprise any type of non-transitory storage device configured to store data, programs, and other information and to make the data, programs, and other information accessible via the bus. The mass storage device may comprise, for example, one or more of a solid state drive, hard disk drive, a magnetic disk drive, an optical disk drive, or the like.
The video adapter and the I/O interface provide interfaces to couple external input and output devices to the processing unit. As illustrated, examples of input and output devices include the display coupled to the video adapter, and the
mouse/keyboard/ printer/inputs/keys coupled to the I/O interface. Other devices may be coupled to the processing unit, and additional or fewer interface cards may be utilized. For example, a serial interface such as Universal Serial Bus (USB) (not shown) may be used to provide an interface for a printer.
The processing unit also includes one or more network interfaces, which may comprise wired links, such as an Ethernet cable or the like, and/or wireless links to access nodes or different networks. The network interface allows the processing unit to communicate with remote units via the networks. For example, the network interface may provide wireless communication via one or more transmitters/transmit antennas and one or more receivers/receive antennas. In an embodiment, the processing unit is coupled to a local-area network or a wide-area network for data processing and communications with remote devices, such as other processing units, the Internet, remote storage facilities, or the like.
FIG. 6 illustrates a block diagram of another embodiment processing system 600 that may be used for implementing the devices and methods disclosed herein, which may be installed in a host device. As shown, the processing system 600 includes a processor 604, a memory 606, and interfaces 610-614, which may (or may not) be arranged as shown in the figure. The processor 604 may be any component or collection of components adapted to perform computations and/ or other processing related tasks, and the memory 606 may be any component or collection of components adapted to store programming and/or instructions for execution by the processor 604. In an embodiment, the memory 606 includes a non- transitory computer readable medium. The interfaces 610, 612, 614 may be any component or collection of components that allow the processing system 600 to communicate with other devices/components and/or a user. For example, one or more of the interfaces 610, 612, 614 may be adapted to communicate data, control, or management messages from the processor 604 to applications installed on the host device and/or a remote device. As another example, one or more of the interfaces 610, 612, 614 may be adapted to allow a user or user device (e.g., personal computer (PC), etc.) to interact/communicate with the processing system 600. The processing system 600 may include additional components not depicted in the figure, such as long term storage (e.g., non-volatile memory, etc.).
In some embodiments, the processing system 600 is in a user-side device accessing a wireless or wireline telecommunications network, such as a mobile station, a user equipment (UE), a personal computer (PC), a tablet, a wearable communications device (e.g., a smartwatch, etc.), or any other handheld device. The user-side device may be adapted to access a telecommunications network. In some embodiments, one or more of the interfaces 610, 612, 614 connects the processing system 600 to a transceiver adapted to transmit and receive signaling over the telecommunications network.
It should be appreciated that one or more steps of the embodiment methods provided herein may be performed by corresponding units or modules. For example, a signal may be transmitted by a transmitting unit or a transmitting module. A signal may be received by a receiving unit or a receiving module. A signal may be processed by a processing unit or a processing module. Other steps may be performed by a detecting unit/module, an activating unit/module, and/or an inputting unit/module. The respective units/modules may be hardware, software, or a combination thereof. For instance, one or more of the units/modules may be an integrated circuit, such as field programmable gate arrays (FPGAs) or application- specific integrated circuits (ASICs).
While this disclosure has been described with reference to illustrative embodiments, this description is not intended to be construed in a limiting sense. Various modifications and combinations of the illustrative embodiments, as well as other embodiments of the disclosure, will be apparent to persons skilled in the art upon reference to the description. It is therefore intended that the appended claims encompass any such modifications or embodiments.

Claims

WHAT IS CLAIMED IS:
1. A device comprising:
a physical input, configured to activate a first function of the device when a first type of touch motion is detected on the physical input; and
an ultrasonic sensor comprising an ultrasonic transmitter and a first ultrasonic receiver, the ultrasonic sensor disposed underneath the physical input, and configured to detect a second type of touch motion on the physical input and activate a second function of the device when the second type of touch motion is detected on the physical input, wherein the second type of touch motion is different than the first type of touch motion.
2. The device of claim l, wherein the second function comprises starting an application program on the device.
3. The device of claim l, wherein the second function comprises activating hardware on the device.
4. The device of claim l, wherein the second function comprises performing an operation on a touch screen of the device.
5. The device as recited in any one of claims 1-4, wherein the first and second inputs are responsive to different gestures.
6. The device as recited in any one of claims 1-5, wherein the first type of touch motion comprises a depressing on the physical input, and the second type of touch motion comprises a sliding touch on the physical input.
7. The device as recited in any one of claims 1-6, wherein the first type of touch motion and the second type of touch motion have different touch forces on the physical input.
8. The device as recited in any one of claims 1-7, wherein the physical input is a volume input of the device.
9. The device as recited in any one of claims 1-7, wherein the physical input is a power input of the device.
10. The device as recited in any one of claims 1-7, wherein the physical input is a key for inputting information into the device.
11. The device as recited in any one of claims 1-10, further comprising:
a touch screen for displaying information.
12. The device as recited in any one of claims 1-10, further comprising:
a second ultrasonic receiver, disposed underneath the physical input.
13. A method comprising :
detecting, by a device using an ultrasonic sensor disposed underneath a physical component of the device, a first type of touch motion applied on the physical component, the ultrasonic sensor comprising an ultrasonic transmitter and an ultrasonic receiver, and being configured to detect the first type of touch motion on the physical component; and
activating, by the device, a first function on the device upon detection of the first type of touch motion applied on the physical component, the first function being associated with the detection of the first type of touch motion on the physical component.
14. The method of claim 13, further comprising:
detecting, by the device using the physical component, a second type of touch motion applied on the physical component that is different than the first type of touch motion; and
activating, by the device, a second function on the device upon detection of the second type of touch motion applied on the physical component, the second function associated with detection of the second type of touch motion on the physical component and different than the first function.
15. The method of claim 14, wherein the first type of touch motion and the second type of touch motion have different gestures on the physical component.
16. The method of claim 14 or 15, wherein the first type of touch motion and the second type of touch motion have different touch forces on the physical component.
17. The method as recited in any one of claims 14-16, wherein the first type of touch motion comprises a touch on the physical component, and the second type of touch motion comprises a depressing of the physical component.
18. The method as recited in any one of claims 13-17, wherein the physical component is a physical input or key.
19. The method as recited in any one of claims 13-18, wherein the physical component is a volume input of the device.
20. The method as recited in any one of claims 13-18, wherein the physical component is a power input of the device.
21. The method as recited in any one of claims 13-18, wherein the physical component is a key for entering information.
22. The method as recited in any one of claims 13-21, wherein the first function comprises starting an application program on the device.
23. The method as recited in any one of claims 13-21, wherein the first function comprises activating hardware on the device.
24. The method as recited in any one of claims 13-21, wherein the first function comprises performing an operation on a touch screen of the device.
25. A device comprising:
a physical input; and
an ultrasonic sensor comprising an ultrasonic transmitter and an ultrasonic receiver, the ultrasonic sensor disposed underneath the physical input, and configured to detect a first type of touch motion applied on the physical input and activate a first function of the device upon detection of the first type of touch motion on the physical input.
26. The device of claim 25, wherein the physical input is configured to activate a second function of the device upon detecting, by the physical input, a second type of touch motion applied on the physical input that is different than the first type of touch motion.
27. The device of claim 26, wherein the first and second inputs are responsive to different gestures.
28. The device of claim 26 or 27, wherein the first type of touch motion and the second type of touch motion have different touch forces on the physical input.
29. The device as recited in any one of claims 26-28, wherein the first type of touch motion comprises a touch on the physical input, and the second type of touch motion comprises a depressing of the physical input.
30. The device as recited in any one of claims 25-29, wherein the physical input is a physical manipulation.
31. The device as recited in any one of claims 25-30, wherein the physical input is a volume input of the device.
32. The device as recited in any one of claims 25-30, wherein the physical input is a power input of the device.
33. The device as recited in any one of claims 25-30, wherein the physical input is a key for entering information.
34. The device as recited in any one of claims 25-33, wherein the first function comprises starting an application program on the device.
35. The device as recited in any one of claims 25-33, wherein the first function comprises activating hardware on the device.
36. The device as recited in any one of claims 25-33, wherein the first function comprises performing an operation on a device touch screen.
PCT/US2019/038032 2018-06-20 2019-06-19 Method and apparatus of integrating slide and touch on an input device Ceased WO2019246295A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202211081423.1A CN115562502B (en) 2018-06-20 2019-06-19 Method and apparatus for integrating swipe and touch on an input device
CN201980040527.8A CN112313609B (en) 2018-06-20 2019-06-19 Method and apparatus for integrating swipe and touch on input device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862687796P 2018-06-20 2018-06-20
US62/687,796 2018-06-20

Publications (1)

Publication Number Publication Date
WO2019246295A1 true WO2019246295A1 (en) 2019-12-26

Family

ID=68984362

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/038032 Ceased WO2019246295A1 (en) 2018-06-20 2019-06-19 Method and apparatus of integrating slide and touch on an input device

Country Status (2)

Country Link
CN (2) CN115562502B (en)
WO (1) WO2019246295A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119248171A (en) * 2024-02-26 2025-01-03 荣耀终端有限公司 Method for enabling shortcut function, electronic device, readable medium and computer program product

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114546163A (en) * 2022-01-27 2022-05-27 歌尔科技有限公司 Touch detection system, method and computer-readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080185281A1 (en) * 2007-02-06 2008-08-07 Inventec Appliances Corp. Touch input device
US20090309616A1 (en) * 2008-06-13 2009-12-17 Sony Ericsson Mobile Communications Ab Touch and force sensing for input devices
US20150286341A1 (en) * 2012-11-21 2015-10-08 The Board Of Trustees Of The Leland Stanford Junior University multi-touch ultrasonic touch screen
US20160062530A1 (en) * 2012-07-26 2016-03-03 Apple Inc. Ultrasound-Based Force Sensing of Inputs

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3725747B2 (en) * 2000-01-07 2005-12-14 三菱電線工業株式会社 Ultrasonic degradation diagnostic equipment for low-voltage cable for railway equipment
AU2012202122B2 (en) * 2005-03-04 2013-07-18 Apple Inc. Multi-functional hand-held device
US20070176903A1 (en) * 2006-01-31 2007-08-02 Dahlin Jeffrey J Capacitive touch sensor button activation
US20090207140A1 (en) * 2008-02-19 2009-08-20 Sony Ericsson Mobile Communications Ab Identifying and responding to multiple time-overlapping touches on a touch panel
CN101907959B (en) * 2010-08-20 2012-10-10 鸿富锦精密工业(深圳)有限公司 Slidably controlled touch type electronic device
CN102629184A (en) * 2012-02-29 2012-08-08 北京创造力教育科技有限公司 Handheld terminal and operation method thereof
US9389718B1 (en) * 2013-04-04 2016-07-12 Amazon Technologies, Inc. Thumb touch interface
CN104932815A (en) * 2015-05-06 2015-09-23 努比亚技术有限公司 Mobile terminal and operation method thereof
KR102383790B1 (en) * 2015-05-22 2022-04-08 삼성전자주식회사 Environment recognition method and electronic device thereof
CN104915030A (en) * 2015-05-28 2015-09-16 努比亚技术有限公司 Operation method and device based on mobile terminal rolling wheel key
CN106293221B (en) * 2016-08-05 2018-07-06 歌尔股份有限公司 Touch pressure control method and equipment
US10908741B2 (en) * 2016-11-10 2021-02-02 Sentons Inc. Touch input detection along device sidewall
CN107943267A (en) * 2017-11-21 2018-04-20 北京小米移动软件有限公司 A kind of method and apparatus for controlling screen

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080185281A1 (en) * 2007-02-06 2008-08-07 Inventec Appliances Corp. Touch input device
US20090309616A1 (en) * 2008-06-13 2009-12-17 Sony Ericsson Mobile Communications Ab Touch and force sensing for input devices
US20160062530A1 (en) * 2012-07-26 2016-03-03 Apple Inc. Ultrasound-Based Force Sensing of Inputs
US20150286341A1 (en) * 2012-11-21 2015-10-08 The Board Of Trustees Of The Leland Stanford Junior University multi-touch ultrasonic touch screen

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119248171A (en) * 2024-02-26 2025-01-03 荣耀终端有限公司 Method for enabling shortcut function, electronic device, readable medium and computer program product

Also Published As

Publication number Publication date
CN115562502B (en) 2023-10-20
CN112313609A (en) 2021-02-02
CN112313609B (en) 2022-09-16
CN115562502A (en) 2023-01-03

Similar Documents

Publication Publication Date Title
US9024877B2 (en) Method for automatically switching user interface of handheld terminal device, and handheld terminal device
US8665218B2 (en) Portable device
US20110050575A1 (en) Method and apparatus for an adaptive touch screen display
AU2019272016B2 (en) System and method for double knuckle touch screen control
CN109558061B (en) Operation control method and terminal
CN105867916A (en) Terminal control method and device
CN108920052B (en) Page Display Control Method and Related Products
WO2019183772A1 (en) Fingerprint unlocking method, and terminal
WO2018039914A1 (en) Method for copying data, and user terminal
CN204302878U (en) Electronic equipment
WO2018112803A1 (en) Touch screen-based gesture recognition method and device
CN115562502B (en) Method and apparatus for integrating swipe and touch on an input device
CN105867684A (en) Object controlling method and device
CN204856386U (en) Wireless keyboard for switching different pairing devices by touch panel
CN105867807A (en) Terminal unlocking method and device
CN109683721A (en) A kind of input information display method and terminal
CN113552954A (en) An input method keyboard display method, electronic device and storage medium
WO2011034330A2 (en) Thimble-type command input apparatus
KR20190124362A (en) Hybrid stylus and touch input apparatus communicating with the hybrid stylus
US20110001716A1 (en) Key module and portable electronic device
KR20120134485A (en) Method for searching index list using movement sensing device and apparatus therefof
TW201516764A (en) Mouse having multifunction button
CN108351729A (en) Touch apparatus
KR20120134476A (en) Method for displaying e-mail content using movement sensing device and apparatus therefof
KR20120134429A (en) Method for studyng words using movement sensing device and apparatus therefof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19823039

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19823039

Country of ref document: EP

Kind code of ref document: A1