WO2024204051A1 - Non-contact input device - Google Patents

Abstract

This non-contact input device comprises: a display unit; an imaging unit that forms a display image of the display unit on an imaging surface in the air as a real image; and an image formation unit that forms a boundary image in at least a partial region around the real image or in the real image.

Description

Non-contact input device

The present invention relates to a non-contact input device.

As disclosed in Patent Document 1, a non-contact input device is known that focuses an image displayed on a display unit of an image display device onto an imaging plane in the air and displays the image (hereinafter referred to as an aerial image) on the imaging plane.

JP 2014-67071 A

Incidentally, the non-contact input device disclosed in Patent Document 1 as described above has a physical frame that surrounds the imaging surface on which the aerial image is formed. This allows the user of the non-contact input device to clearly recognize the boundary between the aerial image and the background. However, such a frame can get in the way when performing input operations on the aerial image, and may reduce operability.

Furthermore, if a user of a non-contact input device has difficulty recognizing the boundaries between adjacent images in the aerial image, operability may be reduced. However, providing a physical frame within the aerial image is undesirable from the standpoint of operability.

The object of the present invention is to provide a non-contact input device that can clearly recognize the boundaries of an aerial image and improve operability.

One aspect of the non-contact input device according to the present invention is
A display unit;
an imaging unit that forms a display image of the display unit as a real image on an imaging surface in the air;
and an image forming unit that forms a boundary image in at least a portion of the area around the real image or within the real image.

The present invention provides a non-contact input device that can clearly recognize the boundaries of an aerial image and improves operability.

FIG. 1 is a schematic cross-sectional view showing the configuration of a non-contact input device according to an embodiment of the present invention. FIG. 2 is a functional block diagram showing the functional configuration of the non-contact input device. FIG. 3 is a diagram showing the display unit and the boundary image output unit. FIG. 4 is a diagram showing an example of an aerial boundary image. FIG. 5 is a diagram showing a modified example of the aerial boundary image. FIG. 6 is a diagram showing a modified example of the aerial boundary image. FIG. 7 is a diagram showing a modified example of the aerial boundary image. FIG. 8 is a diagram showing a modified example of the aerial boundary image. FIG. 9 is a schematic diagram showing a situation in which a user is manipulating an aerial image. FIG. 10 is a schematic diagram showing a situation in which a user is manipulating an aerial boundary image.

The non-contact input device according to the present invention will be described in detail below with reference to the drawings. Note that the non-contact input device described below is one example of the non-contact input device according to the present invention, and the present invention is not limited to the embodiment described below.

[Embodiment]
A non-contact input device 1 according to an embodiment of the present invention will be described with reference to FIGS.

FIG. 1 is a schematic cross-sectional view showing the configuration of a non-contact input device 1 according to this embodiment. The non-contact input device 1 is a device equipped with a so-called air display. The air display can project information and images into the air.

Such a non-contact input device 1 is used in various locations (stores, public facilities, medical facilities, factories, etc.) as a terminal for a user U to input information or a terminal for a user U to obtain information.

Specifically, the non-contact input device 1 may be used as an accounting terminal or a reception terminal. The non-contact input device 1 may also be used as an operation input terminal for inputting operation inputs to various devices.

In the following explanation, when describing the structure of the non-contact input device 1 and each of the components that make up the non-contact input device 1, the Cartesian coordinate system (X, Y, Z) shown in Figure 1 may be used. The X direction corresponds to the front-to-rear direction of the non-contact input device 1. The + side of the X direction corresponds to the front side of the non-contact input device 1. The - side of the X direction corresponds to the rear side of the non-contact input device 1.

The Y direction corresponds to the left-right direction and width direction of the non-contact input device 1. The + side of the Y direction corresponds to the left side when the non-contact input device 1 is viewed from the front. The - side of the Y direction corresponds to the right side when the non-contact input device 1 is viewed from the front.

The Z direction corresponds to the up-down direction of the non-contact input device 1. The +Z direction corresponds to the top side of the non-contact input device 1. The -Z direction corresponds to the bottom side of the non-contact input device 1.

(Non-contact input device)
The non-contact input device 1 includes a housing 2 , a display unit 3 , a boundary image output unit 4 , an imaging unit 5 , an input detection unit 6 , and a control unit 7 .

The non-contact input device 1 according to this embodiment is a so-called vertically-placed non-contact input device. In the case of a vertically-placed non-contact input device, the boundary image G1 is displayed in front of the non-contact input device 1 as shown in FIG. 1. Note that the non-contact input device is not limited to a vertically-placed non-contact input device.

The non-contact input device may be a so-called horizontally placed non-contact input device. A horizontally placed non-contact input device has a configuration in which the non-contact input device 1 shown in FIG. 1 is rotated 90° in the counterclockwise direction in FIG. 1. In the case of a horizontally placed non-contact input device, the border image G1 is displayed above the non-contact input device 1.

(Housing)
The housing 2 is box-shaped and is a member for housing or supporting the elements 2 to 7 that constitute the non-contact input device 1. In the case of this embodiment, the housing 2 is a rectangular parallelepiped that is long in the vertical direction. However, the shape of the housing is not limited to the shape of the housing 2 of this embodiment. The shape of the housing may be appropriately determined depending on the environment in which the non-contact input device 1 is installed.

(Display)
The display unit 3 may be, for example, any of various displays (for example, a liquid crystal display) that display images. The display unit 3 is supported by the housing 2 via a support portion 21. The display unit 3 faces diagonally downward and forward toward the imaging unit 5, which will be described later.

Specifically, the display unit 3 is supported by the support unit 21 in a state in which the upper end of the display unit 3 is inclined at a predetermined angle _θ1 in a direction approaching the imaging unit 5 described below with respect to a virtual line _α1 parallel to the vertical direction. In the case of this embodiment, the predetermined angle _θ1 is 45°.

The display image displayed by the display unit 3 is imaged as an aerial image G1 on the imaging surface S by the imaging unit 5 described below. The aerial image G1 is an example of a real image. The imaging surface S is a virtual area that exists in the air outside the housing 2. The imaging surface S may be considered as a virtual area large enough to image the aerial image G1 and aerial boundary image G2 described below. The area on the imaging surface S where the aerial image G1 is imaged is sometimes referred to as the aerial image area. The area on the imaging surface S where the aerial boundary image G2 is imaged is sometimes referred to as the boundary image area.

The imaging surface S is a virtual area that exists at a position that is plane-symmetrical to the display unit 3 with respect to the imaging unit 5 (in other words, the virtual line _α2 ) described below. The virtual line _α2 is a virtual line that passes through the imaging unit 5 and is parallel to the vertical direction.

Specifically, the imaging surface S is a virtual area inclined at a predetermined angle _θ2 with respect to a virtual line _α3 parallel to the vertical direction such that the upper end of the imaging surface S approaches an imaging unit 5 described below. In the case of this embodiment, the predetermined angle _θ2 is 45°.

The display operation of the display unit 3 is controlled by the control unit 7, which will be described later. The control process of the display unit 3 by the control unit 7 will be described later.

(Boundary image output unit)
The boundary image output unit 4 may be any of various displays that display the displayed boundary image or a laser device that outputs the displayed boundary image. The display unit 3 is supported by the housing 2 via a support portion 21.

As shown in Fig. 3, the boundary image output unit 4 has a rectangular frame shape and surrounds the entire outer edge of the display unit 3. Fig. 3 is a view of the display unit 3 and the boundary image output unit 4 as viewed from the direction indicated by the arrow _A1 in Fig. 1. The arrow _A1 in Fig. 1 is parallel to the normal direction of the display surfaces of the display unit 3 and the boundary image output unit 4.

The border image output unit 4 faces the same direction as the display unit 3. In other words, the border image output unit 4 faces diagonally downward and forward toward the imaging unit 5.

Specifically, the boundary image output unit 4 is supported by the support unit ₂₁ in a state in which the upper end of the boundary image output unit 4 is inclined at a predetermined angle _θ1 in a direction approaching the imaging unit 5 described below with respect to a virtual line α1 parallel to the vertical direction, similar to the display unit 3. In the case of this embodiment, the predetermined angle _θ1 is 45°. The boundary image output unit 4 may be supported by the housing 2 via the display unit 3.

The display boundary image output by the boundary image output unit 4 is imaged as an aerial boundary image G2 on the imaging surface S by the imaging unit 5 described below. The aerial boundary image G2 is an example of a boundary image.

Fig. 4 shows an example of an aerial boundary image G2 formed on the imaging plane S when the shape of the boundary image output unit 4 is the rectangular frame shape shown in Fig. 3. Fig. 4 is a view of the aerial boundary image G2 as viewed from the direction indicated by the arrow _A2 in Fig. 1. The arrow _A2 in Fig. 1 is parallel to the normal direction of the aerial boundary image G2 (in other words, the imaging plane S). The portion marked with a diagonal grid in Fig. 4 is the aerial boundary image G2.

The aerial boundary image G2 has a rectangular frame shape and is imaged on the imaging surface S so as to completely surround the outer edge of the aerial image G1.

In addition, in this embodiment, the aerial boundary image G2 is formed as a three-dimensional image on the imaging surface S, as shown in Figures 1 and 10. In other words, the aerial boundary image G2 has thickness. When the aerial boundary image G2 is a three-dimensional image, the user U of the non-contact input device 1 can view the aerial boundary image G2 not only from the front, but also from the left and right directions. As a result, the user U can reliably recognize the position of the aerial image G1.

This configuration is particularly effective for a vertically-mounted non-contact input device such as the non-contact input device 1 according to this embodiment. The aerial boundary image may be a two-dimensional image formed on the imaging surface S.

The aerial boundary image G2 may have a plurality of regions R1, R2 for operation instructions. The regions R1, R2 for operation instructions are regions for a user U (see FIG. 1) of the non-contact input device 1 to input operation inputs. A function is assigned to each of the regions R1, R2 for operation instructions.

For example, a first function for switching the display mode of the display unit 3 (for example, a function for enlarging the display image of the display unit 3) may be assigned to the operation instruction area R1. In this case, when the user U performs a predetermined operation on the operation instruction area R1, the first function is realized.

Furthermore, a second function for switching the display mode of the display unit 3 (for example, a function for reducing the display image of the display unit 3) may be assigned to the operation instruction area R2. In this case, when the user U performs a predetermined operation on the operation instruction area R2, the second function is realized.

In this embodiment, the aerial boundary image G2 not only functions as a boundary image showing the boundary between the aerial image G1 and the background, but also functions as an input reception image that receives operational input from the user U.

The number and arrangement of regions for operation instructions are not limited to the number and arrangement of regions R1 and R2 for operation instructions shown in FIG. 3.

Furthermore, the shape of the aerial boundary image is not limited to the shape of the aerial boundary image G2 shown in FIG. 3. FIG. 5 and FIG. 6 are diagrams showing modified example 1 and modified example 2 of the aerial boundary image.

The aerial boundary image G21 shown in FIG. 5 is provided along each of a pair of diagonally opposite corners of the four corners of the aerial image G1. Note that the aerial boundary image G21 may be provided at only one of the four corners of the aerial image G1.

Also, the aerial boundary image G21 may be provided at any three of the four corners of the aerial image G1. Furthermore, the aerial boundary image G21 may be provided at all four corners of the aerial image G1.

The aerial boundary image G22 shown in FIG. 6 is arranged along only one of the four sides of the aerial image G1 (the left side in the illustrated example). Note that the aerial boundary image G22 may be arranged along any two or three of the four sides of the aerial image G1.

The aerial boundary images G21 and G22 shown in FIG. 5 and FIG. 6 may also have an area for operation instructions. Furthermore, the aerial boundary images G21 and G22 may be three-dimensional images, similar to the aerial boundary image G2. Furthermore, the aerial boundary images G21 and G22 may be two-dimensional images.

The aerial boundary images G1, G21, and G22 shown in Figures 4 to 6 above are boundary images for indicating the boundary between the aerial images G1, G21, and G22 and the background. However, the aerial boundary images are not limited to boundary images for indicating the boundary between the aerial image and the background.

Specifically, the aerial boundary image may be an image that is focused (in other words, formed) within the aerial image G1. Such an aerial boundary image is, for example, a boundary image that indicates the boundary between adjacent aerial images within the aerial image G1.

Figures 7 and 8 show an example of an aerial boundary image that is focused (in other words, formed) within the aerial image G1.

The aerial boundary image G23 shown in FIG. 7 has a rectangular frame shape. The aerial boundary image G23 is formed within the aerial image G1. Such an aerial boundary image G23 is formed as a three-dimensional image on the imaging plane S. Note that the aerial boundary image G23 may also be formed as a two-dimensional image on the imaging plane S.

The aerial boundary image G23 surrounds the first aerial image G1a included in the aerial image G1. Such an aerial boundary image G23 is an image that shows the boundary between the first aerial image G1a and the second aerial image G1b included in the aerial image G1. The second aerial image G1b is an image formed around the first aerial image G1a.

With this configuration, the user U can recognize the boundary between the first aerial image G1a and the second aerial image G1b. This configuration is particularly effective when it is difficult to recognize the boundary between the first aerial image G1a and the second aerial image G1b.

The control unit 7, which will be described later, may control the boundary image output unit 4 to form an aerial boundary image G23 when the user U has difficulty recognizing the boundary between the first aerial image G1a and the second aerial image G1b.

In other words, the control unit 7 may control the boundary image output unit 4 not to form an aerial boundary image G23 in a situation in which the boundary between the first aerial image G1a and the second aerial image G1b is easily recognized by the user U.

In other words, the aerial boundary image G23 may be formed at a position in the aerial image G1 where the boundary between adjacent images is difficult to recognize. The position at which the aerial boundary image G23 is formed may be controlled by the control unit 7.

The aerial boundary image G23 may also be formed around an aerial image that is to be emphasized and made known to the user U in the aerial image G1. The aerial boundary image G23 may also be formed at a position according to the procedure of the input operation of the user U.

The aerial boundary image G24 shown in FIG. 8 is linear. The aerial boundary image G24 is formed within the aerial image G1. Such an aerial boundary image G24 is formed as a three-dimensional image on the imaging plane S. The aerial boundary image G24 may also be formed as a two-dimensional image on the imaging plane S.

The aerial boundary image G24 is an image showing the boundary between a first aerial image G1c included in the aerial image G1 and a second aerial image G1d included in the aerial image G1. The first aerial image G1c and the second aerial image G1d are adjacent to each other in the aerial image 1G.

The aerial boundary image G24 is also a boundary image for dividing the aerial image G1 into left and right. The extension direction of the aerial boundary image G24 is not limited to the left-right direction in the aerial image G1. The extension direction of the aerial boundary image G24 may be the up-down direction in the aerial image G1.

With this configuration, the user U can recognize the boundary between the first aerial image G1c and the second aerial image G1d. This configuration is particularly effective when it is difficult to recognize the boundary between the first aerial image G1c and the second aerial image G1d.

(Imaging section)
As shown in Fig. 1, the imaging unit 5 is a plate-shaped member. The boundary image output unit 4 images the display image of the display unit 3 as an aerial image G1 in an aerial image area on the imaging plane S. In addition, the imaging unit 5 images the display boundary image of the boundary image output unit 4 as an aerial boundary image G2 in the boundary image area on the imaging plane S.

In this embodiment, the imaging unit 5 has a plurality of light reflecting surfaces (not shown). As shown in Fig. 1, light of a display image on the display unit 3 is incident on the imaging unit 5 from the direction indicated by the arrow _A3 . Hereinafter, the light of the display image incident on the imaging unit 5 may be referred to as "incident light related to the display image".

Incident light related to the display image is reflected multiple times (e.g., twice) by multiple light reflecting surfaces and emitted from imaging unit 5 in the direction indicated by arrow _A4 in Fig. 1. The emitted light related to the display image is then imaged as an aerial image G1 on imaging surface S. The light of the display image emitted from imaging unit 5 is sometimes referred to as "emitted light related to the display image".

The incident angle of the incident light with respect to the display image is equal to the inclination angle _θ1 with respect to the virtual line _α1 of the display unit 3. In the present embodiment, the incident angle of the incident light with respect to the display image is 45°. In addition, the exit angle of the exit light with respect to the display image is equal to the incident angle of the incident light with respect to the display image. In the present embodiment, the exit angle of the exit light with respect to the display image is 45°.

1, light of the display boundary image in the boundary image output unit 4 is also incident on the imaging unit 5 from a direction parallel to the direction indicated by the arrow _A3 . Hereinafter, the light of the display boundary image incident on the imaging unit 5 may be referred to as "incident light related to the display boundary image."

The incident light related to the display boundary image is reflected multiple times (e.g., twice) by multiple light reflecting surfaces and emitted from the imaging unit 5 in a direction parallel to the direction indicated by the arrow _A4 in Fig. 1. The emitted light related to the display boundary image is then imaged as an aerial boundary image G2 on the imaging surface S. The light of the display boundary image emitted from the imaging unit 5 is sometimes referred to as "emitted light related to the display boundary image."

The angle of incidence of the incident light with respect to the display boundary image is equal to the angle of incidence of the incident light with respect to the display image. In this embodiment, the angle of incidence of the incident light with respect to the display boundary image is 45°. In addition, the angle of emission of the emitted light with respect to the display boundary image is equal to the angle of emission of the emitted light with respect to the display image. In this embodiment, the angle of emission of the emitted light with respect to the display boundary image is 45°.

As described above, in this embodiment, the image forming unit that forms the aerial boundary image G2 is composed of the boundary image output unit 4, the imaging unit 5, and the control unit 7. The boundary image output unit 4 corresponds to an example of a light source.

In addition, incident light related to the display image and incident light related to the display border image are incident on the imaging unit 5. In other words, the imaging unit 5 has an area capable of receiving both the light of the display image of the display unit 3 and the light of the display border image of the border image output unit 4.

(Input detection section)
The input detection unit 6 (see FIG. 2) detects information (also referred to as first operation input information) regarding an operation input to the aerial image G1 from the user U (see FIG. 1). The input detection unit 6 sends the detected first operation input information to the control unit 7. The input detection unit 6 is supported by the housing 2.

The input detection unit 6 is composed of multiple sensors (not shown). The input detection unit 6 detects, for example, information about the position in the aerial image G1 operated by the user U (also referred to as first position information) as first operation input information.

The first position information may be, for example, information about coordinates in the aerial image G1 (also referred to as first coordinate information). The first coordinate information may be three-dimensional coordinates consisting of an X-direction coordinate, a Y-direction coordinate, and a Z-direction coordinate.

The input detection unit 6 may also detect information (also referred to as first input depth information) regarding the input depth of the fingertip when the user U operates the aerial image G1. The first input depth information may include a distance D1 (see FIG. 9) that the user U's fingertip passed through the aerial image G1 when the user U operates the aerial image G1. The input detection unit 6 sends the detected first input depth information to the control unit 7.

The input detection unit 6 also detects information (also referred to as second operation input information) regarding an operation input to the aerial boundary image G2 from the user U (see FIG. 1). The input detection unit 6 sends the detected information to the control unit 7.

The above-mentioned first operation input information, first position information, first coordinate information, and first input depth information may be collectively referred to as first information.

The input detection unit 6 also detects information (also referred to as second operation input information) regarding an operation input from the user U to the aerial boundary image G2. The input detection unit 6 sends the detected second operation input information to the control unit 7.

The input detection unit 6 detects, for example, information relating to the position in the aerial boundary image G2 operated by the user U (also referred to as second position information) as second operation input information.

The second position information may be, for example, information about coordinates in the aerial boundary image G2 (also referred to as second coordinate information). The second coordinate information may be three-dimensional coordinates consisting of coordinates in the X direction, Y direction, and Z direction. Specifically, the second position information may be information about the coordinates of areas R1 and R2 for operation instructions in the aerial boundary image G2.

The input detection unit 6 may also detect information (also referred to as second input depth information) regarding the input depth of the fingertip when the user U operates the aerial boundary image G2 (specifically, the regions R1 and R2 for operation instructions).

The second input depth information may include a distance D2 (see FIG. 9) that the user U's fingertip passes through the aerial boundary image G2 when the user U operates the aerial boundary image G2. The input detection unit 6 sends the second input depth information to the control unit 7.

The above-mentioned second operation input information, second position information, second coordinate information, and second input depth information may be collectively referred to as second information.

In this embodiment, the input detection unit (also referred to as the first input detection unit) that detects information regarding operation input to the aerial image G1 and the input detection unit (also referred to as the second input detection unit) that detects information regarding operation input to the aerial boundary image G2 are configured by a single common input detection unit.

However, the first input detection unit and the second input detection unit may be configured by two different input detection units.

Furthermore, the function of the input detection unit 6 to detect the second operation input information, the second position information, the second coordinate information, and the second input depth information (hereinafter referred to as the function of detecting second information) may be omitted.

The function of detecting the second information is a function that is necessary when the non-contact input device 1 has a function of executing some control based on an input operation on the aerial boundary image G2 from the user U. Therefore, the function of detecting the second information may be omitted when the non-contact input device 1 does not have a function of executing some control based on an input operation on the aerial boundary image G2 from the user U.

Furthermore, the configuration of the input detection unit 6 is not particularly limited. The configuration of the input detection unit 6 may be various configurations that can realize the above-mentioned functions. Furthermore, the position at which the input detection unit 6 is provided is also not particularly limited. The input detection unit 6 may be provided in various positions that can realize the above-mentioned functions.

(Control Unit)
The control unit 7 mainly controls the operations of the display unit 3 and the boundary image output unit 4. The control unit 7 is supported by the housing 2. The control unit 7 may be substantially configured with a CPU, ROM, RAM, HDD, etc. connected via a bus, or may be configured with a one-chip LSI, etc. The control executed by the control unit 7 will be described below.

(Display control of aerial images)
The control unit 7 executes display control of the aerial image. That is, the control unit 7 controls the display operation of the display unit 3. Specifically, the control unit 7 executes display control of the aerial image based on information related to an operation input by the user U of the non-contact input device 1 to the aerial image G1.

The control unit 7 acquires information regarding the operation input of the user U of the non-contact input device 1 to the aerial image G1 from the input detection unit 6. The information regarding the operation input of the user U of the non-contact input device 1 to the aerial image G1 is first information detected by the input detection unit 6 (specifically, first operation input information, first position information, first coordinate information, and first input depth information).

The control unit 7 can also control the display of the aerial image based on information regarding the user U's operation input to the aerial boundary image G2.

The control unit 7 acquires information regarding the operation input by the user U to the aerial boundary image G2 from the input detection unit 6. The information regarding the operation input by the user U to the aerial boundary image G2 is second information detected by the input detection unit 6 (specifically, second operation input information, second position information, second coordinate information, and second input depth information).

Specifically, when the control unit 7 detects that the operation instruction area R1 in the aerial boundary image G2 has been operated based on the second information acquired from the input detection unit 6, the control unit 7 executes the function assigned to the operation instruction area R1.

In addition, when the control unit 7 detects that the operation instruction area R2 in the aerial boundary image G2 has been operated based on the second information acquired from the input detection unit 6, the control unit 7 executes the function assigned to the operation instruction area R2.

(Border image display control)
In addition, the control unit 7 executes boundary image display control. That is, the control unit 7 controls the display operation of the boundary image output unit 4. Specifically, the control unit 7 controls the display operation of the boundary image output unit 4 based on an operation input from the user U of the non-contact input device 1.

In controlling the boundary image display, the control unit 7, for example, switches between displaying and hiding the aerial boundary image G2.

When a display request for the aerial boundary image G2 (also referred to as a boundary image display request) is input from the user U, the control unit 7 controls the boundary image output unit 4 to display the aerial boundary image G2 on the imaging surface S.

User U can request the display of the aerial boundary image G2, for example, by performing an operation input on the aerial image G1 or the aerial boundary image G2.

Alternatively, the user U can request the display of the aerial boundary image G2 by using a physical switch (not shown) provided on the non-contact input device 1. In this case, the control unit 7 controls the boundary image output unit 4 according to the state of the switch.

The control unit 7 may also control the timing of displaying the aerial boundary image G2. Specifically, when the control unit 7 detects an operation from the user on the boundary image area in a state where the aerial boundary image G2 has not been formed in the boundary image area on the imaging surface S, the control unit 7 forms the aerial boundary image G2 in the boundary image area.

In addition, in such control, the operation from the user detected by the control unit 7 may be an operation intended by the user, or an operation not intended by the user. For example, when the user's finger deviates from the aerial image G1 and enters the boundary image area, the control unit 7 forms an aerial boundary image G2 to notify the user that the finger has deviated from the aerial image G1.

The control unit 7 may also control the timing of displaying the aerial boundary image G2. When the user U is not using the non-contact input device 1, it is preferable for the aerial boundary image G2 to be hidden from the viewpoint of energy saving. On the other hand, when the user U uses the non-contact input device 1, it is preferable for the aerial boundary image G2 to be presented to the user U in advance.

The control unit 7 may therefore present the aerial boundary image G2 to the user U in advance at an appropriate timing before the user U starts using the non-contact input device 1.

Specifically, when the user U enters a predetermined range around the non-contact input device 1, the control unit 7 may control the boundary image output unit 4 to display the aerial boundary image G2. At this time, the control unit 7 may display the aerial image G1 together with the aerial boundary image G2.

In this case, the non-contact input device 1 may include a user detection means (not shown) that detects when the user U enters a predetermined range around the non-contact input device 1. The control unit 7 controls the boundary image output unit 4 based on the information acquired from the user detection means to display the aerial boundary image G2.

In addition, when the user U leaves a predetermined range around the non-contact input device 1, the control unit 7 may control the boundary image output unit 4 to hide the aerial boundary image G2. At this time, the control unit 7 may hide the aerial image G1 together with the aerial boundary image G2.

(Information notification control)
The control unit 7 can also execute information notification control. The information notification control is control for conveying information to the user U through the aerial boundary image G2. The control unit 7 notifies the user U of the information by controlling the operation of the boundary image output unit 4 to change the display mode of the aerial boundary image G2.

For example, the control unit 7 executes information notification control based on information regarding the user U's operation input to the aerial image G1 (in other words, the first information acquired from the input detection unit 6).

Specifically, if the user U's operation input to the aerial image G1 is incorrect, the control unit 7 controls the operation of the boundary image output unit 4 to change the display mode of the aerial boundary image G2. The user U can recognize that the operation input is incorrect from the change in the display mode of the aerial boundary image G2. As a result, the user U can perform the correct operation input to the aerial image G1.

For example, when user U operates aerial image G1, if user U's fingertips penetrate too deeply into aerial image G1, there is a possibility that an operation input unintended by user U may be input.

The control unit 7 then controls the operation of the boundary image output unit 4 in accordance with the distance D1 (see FIG. 9) that the user U's fingertip has passed through the aerial image G1, thereby changing the display mode of the aerial boundary image G2.

For example, the control unit 7 may change the color of the aerial boundary image G2 depending on the distance D1. Specifically, when the distance D1 is within the appropriate range, the control unit 7 displays the aerial boundary image G2 in blue.

Furthermore, when the distance D1 is greater than the appropriate range and equal to or less than the first threshold, the control unit 7 displays the aerial boundary image G2 in yellow. When the distance D1 is greater than the first threshold and equal to or less than the second threshold, the control unit 7 displays the aerial boundary image G2 in red.

The control unit 7 may change the display mode of the aerial boundary image G2 and notify the user U of information by audio.

(Actions and Effects of the Present Embodiment)
Non-contact input device 1 having the above-described configuration allows the boundaries of aerial image G1 to be clearly recognized, and also improves operability.

First, the non-contact input device 1 can display an aerial boundary image G2 indicating the boundary between the aerial image G1 and the background in at least a portion of the area around the aerial image G1 (in other words, the periphery). This allows the user U of the non-contact input device 1 to clearly recognize the boundary between the aerial image G1 and the background. This effect can also be obtained from the aerial boundary image G21 shown in FIG. 5 and the aerial boundary image G22 shown in FIG. 6 described above.

Furthermore, in the case of the aerial boundary image G23 shown in FIG. 7 and the aerial boundary image G24 shown in FIG. 8 described above, the user U of the non-contact input device 1 can clearly recognize the boundary between adjacent aerial images in the aerial image G1.

Furthermore, the aerial boundary image G2 is an image formed on the imaging surface S. Therefore, when the user U operates the aerial image G1, there is no physical contact between the aerial boundary image G2 and the user U's fingers. As a result, the aerial boundary image G2 does not interfere with the operation by the user U.

Furthermore, the aerial boundary image G2 is a three-dimensional image. Therefore, the user U can view the aerial boundary image G2 not only from the front, but also from the left and right directions. As a result, the user U can reliably recognize the position of the aerial image G1.

Furthermore, in this embodiment, the aerial boundary image G2 not only functions as a boundary image showing the boundary between the aerial image G1 and the background, but also functions as an input reception image that receives operational input from the user U. This improves the operability of the non-contact input device 1 for the user U.

As described above, the non-contact input device 1 according to this embodiment can improve the clarity of the boundary between the aerial image G1 and the background while improving the operability of the non-contact input device 1 at a high level.

(Additional Note)
In the above-described embodiment, non-contact input device 1 includes boundary image output unit 4 that outputs an image that is the basis of aerial boundary image G2. However, boundary image output unit 4 may be omitted. In this case, display unit 3 displays a boundary image indicating the boundary between aerial image G1 and the background in a display image that is the basis of aerial image G1. Then, control unit 7 controls display unit 3 to display the boundary image indicating the boundary between aerial image G1 and the background in the display image. In this case, the image forming unit that forms aerial boundary image G2 is composed of display unit 3, imaging unit 5, and control unit 7.

The entire disclosures of the specification, drawings, and abstract contained in the Japanese application for Patent Application No. 2023-58563, filed on March 31, 2023, are incorporated herein by reference.

The present invention can be applied to non-contact input devices used for a variety of purposes.

REFERENCE SIGNS LIST 1 Non-contact input device 2 Housing 21 Support unit 3 Display unit 4 Boundary image output unit
5 Imaging unit 6 Input detection unit 7 Control unit G1 Aerial image G1a, G1c First aerial image G1b, G1d Second aerial image G2, G21, G22, G23, G24 Aerial boundary image R1, R2 Area for operation instruction U User S Imaging surface

Claims (9)

A display unit;
an imaging unit that forms a display image of the display unit as a real image on an imaging surface in the air;
and an image forming unit that forms a boundary image in at least a part of an area around the real image or within the real image.
Non-contact input device. The imaging unit includes:
A light reflecting surface is provided.
The incident light of the display image is reflected by the light reflecting surface a plurality of times and emitted to form the real image on the image forming surface.
The non-contact input device according to claim 1 . the image forming unit has a light source for displaying the boundary image in the area;
the imaging unit has an area capable of receiving both the light of the display image of the display unit and the light of the light source;
The non-contact input device according to claim 1 or 2. The imaging unit includes:
A light reflecting surface is provided.
The light of the display image and the light of the light source that are incident are reflected by the light reflecting surface a plurality of times and emitted to form the real image and the boundary image on the image forming surface.
The non-contact input device according to claim 3 . The image forming unit forms the boundary image in the area in response to a boundary image display request.
The non-contact input device according to claim 3 . When an operation on the area is detected in a state in which the border image is not formed in the area, the image forming unit forms the border image in the area.
The non-contact input device according to claim 3 . a control unit that detects an operation on the boundary image and controls a display on the display unit in response to the detected operation;
The non-contact input device according to claim 3 . the boundary image includes a plurality of regions for operation instructions;
The control unit detects the operation on the area, and controls a display on the display unit in response to the detected operation.
The non-contact input device according to claim 6. The boundary image is a three-dimensional image.
The non-contact input device according to claim 1 .

Images