CN114609920A - Intelligent household control method and device, computer equipment and medium - Google Patents

Abstract

The present disclosure relates to a smart home control method, apparatus, computer device and medium, and in particular, to the field of smart home technology; wherein, the method comprises the following steps: recognizing voice data of a user to obtain corresponding control information, wherein the control information comprises function types and control instructions; determining a first candidate intelligent device set corresponding to the function category according to a pre-established intelligent device information table; determining a second candidate intelligent device set matched with the control instruction based on the function state corresponding to each candidate intelligent device in the first candidate intelligent device set; and determining a target intelligent device matched with the control instruction from the second candidate intelligent device set, and controlling the target intelligent device to execute the control instruction. According to the embodiment of the intelligent home equipment control method and device, the corresponding control instruction can be executed through the voice automatic control intelligent equipment, a user can conveniently control and use the intelligent home equipment, and the improvement of intelligence and accuracy is facilitated.

Description

Smart home control method, device, computer equipment and medium

technical field

The present disclosure relates to the field of smart home technology, and in particular, to a smart home control method, device, computer equipment and medium.

Background technique

Smart home is to connect various devices in the home, such as audio and video equipment, lighting system, curtain control, air conditioning control, digital theater system, audio and video server and network appliances, etc. through the Internet of Things technology, providing home appliance control, lighting control, telephone Remote control, indoor and outdoor remote control, HVAC control, infrared forwarding and programmable timing control and other functions. Smart home not only has traditional use functions, but also has network communication, information appliances and equipment automation, which can provide a full range of information interaction functions and save energy costs.

In the traditional way, to trigger smart home operation, it is often necessary to enter the application program of the smart home APP for manual operation, manually set the operation scene of the smart device, or manually control the smart device by the user, which leads to inconvenience of operation and greatly reduces the user user experience.

SUMMARY OF THE INVENTION

In order to solve the above-mentioned technology or at least partially solve the above-mentioned technical problem, the present disclosure provides a smart home control method, device, computer equipment and medium, which can obtain function categories and control instructions according to the user's voice data, and according to the function categories and control instructions The instruction determines the target smart device that the user wants to control, so that the target smart device can execute the control instruction without the user's manual operation, which improves the user's experience.

In order to achieve the above purpose, the technical solutions provided by the embodiments of the present disclosure are as follows:

In a first aspect, the present disclosure provides a smart home control method, the method comprising:

Identifying the user's voice data to obtain corresponding control information, where the control information includes function categories and control instructions;

determining a first candidate smart device set corresponding to the functional category according to a pre-established smart device information table;

determining a second candidate smart device set matching the control instruction based on the functional state corresponding to each candidate smart device in the first candidate smart device set;

A target smart device matching the control instruction is determined from the second candidate smart device set, and the target smart device is controlled to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the target smart device matching the control instruction is determined from the second candidate smart device set, and the target smart device is controlled to execute the control instruction, include:

determining the number of all target candidate smart devices included in the second candidate smart device set matching the control instruction;

The target smart device is determined from the second candidate smart device set according to the magnitude relationship between the number and the preset threshold, and the target smart device is controlled to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the target smart device is determined from the second candidate smart device set according to the magnitude relationship between the number and a preset threshold, and the target smart device is controlled The device executes the control instructions, including:

If the number of all target candidate smart devices is less than or equal to the preset threshold, determining all target candidate smart devices included in the second candidate smart device set as the target smart device;

Control each target smart device to execute the control instruction respectively.

As an optional implementation manner of the embodiment of the present disclosure, the method further includes:

If the number of all target candidate smart devices is greater than the preset threshold, first prompt information is sent, where the first prompt information is used to instruct the user to determine the target smart device from the second candidate smart device set ;

receiving first response information, wherein the first response information includes first identification information corresponding to the target smart device;

The target smart device corresponding to the first identification information is controlled to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, identifying the user's voice data to obtain corresponding control information includes:

Perform text recognition on the voice data by a voice recognition method to obtain text information corresponding to the voice data;

The text information is semantically understood through a semantic understanding method to obtain the control information contained in the text information.

As an optional implementation manner of the embodiment of the present disclosure, the smart device information table is obtained in the following manner:

Obtain the device name, function name, function category and function status corresponding to each smart device included in the preset scene;

Create or update a corresponding smart device information table according to all device names, function names, function categories, and function states.

As an optional implementation manner of the embodiment of the present disclosure, the method further includes:

If the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set, second prompt information is sent, wherein the The second prompt information is used to instruct the user to determine the target smart device from a plurality of smart devices;

receiving second response information, wherein the second response information includes second identification information corresponding to the target smart device;

The target smart device corresponding to the second identification information is controlled to execute the control instruction.

In a second aspect, the present disclosure provides a smart home control device, the device comprising:

an identification module for identifying the user's voice data to obtain corresponding control information, where the control information includes function categories and control instructions;

a first determining module, configured to determine a first candidate smart device set corresponding to the function category according to a pre-established smart device information table;

a second determining module, configured to determine a second candidate smart device set matching the control instruction based on the functional status corresponding to each candidate smart device in the first candidate smart device set;

A control module, configured to determine a target smart device matching the control instruction from the second candidate smart device set, and control the target smart device to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the control module includes:

a quantity determination unit, configured to determine the quantity of all target candidate smart devices included in the second candidate smart device set that matches the control instruction;

A device determining unit, configured to determine the target smart device from the second candidate smart device set according to the magnitude relationship between the number and a preset threshold, and control the target smart device to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit is specifically configured to:

If the number of all target candidate smart devices is less than or equal to the preset threshold, determining all target candidate smart devices included in the second candidate smart device set as the target smart device;

Control each target smart device to execute the control instruction respectively.

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit is further specifically configured to:

If the number of all target candidate smart devices is greater than the preset threshold, first prompt information is sent, where the first prompt information is used to instruct the user to determine the target smart device from the second candidate smart device set ;

receiving first response information, wherein the first response information includes first identification information corresponding to the target smart device;

The target smart device corresponding to the first identification information is controlled to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the identification module is specifically used for:

Perform text recognition on the voice data by a voice recognition method to obtain text information corresponding to the voice data;

The text information is semantically understood through a semantic understanding method to obtain the control information contained in the text information.

As an optional implementation manner of the embodiment of the present disclosure, the smart device information table is obtained in the following manner:

Obtain the device name, function name, function category and function status corresponding to each smart device included in the preset scene;

Create or update a corresponding smart device information table according to all device names, function names, function categories, and function states.

As an optional implementation manner of the embodiment of the present disclosure, the apparatus further includes:

A sending module, configured to send a second prompt if the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set information, wherein the second prompt information is used to instruct the user to determine the target smart device from a plurality of smart devices;

a receiving module, configured to receive second response information, wherein the second response information includes second identification information corresponding to the target smart device;

The target smart device corresponding to the second identification information is controlled to execute the control instruction.

In a third aspect, the present disclosure also provides a computer device, including:

one or more processors;

storage means for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors implement the smart home control method described in any one of the embodiments of the present disclosure.

In a fourth aspect, the present disclosure also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements any one of the smart home control methods described in the embodiments of the present disclosure.

Compared with the prior art, the technical solutions provided by the embodiments of the present disclosure have the following advantages: the present disclosure firstly identifies the user's voice data to obtain control information corresponding to the voice data. The established smart device information table determines the first candidate smart device set corresponding to the function category; then, based on the functional status corresponding to each candidate smart device in the first candidate smart device set, determines the second candidate smart device set that matches the control instruction Finally, the target smart device that matches the control command is determined from the second candidate smart device set, and the target smart device is controlled to execute the control command, which solves the problem in the prior art that a user's manual operation is required when triggering a smart home operation. Controlling the smart device to execute corresponding control instructions facilitates the user's control and use of the smart home device, and is beneficial to improving intelligence and accuracy.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the accompanying drawings that are required to be used in the description of the embodiments or the prior art will be briefly introduced below. In other words, on the premise of no creative labor, other drawings can also be obtained from these drawings.

Fig. 1A is a scene schematic diagram of a smart home control process in the prior art;

FIG. 1B is a schematic scene diagram of a smart home control process in an embodiment of the disclosure;

2A is a block diagram of a hardware configuration of a computer device according to one or more embodiments of the present disclosure;

2B is a schematic diagram of a software configuration of a computer device according to one or more embodiments of the present disclosure;

2C is a schematic diagram showing an icon control interface of an application included in a smart device according to one or more embodiments of the present disclosure;

3A is a schematic flowchart of a smart home control method according to an embodiment of the present disclosure;

3B is a schematic diagram of the principle of a smart home control method provided by an embodiment of the present disclosure;

3C is a schematic diagram of a process of determining a second candidate smart device set in an embodiment of the present disclosure;

4A is a schematic flowchart of another smart home control method according to an embodiment of the present disclosure;

FIG. 4B is a schematic schematic diagram of another smart home control method according to an embodiment of the present disclosure;

5A is a schematic flowchart of another smart home control method provided by an embodiment of the present disclosure;

FIG. 5B is a schematic schematic diagram of another smart home control method according to an embodiment of the present disclosure;

6A is a schematic flowchart of another smart home control method provided by an embodiment of the present disclosure;

FIG. 6B is a schematic schematic diagram of another smart home control method according to an embodiment of the present disclosure;

6C is a schematic diagram of a process of obtaining control information in an embodiment of the present disclosure;

7A is a schematic structural diagram of a local control device in an embodiment of the disclosure;

7B is a schematic structural diagram of the interaction between a local control device and a smart device in an embodiment of the disclosure;

8A is a schematic structural diagram of a smart home control device provided by an embodiment of the present disclosure;

8B is a schematic structural diagram of a control module 804 in a smart home control device according to an embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of a computer device provided by an embodiment of the present disclosure.

Detailed ways

In order to more clearly understand the above objects, features and advantages of the present disclosure, the solutions of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments may be combined with each other under the condition of no conflict.

Many specific details are set forth in the following description to facilitate a full understanding of the present disclosure, but the present disclosure can also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only a part of the embodiments of the present disclosure, and Not all examples.

The terms "first" and "second" and the like in the present disclosure are used to distinguish different objects, rather than to describe a specific order of the objects. For example, the first candidate smart device set, the second candidate smart device set, etc. are used for distinguishing different candidate smart device sets, rather than for describing a specific order of the candidate smart device sets.

With the continuous development of science and technology, various household devices are becoming more and more intelligent, which brings great convenience to people's lives. In the era of mobile Internet + Internet of Things accelerating progress, through the application software of mobile smart terminals, especially mobile phones or tablets, an intelligent scene control function is required for each smart device. Due to the variety of smart devices, manufacturers of There are also more and more categories, and the same category also has different models. Based on functional control instructions, intelligent control is becoming more and more complicated. Simple intelligent control of a single device can no longer meet people's requirements for comfort in the intelligent age.

In the traditional way, triggering the smart home operation often requires the user to enter the application program of the smart home APP to perform manual operation, manually set the operation scene of the smart device, or manually control the smart device by the user, which leads to inconvenience of operation and greatly reduces the User experience.

FIG. 1A is a scene schematic diagram of a smart home control process in the prior art. As shown in FIG. 1A, exemplarily, it is assumed that the smart devices in the smart home scenario include smart devices 100 (ie, smart refrigerators), smart devices 101 (ie, smart washing machines) and smart devices 102 (ie, smart display devices). The smart terminal device 103 controls the smart device 100 , the smart device 101 , and the smart device 102 , or the user directly and manually controls the smart device 100 , the smart device 101 , and the smart device 102 . The user needs to perform manual operations when controlling the smart home, which reduces the user experience.

It should be noted that: a smart home scene may include a variety of smart devices, and FIG. 1A is only an exemplary illustration, and the type and number of smart devices are not specifically limited.

As can be seen from the above, the existing smart home control method is inconvenient to operate, therefore, a simpler and intelligent smart home control method is required.

FIG. 1B is a schematic scene diagram of a smart home control process in an embodiment of the disclosure. As shown in FIG. 1B , it is assumed that the smart devices in the smart home scene include smart device 200 (ie, smart refrigerator), smart device 201 (ie, smart washing machine) and smart device 202 (ie, smart display device). When controlling the smart device in the device 204, the recording application in the smart terminal device 204 is used to record first to obtain the recording data, wherein the recording data is mainly the user's control intention, and the control intention does not include the smart device to be controlled. The intelligent terminal device 204 sends the user's recording data to the server 203, so that the server 203 can recognize the voice data, obtain specific control information corresponding to the voice data, and determine the intelligent device that the user actually wants to control according to the control information. , and directly control the smart device to execute the corresponding control instructions, that is: realize the control of the smart home through the interaction between the server 203 and the smart terminal device 204; or the user can control the device 205 locally, such as the recording module in the Internet of Things terminal. A sound is recorded, wherein the sound is mainly the control intention of the user, and the control intention does not include the smart device to be controlled. The local control device 205 recognizes the voice data entered by the user, obtains specific control information corresponding to the voice data, thereby determines the smart device that the user actually wants to control according to the control information, and directly controls the smart device to execute the corresponding control instruction.

In the above process, the user only needs to record, and the rest of the processing process does not require the user's participation, so that the intelligent device can be automatically controlled by voice to execute the corresponding control instructions, which is convenient for the user to control and use the smart home device. Improve intelligence and accuracy.

It should be noted that: a smart home scene may include a variety of smart devices, and FIG. 1B is only an exemplary illustration, and does not specifically limit the type and number of smart devices.

The smart home control method provided by the embodiments of the present disclosure may be implemented based on a computer device, or a functional module or functional entity in the computer device.

The computer may be a personal computer (personal computer, PC), a server, a mobile phone, a tablet computer, a notebook computer, a large computer, or the like, which is not specifically limited in this embodiment of the present disclosure.

Exemplarily, FIG. 2A is a block diagram of a hardware configuration of a computer device according to one or more embodiments of the present disclosure. As shown in FIG. 2A, the computer equipment includes: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. at least one of. The controller 250 includes a central processing unit, a video processing unit, an audio processing unit, a graphics processing unit, a RAM, a ROM, and a first interface to an nth interface for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner and demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG audio and video data signals, from a plurality of wireless or wired broadcast television signals. The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The computer device can establish transmission and reception of control signals and data signals with the server 203 or the local control device 205 through the communicator 220 . The detector 230 is used to collect external environment or external interaction signals. The controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 can be used to receive control signals from a control device (eg, an infrared remote control, etc.).

In some embodiments, the controller 250, through various software control programs stored in memory, controls the operation of the computer device and responds to user operations. The controller 250 controls the overall operation of the computer device. A user may input a user command on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, a "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. A commonly used form of user interface is a graphical user interface (Graphic User Interface, GUI for short), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an interface element such as an icon, window, and control displayed on the display screen of a computer device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. at least one of the visual interface elements.

FIG. 2B is a schematic diagram of a software configuration of a computer device according to one or more embodiments of the present disclosure. As shown in FIG. 2B , the system is divided into four layers, from top to bottom, the applications layer (referred to as the “application layer” for short). ”), the Application Framework layer (referred to as the “framework layer”), the Android runtime (Android runtime) and the system library layer (referred to as the “system runtime layer”), and the kernel layer.

In some embodiments, at least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, or a clock program that comes with the operating system; they may also be developed by third-party developers. s application. During specific implementation, the applications in the application layer include but are not limited to the above examples.

In some embodiments, the system runtime layer provides support for the upper layer, that is, the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software, at least including at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power drive.

2C is a schematic diagram showing an icon control interface of an application program included in a smart device (mainly a smart playback device, such as a smart TV, a digital cinema system, or an audio-visual server, etc.) according to one or more embodiments of the present disclosure, as shown in FIG. 2C As shown, the application layer includes at least one application that can display corresponding icon controls on the display, such as: live TV application icon control, video on demand VOD application icon control, media center application icon control, application center icon control , game application icon controls, etc. Live TV app that can provide live TV from different sources. Video-on-demand VOD application that can provide videos from different storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. A media center application that can provide a variety of multimedia content playback applications. The application center can provide storage of various applications.

The smart home control method provided by the embodiments of the present application may be implemented based on the above-mentioned computer equipment.

The smart home control process provided by the embodiments of the present disclosure can be implemented based on the above-mentioned computer equipment. The method can identify the user's voice data, and obtain control information corresponding to the voice data. The control information includes function categories and control instructions. The established smart device information table determines the first candidate smart device set corresponding to the function category; then, based on the functional status corresponding to each candidate smart device in the first candidate smart device set, determines the second candidate smart device set that matches the control instruction Finally, the target smart device that matches the control command is determined from the second candidate smart device set, and the target smart device is controlled to execute the control command, which solves the problem in the prior art that a user's manual operation is required when triggering a smart home operation. Controlling the smart device to execute corresponding control instructions facilitates the user's control and use of the smart home device, and is beneficial to improving intelligence and accuracy.

In order to describe the solution in more detail, the following will be described in conjunction with FIG. 3A in an exemplary manner. It is understood that the steps involved in FIG. 3A may include more steps or fewer steps in actual implementation, And the sequence of these steps may also be different, which is subject to the realization of the smart home control method provided in the embodiments of the present application.

3A is a schematic flowchart of a smart home control method provided by an embodiment of the present disclosure, and FIG. 3B is a schematic schematic diagram of a principle of a smart home control method provided by an embodiment of the present disclosure. This embodiment is applicable to the case of controlling each smart device included in the smart home scene. The method of this embodiment can be executed by a smart home control device, and the device can be implemented by means of hardware and/or software, and can be configured in computer equipment.

As shown in Figure 3A, the method specifically includes the following steps:

S310: Identify the user's voice data to obtain corresponding control information, where the control information includes function categories and control instructions.

Among them, the voice data can be understood as the data formed by the user after recording. The control information can be understood as a control intention corresponding to the user's voice data, which includes function categories and control instructions related to the smart device, but does not include the specific smart device to be controlled. Smart devices can be understood as various devices included in the smart home scene, such as audio and video equipment, lighting systems, curtain control, air conditioning control, digital theater systems, audio and video servers, and network appliances. The function category can be understood as the category to which the specific function of the smart device belongs. For example, the category corresponding to the smart TV may include: volume, brightness, video playback scene, and recipe scene. The control instructions can be understood as operation instructions related to the smart device, such as opening, closing, playing, and pausing.

In a smart home scenario that includes multiple different types of smart devices, each smart device is in different control states. Users need to specify the specific control state of each smart device to control the smart device. For voice data that does not specify a smart device, it may be It will lead to the failure of the implementation of the voice smart home control process or the need to guide the user multiple times to supplement information in order to determine the smart device to be controlled.

The execution subject in this embodiment may be a local control device 205 with processing and interaction functions, such as an IoT terminal, and may also be a server 203 that interacts with the intelligent terminal device 204 . After obtaining the user's recording data, since the local control device 205 and the server 203 cannot directly obtain the specific information contained in the voice data, it is necessary to recognize the user's voice data. Specifically, the voice recognition method and the semantic understanding method can be used for recognition. , and can also be recognized by methods such as a neural network model or a speech recognition system, which is not specifically limited in this embodiment. After the recognition, the control information corresponding to the voice data can be obtained,

S320: Determine a first candidate smart device set corresponding to the function category according to the pre-established smart device information table.

Among them, the smart device information table can be understood as a pre-established table related to the information corresponding to each smart device in the smart home scene, and the table can include the device identification number, device name, function category and function status corresponding to each smart device respectively. . The first candidate smart device set may be understood as a set composed of smart devices included in the smart home scene that match the functional category.

After the control information corresponding to the voice data is obtained, the first candidate smart device corresponding to the function category in the control information can be obtained by matching the function category corresponding to each smart device in the smart device information table with the function category in the control information. gather.

S330 , based on the function states corresponding to each candidate smart device in the first candidate smart device set, determine a second candidate smart device set that matches the control instruction.

The second candidate smart device set may be understood as a set of smart devices included in the smart home scene that match the control instructions, and the set is a final candidate set of smart devices that the user wants to control.

The first candidate smart device set may include multiple candidate smart devices, and each candidate smart device may be in different functional states. Therefore, after obtaining the first candidate smart device set, in order to determine the smart device that the user wants to control, it is necessary to further narrow down. At this time, according to the functional state corresponding to each candidate smart device in the first candidate smart device set, the functional state corresponding to each candidate smart device is compared with the control instruction in the control information, and a candidate matching the control instruction can be obtained. The second candidate smart device set formed by smart devices.

Exemplarily, assuming that the control command is ON, the functional state corresponding to the candidate smart device 1 is normal; the functional state corresponding to the candidate smart device 2 is playing, and the functional state corresponding to the candidate smart device 3 is OFF, then the candidate smart device 3 Join the second candidate smart device set.

S340: Determine a target smart device matching the control instruction from the second candidate smart device set, and control the target smart device to execute the control instruction.

The target smart device can be understood as a smart device matching the control instruction.

Since there may be multiple smart devices included in the second candidate smart device set, the target smart device matching the control instruction needs to be determined from the second candidate smart device set. As the case may be, the present disclosure is not specifically limited. After the target smart device is determined, the corresponding control command is sent to the smart device to control the target smart device to execute the control command, so as to meet the user's needs and accurately execute the control of the target smart device conforming to the user's voice data.

Optionally, FIG. 3C is a schematic diagram of a process of determining a second candidate smart device set in an embodiment of the present disclosure, as shown in FIG. 3C :

1. Determine the total set of device names, the total set of function categories and the total set of function states corresponding to all smart devices;

Among them, the total set of device names is defined as Dev, and each smart device is Dev1, Dev2, Dev3, ...;

The total set of function categories is defined as F, and each function is F1, F2, F3, …;

The total set of functional states is defined as S, and the functional states are respectively S1, S2, S3, . . .

2. Determine the combination of functional categories and functional states contained in each smart device, and the corresponding sets are as follows:

Dev1={F1S1,F2S2,…}

Dev2 = {F1S2, F2S3, F3S3, ...}

Dev3={F1S1, F2S3, F4S1, F5S2, …}

Dev4 = {F3S3, F3S3, F5S5, ...}

3. Identify the user's voice data, and obtain the combination FxSy corresponding to the function category and the control command.

4. Query each set in step 2, and determine a second candidate smart device set according to the smart device corresponding to the set whose elements are the same as FxSy in the set.

In this embodiment, the user's voice data is first identified to obtain control information corresponding to the voice data, and the control information includes a function category and a control instruction, and then the first information corresponding to the function category is determined according to a pre-established smart device information table. A set of candidate smart devices; then based on the functional states corresponding to each candidate smart device in the first candidate smart device set, a second candidate smart device set that matches the control instruction is determined, and finally the control instruction is determined from the second candidate smart device set The matching target smart device, and control the target smart device to execute the control command, solves the problem that the user needs manual operation when triggering the smart home operation in the prior art, and automatically controls the smart device to execute the corresponding control command through the voice, which is convenient for the user to control the smart home The control and use of equipment is conducive to improving intelligence and accuracy.

In some embodiments, optionally, the smart device information table is obtained in the following manner:

Obtain the device name, function name, function category and function status corresponding to each smart device included in the preset scene;

Create or update a corresponding smart device information table according to all device names, function names, function categories, and function states.

The preset scene may be understood as a scene including multiple smart devices and the multiple smart devices are interconnected through a network, such as a smart home scene, a smart office scene, and the like.

Specifically, the device name, function name, function category, and function status corresponding to each smart device included in the preset scene can be obtained by means of smart device information reporting, and the device corresponding to each smart device can also be obtained by other methods. Name, function name, function category, and function status. After obtaining the information corresponding to each smart device, according to all the device names, function names, function categories and function status, a corresponding smart device information table can be established, or the device name, function name, function category and function status in the device name, function name, function category and function status. The smart device information table can be updated in time after at least one changes.

In this embodiment, establishing or updating the corresponding smart device information table through the above method can ensure that the smart device information table is consistent with the actual functional state of each smart device, thereby facilitating the determination of the first candidate smart device set and ensuring the integrity of the set. accuracy.

In some embodiments, optionally, the method further includes:

If the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set, second prompt information is sent, wherein the The second prompt information is used to instruct the user to determine the target smart device from a plurality of smart devices;

receiving second response information, wherein the second response information includes second identification information corresponding to the target smart device;

The target smart device corresponding to the second identification information is controlled to execute the control instruction.

The fact that the first candidate smart device set is an empty set can be understood as no candidate smart device that meets the conditions in the set. It can be understood that the second candidate smart device set is an empty set, which means that there is also no eligible smart device in the set.

Specifically, if the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set, it means that it is currently impossible to determine the smart device that the user actually wants to control. equipment. At this time, the second prompt information may be sent, for example, the local control device 205 may send the second prompt information, for example, the second prompt information may be sent to its own display screen or audio application to display or play the second prompt information to instruct the user The target smart device is determined from multiple smart devices; or the server 203 sends second prompt information to the smart terminal device 204 to instruct the user to determine the target smart device from the multiple smart devices. The second response information fed back by the user is received. Since the second response information includes the second identification information corresponding to the target smart device, the target smart device corresponding to the second identification information can be directly controlled to execute the control instruction.

In this embodiment, when the smart device that the user actually wants to control cannot be determined at present, the target smart device can be determined by the above method, so as to satisfy the user's control requirements and improve the user's use experience.

4A is a schematic flowchart of another smart home control method provided by an embodiment of the present disclosure, and FIG. 4B is a schematic schematic diagram of another smart home control method provided by an embodiment of the present disclosure. This embodiment is further extended and optimized on the basis of the above-mentioned embodiment. Optionally, a possible implementation manner of S340 in this embodiment is as follows:

S3401: Determine the number of all target candidate smart devices included in the second candidate smart device set matching the control instruction.

Since the second candidate smart device set may include multiple target candidate smart devices, in order to determine the target smart device matching the control instruction, it is necessary to determine all target candidate smart devices included in the second candidate smart device set matching the control instruction. The number of devices, so that the target smart device is subsequently determined from the second candidate smart device set according to the magnitude relationship between the number and the preset threshold.

S3402: Determine a target smart device from the second candidate smart device set according to the magnitude relationship between the quantity and the preset threshold, and control the target smart device to execute the control instruction.

The preset threshold may be a preset value, such as one, three, etc., or may be determined according to specific circumstances, which is not specifically limited in this embodiment.

After obtaining the number of all target candidate smart devices included in the second candidate smart device set, compare the number with the preset threshold to obtain the size relationship between the two, so that the second candidate smart device can be extracted from the second candidate smart device according to the size relationship between the two. The target smart device is determined in the device set, for example, all target candidate smart devices included in the second candidate smart device set are target smart devices, or some target candidate smart devices included in the second candidate smart device set are target smart devices equipment. After the target smart device is determined, it is also necessary to control the target smart device to execute the control instruction, so as to realize the smart home control through voice and reduce the user's operation.

In this embodiment, the determination of the target smart device by the above method is simple and quick, and the work efficiency can be improved.

FIG. 5A is a schematic flowchart of another smart home control method provided by an embodiment of the present disclosure, and FIG. 5B is a schematic schematic diagram of another smart home control method provided by an embodiment of the present disclosure. This embodiment is further extended and optimized on the basis of the above-mentioned embodiment. Optionally, a possible implementation manner of S3402 in this embodiment is as follows:

S34021: Determine whether the number of target candidate smart devices is less than or equal to a preset threshold.

After obtaining the number of all target candidate smart devices included in the second candidate smart device set, comparing the magnitude relationship between the number and the preset threshold, it can be determined whether the number of target candidate smart devices is less than or equal to the preset threshold.

If yes, execute S34022-S34023; if not, execute S34024-S34026.

S34022: Determine all target candidate smart devices included in the second candidate smart device set as target smart devices.

If the number of target candidate smart devices is less than or equal to the preset threshold, it means that the number of target candidate smart devices does not exceed the upper limit. Therefore, all target candidate smart devices included in the second candidate smart device set are determined as target smart devices.

S34023, control each target intelligent device to execute the control instruction respectively.

After all target candidate smart devices included in the second candidate smart device set are determined as target smart devices, a control instruction needs to be sent to each target smart device to control each target smart device to execute the control instruction respectively.

S34024: Send first prompt information, where the first prompt information is used to instruct the user to determine the target smart device from the second candidate smart device set.

If the number of target candidate smart devices is greater than the preset threshold, it means that the number of target candidate smart devices exceeds the upper limit. A prompt information, for example, the local control device 205 sends the first prompt information, for example, it can send the first prompt information to its own display screen or an audio application to display or play the first prompt information to instruct the user to select from multiple smart devices. Determine the target smart device; or the server 203 sends first prompt information to the smart terminal device 204 to instruct the user to determine the target smart device from multiple smart devices.

S34025: Receive first response information, where the first response information includes first identification information corresponding to the target smart device.

The first response information fed back by the user is received, so as to subsequently control the target smart device corresponding to the first identification information to execute the control instruction.

S34026: Control the target smart device corresponding to the first identification information to execute the control instruction.

Since the first response information includes the first identification information corresponding to the target smart device, the target smart device corresponding to the first identification information can be directly controlled to execute the control instruction.

In this embodiment, the corresponding steps are respectively performed according to the two magnitude relationships between the number of all target candidate smart devices included in the second candidate smart device set and the preset threshold, which can further improve the intelligence of the smart home control process. sex and accuracy.

FIG. 6A is a schematic flowchart of another smart home control method provided by an embodiment of the present disclosure, and FIG. 6B is a schematic schematic diagram of another smart home control method provided by an embodiment of the present disclosure. This embodiment is further extended and optimized on the basis of the above-mentioned embodiment. Optionally, a possible implementation manner of S310 in this embodiment is as follows:

S3101. Perform text recognition on the voice data by using a voice recognition method to obtain text information corresponding to the voice data.

Among them, the speech recognition method is a method of converting speech into text, such as speech recognition software.

The speech recognition method can perform text recognition on the speech data, thereby obtaining text information corresponding to the speech data.

S3102 , perform semantic understanding on the text information through a semantic understanding method, and obtain control information contained in the text information, where the control information includes function categories and control instructions.

The semantic understanding method may include a keyword extraction method, an information extraction method, and the like.

After the text information is obtained, since the text information recognized by the machine may contain redundant information, repeated information, etc., in order to further improve the accuracy of the recognition process, the text information is semantically understood through the semantic understanding method, and the control information contained in the text information is obtained. information, the control information includes function categories and control instructions.

In this embodiment, the control information obtained by the above method is more accurate and more in line with the actual situation, which is beneficial to ensure the smooth progress of the subsequent process.

Exemplarily, FIG. 6C is a schematic diagram of a process of obtaining control information in an embodiment of the present disclosure, as shown in FIG. 6C :

First, voice recognition is performed on the voice data to obtain the first information, and then the first information is semantically understood to obtain the control information.

Exemplarily, FIG. 7A is a schematic structural diagram of a local control device in an embodiment of the disclosure, as shown in FIG. 7A :

The local control device 205 includes speech recognition services, semantic understanding services, and smart device control services. Among them, the speech recognition service is mainly used for recording and recognizing the user's voice data to obtain the recognition result; the semantic understanding service is mainly used to determine the control information according to the recognition result; the home control service is used to maintain the smart device information table and receive reports from smart devices and control the corresponding smart device according to the control information.

FIG. 7B is a schematic structural diagram of the interaction between a local control device and a smart device in an embodiment of the disclosure, as shown in FIG. 7B :

The voice recognition service includes a recording module and a recognition engine, wherein the recording module is used for recording, and the recognition engine is used for recognition according to the user's voice data to obtain a recognition result. The semantic understanding service includes functional categories and control instructions. The home control service includes smart device information table, target smart device and home command control. The home control service interacts with each smart device, such as smart device A, smart device B, ..., smart device N. The home control service obtains the smart device information table according to the device information reported by each smart device; according to the smart device information table and the function category to determine the first candidate smart device set; determine the second candidate smart device set according to the second candidate smart device set and the control instruction, and determine the target smart device from the second candidate smart device set, and control the target smart device to execute the Control instructions, so as to control the smart home through voice data. The smart device is responsible for reporting device information and receiving and executing the control instructions issued by the home control service.

In some embodiments, it is assumed that the smart device information table is shown in Table 1 below:

Table 1

equipment identification number device name functional category functional status 1 curtain brightness closure 2 television brightness normal 3 television volume normal 4 television recipe scene Show UI 5 smart speaker music scene Now Playing 6 oven food scene Steak set 7 refrigerator Door turn on 8 washing machine Door closure

The information contained in each smart device in Table 1 is as follows:

1. Curtains are closed;

2. The brightness of the TV is normal, the volume is normal, and the recipe UI is being displayed;

3. The smart speaker is playing music;

4. The steak has been placed in the oven, waiting to start cooking.

5. The door of the refrigerator is open.

6. The door of the washing machine is closed.

It should be noted that: each device included in Table 1 is a smart device.

Example 1: Assuming that the voice data is "too dark", the function category is brightness, the control command is increase, and the preset threshold is 1, according to the function category and Table 1, it can be determined that the first candidate smart device set is: 1 curtain and 2 TV; then according to the functional status and control instructions of each smart device in the first candidate smart device set, it can be determined that the second candidate smart device set is: 1 curtain, because the number of all target candidate smart devices included in the second candidate smart device set If it is equal to the preset threshold, the target smart device is determined to be 1 curtain, and the curtain is controlled to perform the opening function.

Example 2: Assuming the voice data is "I want to grill steak", the function category is the ingredient scene and the recipe scene, the control command is cooking and query, and the preset threshold is 1, then the first candidate smart device can be determined according to the function category and Table 1 The sets are: 4 TVs and 6 ovens; then according to the functional states and control instructions of each smart device in the first candidate smart device set, it can be determined that the second candidate smart device set is: 6 ovens, because the second candidate smart device set contains 6 ovens. The number of all target candidate smart devices is equal to the preset threshold, then the target smart devices are determined to be 6 ovens, and the oven is controlled to perform the function of grilling steak.

In some embodiments, if it is detected that there is no steak in the oven, but the TV supports a recipe query function, the TV's introduction of the grilled steak recipe is performed.

Example 3: Assuming that the voice data is "too loud", the function category is volume, the control command is lower, and the preset threshold is 1, then according to the function category and Table 1, it can be determined that the first candidate smart device set is: 3 TV and 5 smart speakers; then according to the functional status and control instructions of each smart device in the first candidate smart device set, it can be determined that the second candidate smart device set is: 5 smart speakers, because all target candidate smart devices included in the second candidate smart device set If the number of devices is equal to the preset threshold, the target smart devices are determined to be 5 smart speakers, and the smart speakers are controlled to perform the volume reduction function.

In some embodiments, if it is detected that the TV is also playing a video, the user is prompted to select whether the device to turn down the volume is a TV or a speaker.

Example 4: Assuming that the voice data is "close the door", the function category is door, the control command is closed, and the preset threshold is 1, then according to the function category and Table 1, it can be determined that the first candidate smart device set is: 7 refrigerators and 8 TV sets Then, according to the functional state of each smart device in the first candidate smart device set and the control instruction, it can be determined that the second candidate smart device set is: 7 refrigerators, because the number of all target candidate smart devices included in the second candidate smart device set is equal to If the preset threshold is set, the target smart device is determined to be 7 refrigerators, and the refrigerator is controlled to perform the door closing function.

In some embodiments, if it is detected that the oven door is also in an open state, the user is prompted whether the device to close the door is a refrigerator or an oven.

8A is a schematic structural diagram of a smart home control device provided by an embodiment of the present disclosure; the device is configured in a computer device and can implement the smart home control method described in any embodiment of the present application. The device specifically includes the following:

The identification module 801 is used to identify the user's voice data to obtain corresponding control information, where the control information includes function categories and control instructions;

a first determining module 802, configured to determine a first candidate smart device set corresponding to the function category according to a pre-established smart device information table;

A second determining module 803, configured to determine a second candidate smart device set matching the control instruction based on the functional status corresponding to each candidate smart device in the first candidate smart device set;

The control module 804 is configured to determine a target smart device matching the control instruction from the second candidate smart device set, and control the target smart device to execute the control instruction.

FIG. 8B is a schematic structural diagram of a control module 804 in a smart home control device according to an embodiment of the present disclosure. As shown in FIG. 8B , the control module 804 includes:

A quantity determining unit 8041, configured to determine the quantity of all target candidate smart devices included in the second candidate smart device set matching the control instruction;

A device determining unit 8042, configured to determine the target smart device from the second candidate smart device set according to the magnitude relationship between the quantity and a preset threshold, and control the target smart device to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit 8042 is specifically configured to:

If the number of all target candidate smart devices is less than or equal to the preset threshold, determining all target candidate smart devices included in the second candidate smart device set as the target smart device;

Control each target smart device to execute the control instruction respectively.

As an optional implementation manner of the embodiment of the present disclosure, the device determining unit 8042 is further specifically configured to:

If the number of all target candidate smart devices is greater than the preset threshold, first prompt information is sent, where the first prompt information is used to instruct the user to determine the target smart device from the second candidate smart device set ;

receiving first response information, wherein the first response information includes first identification information corresponding to the target smart device;

The target smart device corresponding to the first identification information is controlled to execute the control instruction.

As an optional implementation manner of the embodiment of the present disclosure, the identification module 801 is specifically used for:

Perform text recognition on the voice data by a voice recognition method to obtain text information corresponding to the voice data;

The text information is semantically understood through a semantic understanding method to obtain the control information contained in the text information.

As an optional implementation manner of the embodiment of the present disclosure, the smart device information table is obtained in the following manner:

Obtain the device name, function name, function category and function status corresponding to each smart device included in the preset scene;

Create or update a corresponding smart device information table according to all device names, function names, function categories, and function states.

As an optional implementation manner of the embodiment of the present disclosure, the apparatus further includes:

A sending module, configured to send a second prompt if the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set information, wherein the second prompt information is used to instruct the user to determine the target smart device from a plurality of smart devices;

a receiving module, configured to receive second response information, wherein the second response information includes second identification information corresponding to the target smart device;

The target smart device corresponding to the second identification information is controlled to execute the control instruction.

The smart home control device provided by the embodiment of the present disclosure can execute the smart home control method provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method. To avoid repetition, details are not described here.

An embodiment of the present disclosure provides a computer device, including: one or more processors; and a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, The one or more processors are caused to implement the smart home control method described in any one of the embodiments of the present disclosure.

FIG. 9 is a schematic structural diagram of a computer device provided by an embodiment of the present disclosure. As shown in FIG. 9 , the computer device includes a processor 910 and a storage device 920; the number of processors 910 in the computer device may be one or more, and one processor 910 is taken as an example in FIG. 9; the processor in the computer device The storage device 910 and the storage device 920 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 9 .

As a computer-readable storage medium, the storage device 920 can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the smart home control method in the embodiments of the present disclosure. The processor 910 executes various functional applications and data processing of the computer equipment by running the software programs, instructions and modules stored in the storage device 920, ie, implements the smart home control method provided by the embodiments of the present disclosure.

The storage device 920 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Additionally, storage device 920 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, storage device 920 may further include memory located remotely from processor 910, which may be connected to the computer device through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The computer device provided in this embodiment can be used to execute the smart home control method provided by any of the above embodiments, and has corresponding functions and beneficial effects.

Embodiments of the present disclosure provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process performed by the above-mentioned smart home control method can be implemented, and the same technical effect can be achieved. , in order to avoid repetition, it will not be repeated here.

Wherein, the computer-readable storage medium may be a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk, an optical disk, or the like.

The present disclosure provides a computer program product, which is characterized by comprising: when the computer program product runs on a computer, causing the computer to implement the above application installation method.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments have been chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the embodiments and various modified embodiments suitable for specific use considerations.

Claims (10)

1. a smart home control method, is characterized in that, described method comprises: Identifying the user's voice data to obtain corresponding control information, where the control information includes function categories and control instructions; determining a first candidate smart device set corresponding to the functional category according to a pre-established smart device information table; determining a second candidate smart device set matching the control instruction based on the functional state corresponding to each candidate smart device in the first candidate smart device set; A target smart device matching the control instruction is determined from the second candidate smart device set, and the target smart device is controlled to execute the control instruction. 2. The method according to claim 1, wherein the target smart device matching the control instruction is determined from the second candidate smart device set, and the target smart device is controlled to execute the control Instructions, including: determining the number of all target candidate smart devices included in the second candidate smart device set matching the control instruction; The target smart device is determined from the second candidate smart device set according to the magnitude relationship between the number and the preset threshold, and the target smart device is controlled to execute the control instruction. 3 . The method according to claim 2 , wherein the target smart device is determined from the second candidate smart device set according to the relationship between the quantity and a preset threshold, and the target smart device is controlled. 4 . The target smart device executes the control instruction, including: If the number of all target candidate smart devices is less than or equal to the preset threshold, determining all target candidate smart devices included in the second candidate smart device set as the target smart device; Control each target smart device to execute the control instruction respectively. 4. The method of claim 3, further comprising: If the number of all target candidate smart devices is greater than the preset threshold, first prompt information is sent, where the first prompt information is used to instruct the user to determine the target smart device from the second candidate smart device set ; receiving first response information, wherein the first response information includes first identification information corresponding to the target smart device; The target smart device corresponding to the first identification information is controlled to execute the control instruction. 5. The method according to claim 1, wherein the identifying the user's voice data to obtain corresponding control information, comprising: Perform text recognition on the voice data by a voice recognition method to obtain text information corresponding to the voice data; The text information is semantically understood through a semantic understanding method to obtain the control information contained in the text information. 6. The method according to claim 1, wherein the smart device information table is obtained in the following manner: Obtain the device name, function name, function category and function status corresponding to each smart device included in the preset scene; Create or update a corresponding smart device information table according to all device names, function names, function categories, and function states. 7. The method according to any one of claims 1-6, further comprising: If the first candidate smart device set is an empty set, or if the first candidate smart device set is a non-empty set and the second candidate smart device set is an empty set, second prompt information is sent, wherein the The second prompt information is used to instruct the user to determine the target smart device from a plurality of smart devices; receiving second response information, wherein the second response information includes second identification information corresponding to the target smart device; The target smart device corresponding to the second identification information is controlled to execute the control instruction. 8. A smart home control device, wherein the device comprises: an identification module for identifying the user's voice data to obtain corresponding control information, where the control information includes function categories and control instructions; a first determining module, configured to determine a first candidate smart device set corresponding to the function category according to a pre-established smart device information table; a second determining module, configured to determine a second candidate smart device set matching the control instruction based on the functional status corresponding to each candidate smart device in the first candidate smart device set; A control module, configured to determine a target smart device matching the control instruction from the second candidate smart device set, and control the target smart device to execute the control instruction. 9. A computer equipment, characterized in that, comprising: one or more processors; storage means for storing one or more programs, The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-7. 10. A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the method according to any one of claims 1-7 is implemented.

Images