CN112672120B - Projector with speech analysis function and method for generating personal health data - Google Patents

Projector with speech analysis function and method for generating personal health data Download PDF

Info

Publication number
CN112672120B
CN112672120B CN201910979936.6A CN201910979936A CN112672120B CN 112672120 B CN112672120 B CN 112672120B CN 201910979936 A CN201910979936 A CN 201910979936A CN 112672120 B CN112672120 B CN 112672120B
Authority
CN
China
Prior art keywords
module
voice
unit
information
projector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910979936.6A
Other languages
Chinese (zh)
Other versions
CN112672120A (en
Inventor
许桂林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Aiwo Health Network Service Co ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201910979936.6A priority Critical patent/CN112672120B/en
Publication of CN112672120A publication Critical patent/CN112672120A/en
Application granted granted Critical
Publication of CN112672120B publication Critical patent/CN112672120B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to the field of projectors, in particular to a projector with a voice analysis function and a personal health data generation method, wherein the projector comprises: the circuit comprises a central control module, an optical projection module, an audio output module, a power supply module, a voice analysis module and an edge calculation voice processing module; the voice analysis module comprises a recording unit, an A/D conversion unit, a denoising unit and a voiceprint detection and extraction unit which are sequentially and electrically connected, the personal health data generation method comprises voice recording, signal conversion, denoising processing, voiceprint recognition and extraction and edge calculation, and the projector can collect information of daily life information, voiceprint characteristics and the like of the user and provide data support for health diagnosis of the user.

Description

一种带语音分析功能的投影仪及个人健康数据生成方法Projector with speech analysis function and method for generating personal health data

技术领域technical field

本发明涉及投影仪技术领域,尤其涉及一种带语音分析功能的投影仪及个人健康数据生成方法。The invention relates to the technical field of projectors, in particular to a projector with a speech analysis function and a method for generating personal health data.

背景技术Background technique

投影仪,是一种可以将图像或视频投射到幕布上的设备,投影仪目前广泛应用于家庭、多媒体会议、学校和娱乐场所;目前的的投影仪功能单一,无法收集用户的日常生活信息及其他身体生理、心理信息,为用户的健康诊断提供数据支持。A projector is a device that can project images or videos onto a screen. Projectors are currently widely used in homes, multimedia conferences, schools, and entertainment venues. The current projectors have a single function and cannot collect information about users' daily life. Other physical and psychological information provides data support for the user's health diagnosis.

现有技术中有单独的人体健康检测机,如专利号为CN109859843A的专利只能检测用户的生理数据如血糖、血脂等数据,不涉及到心理情绪变化的收集分析,也不会收集用户日常饮食、药物等数据辅助健康诊断。事实上如果医生对病人进行诊断时,不结合病人长期的心理、情绪状态、日常饮食、药物等情况则容易发生误诊。There are separate human health detectors in the prior art. For example, the patent with the patent number of CN109859843A can only detect the user's physiological data such as blood sugar, blood lipid and other data, and does not involve the collection and analysis of psychological and emotional changes, nor does it collect the user's daily diet. , drugs and other data to assist health diagnosis. In fact, if a doctor diagnoses a patient without considering the patient's long-term psychology, emotional state, daily diet, and drugs, misdiagnosis is likely to occur.

发明内容SUMMARY OF THE INVENTION

本发明的一个目的在于提供一种带语音分析功能的投影仪,可实现语音信息以及声纹的采集及处理,为用户身体健康分析提供数据支持;另一个目的在于提供一种基于上述带语音分析功能的投影仪的个人健康数据生成方法。One object of the present invention is to provide a projector with a voice analysis function, which can realize the collection and processing of voice information and voiceprints, and provide data support for the user's physical health analysis; another object is to provide a voice analysis based on the above. A method of generating personal health data for a functional projector.

为实现上述目的,本发明提供一种带语音分析功能的投影仪,包括:壳体以及设置在壳体内部的电路,电路包括中央控制模块、光学投影模块、音频输出模块、电源模块、语音分析模块、边缘计算语音处理模块;中央控制模块分别与光学投影模块、音频输出模块、电源模块、语音分析模块、边缘计算语音处理模块电连接;语音分析模块包括依次电连接的录音单元、A/D转换单元、去噪单元、声纹检测提取单元,录音单元用于录入用户的语音信息并将语音信息发送给A/D转换单元转换为数字语音信号,去噪单元将数字语音信号进行去噪处理后传输给声纹检测提取单元;声纹检测提取单元接收数字语音信号并提取声纹后将声纹与预先存储的用户声纹进行比对,若比对成功,将声纹以及数字语音信号发送给边缘计算语音处理模块;边缘计算语音处理模块用于对接收到的声纹以及数字语音信号进行分析处理生成个人健康数据。In order to achieve the above purpose, the present invention provides a projector with a voice analysis function, comprising: a casing and a circuit arranged inside the casing, the circuit includes a central control module, an optical projection module, an audio output module, a power supply module, and a voice analysis module. module, edge computing voice processing module; the central control module is respectively electrically connected with the optical projection module, audio output module, power supply module, voice analysis module, and edge computing voice processing module; the voice analysis module includes a recording unit, A/D The conversion unit, the denoising unit, the voiceprint detection and extraction unit, the recording unit is used to input the user's voice information and send the voice information to the A/D conversion unit to convert it into a digital voice signal, and the denoising unit denoises the digital voice signal. Then, it is transmitted to the voiceprint detection and extraction unit; the voiceprint detection and extraction unit receives the digital voice signal and extracts the voiceprint, and compares the voiceprint with the pre-stored user voiceprint. If the comparison is successful, the voiceprint and the digital voice signal are sent. To the edge computing voice processing module; the edge computing voice processing module is used to analyze and process the received voiceprint and digital voice signals to generate personal health data.

进一步的,语音分析模块还包括语音指令控制单元,语音指令控制单元用于根据用户的语音指令生成指令控制信号发送给中央控制模块,中央控制模块根据指令控制信号控制投影仪的开关机以及投影仪的内部系统运行;语音指令控制单元与去噪单元、声纹检测提取单元电连接。Further, the voice analysis module also includes a voice command control unit, and the voice command control unit is used to generate a command control signal according to the user's voice command and send it to the central control module, and the central control module controls the on-off of the projector and the projector according to the command control signal. The internal system operates; the voice command control unit is electrically connected with the denoising unit and the voiceprint detection and extraction unit.

进一步的,电路还包括远程指纹开关模块,远程指纹开关模块与中央控制模块电连接或远程指纹开关模块与中央控制模块无线连接,用户通过远程指纹开关模块控制所述投影仪开机,同时,光学投影模块出现白屏;或者,用户通过语音分析模块输入开机语音指令控制投影仪开机,同时,光学投影模块出现白屏。Further, the circuit also includes a remote fingerprint switch module, the remote fingerprint switch module is electrically connected to the central control module or the remote fingerprint switch module is wirelessly connected to the central control module, the user controls the projector to turn on through the remote fingerprint switch module, and at the same time, the optical projection A white screen appears on the module; or, the user controls the projector to turn on by inputting a power-on voice command through the voice analysis module, and at the same time, a white screen appears on the optical projection module.

进一步的,电路还包括散热模块,散热模块与中央控制模块电连接,用于对运行的投影仪进行散热。Further, the circuit further includes a heat dissipation module, and the heat dissipation module is electrically connected with the central control module, and is used for heat dissipation of the running projector.

进一步的,电源模块包括电源控制电路、锂电池和外接电源适配接口,锂电池和外接电源适配接口通过电源控制电路进行电源的切换和输入。Further, the power module includes a power control circuit, a lithium battery and an external power adapter interface, and the lithium battery and the external power adapter interface perform power switching and input through the power control circuit.

进一步的,音频输出模块包括内置扬声器和音频输出接口。Further, the audio output module includes a built-in speaker and an audio output interface.

进一步的,电路还包括无线模块,无线模块与中央控制模块电连接。Further, the circuit further includes a wireless module, and the wireless module is electrically connected with the central control module.

进一步的,电路还包括存储模块,存储模块与中央控制模块、边缘计算语音分析模块电连接。Further, the circuit further includes a storage module, and the storage module is electrically connected with the central control module and the edge computing voice analysis module.

进一步的,边缘计算语音分析模块包括高效缓存单元、神经网络加速单元、数据可视化单元、异常网络信息反馈单元,其中:神经网络加速单元用于对语音分析模块传输的数字语音信号以及声纹进行分析处理生成个人健康数据并发送至高效缓存单元进行缓存;数据可视化单元用于将神经网络加速单元生成的个人健康数据以及神经网络加速单元无法处理的数字语音信号、声纹进行数据可视化处理传输至异常网络信息反馈单元进行反馈。Further, the edge computing voice analysis module includes a high-efficiency cache unit, a neural network acceleration unit, a data visualization unit, and an abnormal network information feedback unit, wherein: the neural network acceleration unit is used to analyze the digital voice signal and voiceprint transmitted by the voice analysis module. Process and generate personal health data and send it to the high-efficiency cache unit for caching; the data visualization unit is used to visualize the personal health data generated by the neural network acceleration unit and the digital voice signals and voiceprints that cannot be processed by the neural network acceleration unit. The network information feedback unit performs feedback.

本发明还提供了一种基于上述的带语音分析功能的投影仪的健康数据生成方法,方法包括:The present invention also provides a method for generating health data based on the above-mentioned projector with a speech analysis function, the method comprising:

S101:投影仪通过语音开机或开关开机;S101: The projector is turned on by voice or switch;

S102:语音分析模块开始录入用户语音信息;S102: The voice analysis module starts to input user voice information;

S103:将步骤S103中录入的用户语音信息转换为数字语音信号并提取声纹;S103: Convert the user voice information entered in step S103 into a digital voice signal and extract voiceprints;

S104:判断提取到的声纹与预先存储的声纹是否匹配,若是,执行步骤S105,否则,结束;S104: determine whether the extracted voiceprint matches the pre-stored voiceprint, if so, perform step S105, otherwise, end;

S105:将数字语音信号以及声纹发送给边缘计算语音处理模块;S105: Send the digital voice signal and voiceprint to the edge computing voice processing module;

S106:边缘计算语音处理模块对接收到的数字语音信号进行语义识别并根据语义识别结果将接收到的数字语音信号分为饮食信息、用药信息、情绪信息以及生活言语信息;S106: The edge computing voice processing module performs semantic recognition on the received digital voice signal and divides the received digital voice signal into diet information, medication information, emotional information and life language information according to the semantic recognition result;

S107:边缘计算语音处理模块分别对饮食信息、用药信息、情绪信息、生活言语信息以及声纹信息进行分析处理生成个人健康数据。S107: The edge computing voice processing module analyzes and processes the dietary information, medication information, emotional information, life speech information and voiceprint information respectively to generate personal health data.

本发明具有以下有益效果:The present invention has the following beneficial effects:

1、本发明提供的带语音分析功能的投影仪增加了语音分析模块、边缘计算语音处理模块,能够通过语音分析模块采集用户的饮食信息、用药信息、情绪信息以及生活言语信息,并提取声纹特征,并对这些数据进行边缘计算,分析得出用户的情绪及心理变化以及日常饮食、用药情况,为之后的用户健康诊断提供数据支持,降低医生误诊率。1. The projector with the speech analysis function provided by the present invention adds a speech analysis module and an edge computing speech processing module, which can collect the user's diet information, medication information, emotional information and life language information through the speech analysis module, and extract the voiceprint. Features, and perform edge computing on these data to analyze the user's emotional and psychological changes, as well as daily diet and medication conditions, provide data support for subsequent user health diagnosis, and reduce the rate of misdiagnosis by doctors.

2、本发明中的语音分析模块具有语音控制功能,能识别出用户指令,从而实现对投影仪的语音控制。2. The voice analysis module in the present invention has a voice control function, which can recognize user commands, thereby realizing voice control of the projector.

附图说明Description of drawings

图1为本发明一种实施例的投影仪内部电路结构示意图;1 is a schematic diagram of the internal circuit structure of a projector according to an embodiment of the present invention;

图2为本发明一种实施例的语音分析模块电路结构示意图;2 is a schematic diagram of a circuit structure of a speech analysis module according to an embodiment of the present invention;

图3为本发明又一种实施例的投影仪内部电路结构示意图;3 is a schematic diagram of an internal circuit structure of a projector according to another embodiment of the present invention;

图4为本发明一种实施例的电源模块电路结构示意图;FIG. 4 is a schematic structural diagram of a power module circuit according to an embodiment of the present invention;

图5为本发明一种实施例的音频输出模块电路结构示意图;5 is a schematic structural diagram of an audio output module circuit according to an embodiment of the present invention;

图6为本发明一种实施例的边缘计算语音处理模块电路结构示意图;6 is a schematic diagram of a circuit structure of an edge computing voice processing module according to an embodiment of the present invention;

图7为本发明一种实施例的个人健康数据生成方法流程图;7 is a flowchart of a method for generating personal health data according to an embodiment of the present invention;

1-中央控制模块、2-光学投影模块、3-音频输出模块、4-电源模块、5-边缘计算语音处理模块、6-语音分析模块、7-远程指纹开关模块、8-散热模块、9-无线模块、10-存储模块、301-音频输出接口、302-内置扬声器、401-电源控制电路、402-锂电池、403-外接电源适配接口、501-高效缓存单元、502-神经网络加速单元、503-数据可视化单元、504-异常网络信息反馈单元、601-录音单元、602-A/D转换单元、603-去噪单元、604-声纹检测提取单元、605-语音指令控制单元。1-central control module, 2-optical projection module, 3-audio output module, 4-power supply module, 5-edge computing voice processing module, 6-voice analysis module, 7-remote fingerprint switch module, 8-cooling module, 9 -Wireless module, 10-storage module, 301-audio output interface, 302-built-in speaker, 401-power control circuit, 402-lithium battery, 403-external power adapter interface, 501-high-efficiency buffer unit, 502-neural network acceleration Units, 503 - data visualization unit, 504 - abnormal network information feedback unit, 601 - recording unit, 602 - A/D conversion unit, 603 - denoising unit, 604 - voiceprint detection and extraction unit, 605 - voice command control unit.

具体实施方式Detailed ways

下面将结合本发明中的附图,对本发明实施例中的技术方案进行清楚、完整的描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通的技术人员在没有做出创造性劳动的前提下所获得的所有其它实施例,都属于本发明的保护范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present invention.

本发明提供一种带语音分析功能的投影仪,包括壳体以及设置在壳体内部的电路,在本发明提供的一实施例的内部电路结构示意图如图1所示,壳体内部的电路结构包括中央控制模块1、光学投影模块2、音频输出模块3、电源模块4、边缘计算语音处理模块5以及语音分析模块6。中央控制模块1分别与光学投影模块2、音频输出模块3、电源模块4、边缘计算语音处理模块5、语音分析模块6电连接,控制各个模块正常运转,例如控制投影仪的开关机、开关操作系统,主要承担系统控制、数据中转等。而语音信息的分析处理则主要由边缘计算语音分析模块5完成。电源模块4分别与中央控制模块1、光学投影模块2、音频输出模块3、语音分析模块6以及边缘计算语音处理模块5电连接,为各个模块供电,保证各个模块的正常工作。The present invention provides a projector with a speech analysis function, which includes a casing and a circuit arranged inside the casing. The schematic diagram of the internal circuit structure of an embodiment provided by the present invention is shown in FIG. 1 . The circuit structure inside the casing is shown in FIG. 1 . It includes a central control module 1 , an optical projection module 2 , an audio output module 3 , a power supply module 4 , an edge computing voice processing module 5 and a voice analysis module 6 . The central control module 1 is electrically connected to the optical projection module 2, the audio output module 3, the power supply module 4, the edge computing voice processing module 5, and the voice analysis module 6, respectively, and controls the normal operation of each module, such as controlling the on-off and on-off operations of the projector. System, mainly responsible for system control, data transfer, etc. The analysis and processing of the voice information is mainly completed by the edge computing voice analysis module 5 . The power supply module 4 is electrically connected to the central control module 1, the optical projection module 2, the audio output module 3, the speech analysis module 6 and the edge computing speech processing module 5, respectively, to supply power to each module and ensure the normal operation of each module.

具体的,如图2所示,语音分析模块6包括录音单元601、A/D转换单元602、去噪单元603、声纹检测提取单元604。Specifically, as shown in FIG. 2 , the speech analysis module 6 includes a recording unit 601 , an A/D conversion unit 602 , a denoising unit 603 , and a voiceprint detection and extraction unit 604 .

录音单元601用于采集用户语音,录音单元601与A/D转换单元602电连接,可选的,录音单元601可以为麦克风及市售的录音芯片,如型号为WTR050、WT2000的语音芯片等等,用于采集或录制使用者的语音信息,用户录制口述的个人日常饮食、服用药物等情况、日常生活中的言语信息等,采集到用户的语音信息之后输出给A/D转换单元602。A/D转换单元602为模数转换器,可选的,可以使用双八位高速ADC转换器MXT2002,将语音模拟信号转换为投影仪后续能够处理的数字语音信号,A/D转换单元602与去噪单元603电连接,将转换后的数字语音信号输出给去噪单元603进行去噪处理,去噪完成之后再将去噪之后的数字语音信号分别传输给声纹检测提取单元604。经过去噪单元603进行去噪后可以有效的消除数字语音信号中的杂音,得到更加精确的数字语音信号,方便之后的声纹检测提取单元604进行声纹检测提取以及边缘计算语音处理模块5进行分析计算,降低声纹检测提取以及分析计算的难度,提高声纹检测提取、分析计算的准确率并且保证录音的音效。可选的,去噪单元603可以为市售的滤波器。The recording unit 601 is used to collect the user's voice, and the recording unit 601 is electrically connected to the A/D conversion unit 602. Optionally, the recording unit 601 can be a microphone and a commercially available recording chip, such as a voice chip with models of WTR050 and WT2000, etc. , is used to collect or record the user's voice information. The user records oral personal daily diet, taking medicine, etc., and speech information in daily life. The A/D conversion unit 602 is an analog-to-digital converter. Optionally, a dual eight-bit high-speed ADC converter MXT2002 can be used to convert the analog voice signal into a digital voice signal that the projector can process later. The A/D conversion unit 602 is connected to The denoising unit 603 is electrically connected, and outputs the converted digital voice signal to the denoising unit 603 for denoising processing. After the denoising is completed, the denoised digital voice signal is respectively transmitted to the voiceprint detection and extraction unit 604 . After denoising by the denoising unit 603, the noise in the digital voice signal can be effectively eliminated, and a more accurate digital voice signal can be obtained, which is convenient for the voiceprint detection and extraction by the voiceprint detection and extraction unit 604 and the edge computing voice processing module 5. Analysis and calculation, reduce the difficulty of voiceprint detection, extraction and analysis and calculation, improve the accuracy of voiceprint detection, extraction, analysis and calculation, and ensure the sound effect of the recording. Optionally, the denoising unit 603 may be a commercially available filter.

声纹检测提取单元604与边缘计算语音处理模块5电连接,对输入的数字信号进行声纹、声波检测,提取声纹特征,与预先存储在声纹检测提取单元604中的投影仪用户的声纹进行对比。可选的,声纹检测提取单元604也可采用市售的声纹识别芯片,如SpeakIn的声纹识别芯片。声纹检测提取单元604中已经预先存储了用户的声纹,当声纹检测提取单元604检测到声纹时,将当前的声纹与预先存储的声纹进行比较,从而判断当前用户是否为投影仪的用户,若当前用户的声纹与预先设置的用户的声纹匹配成功,则声纹检测提取单元604将提取的声纹特征以及接收到的数字语音信号一并发送给边缘计算语音处理模块5进行处理计算。The voiceprint detection and extraction unit 604 is electrically connected to the edge computing voice processing module 5, and performs voiceprint and sound wave detection on the input digital signal, extracts the voiceprint features, and is pre-stored in the voiceprint detection and extraction unit 604. The voice of the projector user. pattern for comparison. Optionally, the voiceprint detection and extraction unit 604 may also use a commercially available voiceprint recognition chip, such as a voiceprint recognition chip of SpeakIn. The voiceprint detection and extraction unit 604 has pre-stored the user's voiceprint. When the voiceprint detection and extraction unit 604 detects a voiceprint, it compares the current voiceprint with the pre-stored voiceprint to determine whether the current user is a projection. If the voiceprint of the current user matches the preset user's voiceprint successfully, the voiceprint detection and extraction unit 604 sends the extracted voiceprint feature and the received digital voice signal to the edge computing voice processing module 5 Perform processing calculations.

可选的,在本发明提供的投影仪中的声纹检测提取单元604可以预先存储多个用户信息,包括声纹信息,边缘计算语音处理模块5中也可以建立多个用户独立的个人信息数据库用于临时缓存个人数据。当预先存储的投影仪的用户信息为多个时,在声纹检测提取单元604进行检测提取时还要检测该声纹特征属于哪一位用户,并将该用户身份信息随声纹以及数字语音信号一起发送给边缘计算语音处理模块5,边缘计算语音处理模块5从而能够得知目前分析计算的声纹以及数字语音信号等语音信息是具体哪一个用户的语音信息,从而将语音信息以及分析计算的结果存储在该用户的个人信息数据库中。Optionally, the voiceprint detection and extraction unit 604 in the projector provided by the present invention can pre-store multiple user information, including voiceprint information, and the edge computing voice processing module 5 can also establish multiple user-independent personal information databases. For temporary caching of personal data. When the pre-stored user information of the projector is multiple, when the voiceprint detection and extraction unit 604 performs detection and extraction, it is necessary to detect which user the voiceprint feature belongs to, and combine the user identity information with the voiceprint and digital voice. The signal is sent to the edge computing voice processing module 5 together, and the edge computing voice processing module 5 can know which user's voice information is the voice information such as the voiceprint and digital voice signal currently analyzed and calculated, so as to combine the voice information and analysis calculation. The results are stored in the user's personal information database.

边缘计算语音处理模块5可以提取语速、语频信息,同时识别语义,分析用户的措辞、进行声纹特征变化分析等,由于人的情绪会对声纹、语速、语频等产生一定影响,在用户生气、开心时发出的声音的声纹、语速、语频是存在区别的,边缘计算语音处理模块5可以通过上述分析从而确定当前用户的情绪、心理状态,在一定时间段内进行综合分析,还可以分析出用户当前的情绪、心理状态波动情况。并且边缘计算语音处理模块5能够识别语义,因此能够分析出用户的饮食信息、用药信息并将这些信息转换为文字进行分析计算得到用户的饮食状况、用药状况。边缘计算语音处理模块5进行分析计算得到的情绪、心理、饮食、用药信息等信息可以作为个人健康数据,为医生进行健康诊断时提供健康数据支持,降低医生的误诊率。The edge computing speech processing module 5 can extract speech rate and speech frequency information, at the same time recognize semantics, analyze the user's wording, and analyze the change of voiceprint characteristics. Because human emotions will have a certain impact on speechprints, speech rate, speech frequency, etc. , there are differences in the voiceprint, speech rate, and speech frequency of the voice made when the user is angry or happy. The edge computing voice processing module 5 can determine the current user's mood and psychological state through the above analysis, and carry out the process within a certain period of time. Comprehensive analysis can also analyze the user's current emotional and psychological state fluctuations. And the edge computing voice processing module 5 can recognize semantics, so it can analyze the user's diet information and medication information and convert these information into text for analysis and calculation to obtain the user's diet status and medication status. Information such as emotion, psychology, diet, medication information and other information obtained by the edge computing voice processing module 5 can be used as personal health data to provide health data support for doctors during health diagnosis and reduce the misdiagnosis rate of doctors.

在本实施例中,带语音分析功能的投影仪增加了边缘计算语音处理模块5,可选的,边缘计算语音处理模块5可以为地平线公司的XForce边缘AI计算平台,Google的TPU、寒武纪的DianNao系列、Eyeriss的NPU、英特尔至强D-2100处理器等AI芯片。边缘计算语音处理模块5也可以为带有边缘计算功能的GPU,GPU为图形处理器,目前的GPU已经不再局限于3D图形处理了,GPU通用计算技术发展已经引起业界不少的关注,事实也证明在浮点运算、并行计算等部分计算方面,GPU可以提供数十倍乃至于上百倍于CPU的性能,在目前的GPU中加入具有边缘计算功能的芯片能够快速实现对大数据的处理。In this embodiment, an edge computing voice processing module 5 is added to the projector with the voice analysis function. Optionally, the edge computing voice processing module 5 can be the XForce edge AI computing platform of Horizon Company, TPU of Google, Cambrian DianNao series, Eyeriss NPU, Intel Xeon D-2100 processor and other AI chips. The edge computing voice processing module 5 can also be a GPU with edge computing function. The GPU is a graphics processor. The current GPU is no longer limited to 3D graphics processing. The development of GPU general computing technology has attracted a lot of attention in the industry. It also proves that in some calculations such as floating-point operations and parallel computing, GPUs can provide dozens or even hundreds of times the performance of CPUs. Adding chips with edge computing functions to current GPUs can quickly process big data.

边缘计算语音处理模块5可以对上述的声纹、饮食、用药等语音信息实现短期的存储,因此能够在本地即带语音分析功能的投影仪上实现对语音信息的短期计算分析,无需将语音信息传输给云端在云端进行分析。增加边缘计算语音处理模块5,能够产生以下的有益效果:1、大量的计算任务能够在数据采集端处理,无需传输到云端,这大大缓解了网络的传输压力,同时也减小了数据中心的压力;2、边缘计算分布式以及靠近设备端的特性注定它实时处理的优势,所以它能够更好的支撑本地业务实时处理与执行,任务是在边缘处理的,因此,数据在网络中传输的时间急剧减少,用户得到响应的时间会更快;3、由于投影仪提取的的用户的声纹特征是十分隐私的数据,如果将这些个人隐私数据上传到云中心去计算处理,存在一定的安全风险,在投影仪上增加边缘计算语音处理模块5可以更好的保护隐私数据。The edge computing voice processing module 5 can realize short-term storage of the above-mentioned voiceprint, diet, medication and other voice information, so it can realize the short-term calculation and analysis of the voice information on the local projector with the voice analysis function, without the need to store the voice information. Transfer to the cloud for analysis in the cloud. The addition of the edge computing voice processing module 5 can produce the following beneficial effects: 1. A large number of computing tasks can be processed at the data collection end without being transmitted to the cloud, which greatly relieves the transmission pressure of the network and also reduces the cost of data center Pressure; 2. The characteristics of distributed edge computing and its proximity to the device end doom it to its advantages in real-time processing, so it can better support real-time processing and execution of local services. The task is processed at the edge. Therefore, the time required for data transmission in the network Sharply reduced, the user will get a faster response time; 3. Since the user's voiceprint features extracted by the projector are very private data, if these personal privacy data are uploaded to the cloud center for calculation and processing, there will be certain security risks , adding an edge computing voice processing module 5 to the projector can better protect private data.

在本发明的又一实施例中,可选的,如图2所示,语音分析模块还包括语音指令控制单元605,语音指令控制单元605用于根据用户的语音指令生成指令控制信号发送给中央控制模块1,中央控制模块1根据指令控制信号控制投影仪的开关机以及投影仪的内部系统运行;语音指令控制单元605与去噪单元603、声纹检测提取单元604电连接,当声纹检测提取单元604检测到当前提取到的声纹与预存的用户声纹一致,证明当前的使用者为投影仪的用户,可以进行后续操作,语音指令控制单元605即可以根据从去噪单元603处接收到的数字语音信号中识别出的开关机或系统运行命令生成相应的指令控制信号,并将指令控制信号发送给中央控制模块1,由中央控制模块1根据指令控制信号控制投影仪开关机或者系统运行。In another embodiment of the present invention, optionally, as shown in FIG. 2 , the voice analysis module further includes a voice command control unit 605, and the voice command control unit 605 is configured to generate a command control signal according to the user's voice command and send it to the central Control module 1, the central control module 1 controls the power on and off of the projector and the operation of the internal system of the projector according to the command control signal; the voice command control unit 605 is electrically connected with the denoising unit 603 and the voiceprint detection and extraction unit 604. The extraction unit 604 detects that the currently extracted voiceprint is consistent with the pre-stored user voiceprint, which proves that the current user is a user of the projector and can perform subsequent operations. The switch or system operation command identified in the received digital voice signal generates the corresponding command control signal, and sends the command control signal to the central control module 1, and the central control module 1 controls the projector to switch on and off or the system according to the command control signal. run.

在本发明的又一实施例中,如图3所示,电路还包括远程指纹开关模块7,远程指纹开关模块7与中央控制模块1电连接或远程指纹开关模块7与中央控制模块无线连接,用户通过远程指纹开关模块7控制投影仪开机,同时,光学投影模块出现白屏。具体的,远程指纹开关模块7主要用于控制带语音分析功能的投影仪的开机,通过按压开关打开电源,同时通过按压输入用户的指纹信息,经指纹信息匹配成功后,投影仪开机;可选择的,为了使用的便利,用户可以通过语音分析模块输入开机语音指令控制投影仪开机,同时,光学投影模块出现白屏。具体的根据语音控制的原理已经再上文提到,在此不过多赘述。In another embodiment of the present invention, as shown in FIG. 3 , the circuit further includes a remote fingerprint switch module 7, which is electrically connected to the central control module 1 or wirelessly connected to the central control module, The user controls the projector to turn on through the remote fingerprint switch module 7, and at the same time, a white screen appears on the optical projection module. Specifically, the remote fingerprint switch module 7 is mainly used to control the startup of the projector with the voice analysis function, and the power is turned on by pressing the switch, and the user's fingerprint information is input by pressing at the same time. After the fingerprint information is successfully matched, the projector is turned on; Yes, for the convenience of use, the user can input the power-on voice command through the voice analysis module to control the projector to turn on, and at the same time, a white screen appears on the optical projection module. The specific principle of voice control has already been mentioned above, and will not be repeated here.

在本发明的又一实施例中,如图3所示,电路还包括散热模块8,散热模块8与中央控制模块1电连接,用于对运行的所述投影仪进行散热。具体的,投影仪在运转过程中,尤其进行大量数据传输与计算时,投影仪不可避免的由于高速运转会导致机器温度急速上升,为了更好的保护投影仪的各个部件免于烧坏以及保证投影仪的高速运转,需要设置散热模块8,对运行的投影仪或主要部件进行散热。散热模块8可以采用现有较成熟的散热板等,本发明不做具体限定。In yet another embodiment of the present invention, as shown in FIG. 3 , the circuit further includes a heat dissipation module 8 , which is electrically connected to the central control module 1 and used to dissipate heat from the projector in operation. Specifically, during the operation of the projector, especially when a large amount of data is transmitted and calculated, the projector will inevitably cause the temperature of the machine to rise rapidly due to high-speed operation. In order to better protect the various parts of the projector from burning out and ensure For the high-speed operation of the projector, a heat dissipation module 8 needs to be installed to dissipate heat from the projector or main components in operation. The heat dissipation module 8 may use a relatively mature heat dissipation plate or the like, which is not specifically limited in the present invention.

在又一实施例中,如图4所示,电源模块4包括电源控制电路401、锂电池402和外接电源适配接口403,锂电池402和外接电源适配接口403通过电源控制电路401进行电源的切换和输入。机器启动后,电源控制电路401内的各稳压芯片为投影仪内部各个模块提供所需的电源电压,并使各功能模块、各驱动电路开始正常工作,若使用外接电源,在完成上述进程的同时,会通过电源控制电路401根据锂电池402的电量确定是否执行充电操作,当不使用外接电源时,则锂电池402放电为投影仪内部的各个模块进行供电。In yet another embodiment, as shown in FIG. 4 , the power module 4 includes a power control circuit 401 , a lithium battery 402 and an external power adapter interface 403 , and the lithium battery 402 and the external power adapter interface 403 are powered by the power control circuit 401 switching and input. After the machine is started, each voltage regulator chip in the power control circuit 401 provides the required power supply voltage for each module inside the projector, and makes each functional module and each drive circuit start to work normally. At the same time, the power control circuit 401 determines whether to perform a charging operation according to the power of the lithium battery 402. When the external power supply is not used, the lithium battery 402 is discharged to supply power to each module inside the projector.

在又一实施例中,如图5所示,音频输出模块3包括音频输出接口301和内置扬声器302。内置扬声器302通过位于机壳下表面的喇叭播放声音,音频输出接口301电连接外部的音箱、耳机等设备。In yet another embodiment, as shown in FIG. 5 , the audio output module 3 includes an audio output interface 301 and a built-in speaker 302 . The built-in speaker 302 plays sound through the speaker located on the lower surface of the casing, and the audio output interface 301 is electrically connected to external speakers, earphones and other devices.

在又一实施例中,如图3所示,壳体内的电路还包括无线模块9,无线模块9与中央控制模块1电连接,可选的,无线模块9包括无线路由器、红外遥控信号接收器和蓝牙装置,投影仪可以通过无线模块9和其他的智能设备进行信息的交互,如可以和其他的健康检测设备进行信息的交互,收集这些健康检测设备测量的人体生理数据信息,并通过中央控制模块1发送给边缘计算语音处理模块5进行处理计算。无线模块9还可以将边缘计算语音处理模块计算分析的结果输出给用户的其他的智能设备,方便用户查看分析结果。In yet another embodiment, as shown in FIG. 3 , the circuit in the housing further includes a wireless module 9 , and the wireless module 9 is electrically connected to the central control module 1 . Optionally, the wireless module 9 includes a wireless router and an infrared remote control signal receiver. With the Bluetooth device, the projector can interact with other smart devices through the wireless module 9, for example, it can interact with other health detection equipment, collect the human physiological data information measured by these health detection equipment, and pass the central control. Module 1 is sent to edge computing voice processing module 5 for processing and calculation. The wireless module 9 can also output the result of calculation and analysis by the edge computing voice processing module to other smart devices of the user, so as to facilitate the user to view the analysis result.

在本发明的又一实施例中,如图3所示,电路还包括存储模块10,存储模块10与中央控制模块1、边缘计算语音分析模块5电连接。存储模块10具有大容量的存储器,可以对边缘计算语音处理模块5生成的个人健康数据进行长期存储,边缘计算语音处理模块5虽然也可以对个人健康数据进行暂时的缓存,但是由于个人健康数据量大且边缘计算语音处理模块5无法对这些数据进行长期的存储,只能存储一定时间段内的数据,从而在进行分析处理时也只能进行短期分析,而加入存储模块10后,能够实现对个人健康数据的长期监测与追踪,为边缘计算语音处理模块5进行数据的长期综合计算分析提供支持。边缘计算语音处理模块5进行分析计算的结果存入存储模块10中进行存储,减轻了边缘计算语音处理模块5的存储压力。伴随用户的使用次数、时间的增多,存储模块10存储的个人健康数据量越来越大,继而为后续的边缘计算等提供充足的数据支持。另外,本发明的投影仪的存储模块10,可以根据实际存储的个人健康数据的类型进行分类存储,例如情绪变化库、心理状态变化库、用药情况变化库、饮食情况变化库等等。In another embodiment of the present invention, as shown in FIG. 3 , the circuit further includes a storage module 10 , and the storage module 10 is electrically connected to the central control module 1 and the edge computing speech analysis module 5 . The storage module 10 has a large-capacity memory, which can store the personal health data generated by the edge computing voice processing module 5 for a long time. Although the edge computing voice processing module 5 can also temporarily cache the personal health data, due to the amount of personal health data. The edge computing voice processing module 5 cannot store these data for a long time, and can only store data within a certain period of time, so that only short-term analysis can be performed during analysis and processing. The long-term monitoring and tracking of personal health data provides support for the long-term comprehensive calculation and analysis of data by the edge computing voice processing module 5. The result of the analysis and calculation performed by the edge computing voice processing module 5 is stored in the storage module 10 for storage, which relieves the storage pressure of the edge computing voice processing module 5 . With the increase of the number of times and the time of use of the user, the amount of personal health data stored in the storage module 10 is increasing, which in turn provides sufficient data support for subsequent edge computing and the like. In addition, the storage module 10 of the projector of the present invention can be classified and stored according to the type of personal health data actually stored, such as mood change database, psychological state change database, medication situation change database, diet situation change database and so on.

进一步的,在本发明上述实施例的基础上,如图6所示,边缘计算语音处理模块5包括高效缓存单元501、神经网络加速单元502、数据可视化单元503、异常网络信息反馈单元504,其中:Further, on the basis of the above embodiments of the present invention, as shown in FIG. 6 , the edge computing voice processing module 5 includes a high-efficiency cache unit 501, a neural network acceleration unit 502, a data visualization unit 503, and an abnormal network information feedback unit 504, wherein :

神经网络加速单元502用于对语音分析模块6输送的语音信息实时进行分析处理生成个人健康数据并发送至高效缓存单元501以及存储模块10进行缓存。具体的,神经网络加速单元502首先对一定时间内接收到的语音信息:声纹、饮食信息、用药信息、生活语言信息等进行分析计算,得到用户的情绪、心理、饮食、用药情况等数据发送给数据可视化单元503进行可视化处理生成可供用户查看的文字性或图表性结论等,将生成的文字性或图表性的结论存储到存储模块10;同时神经网络加速单元502将得到的情绪、心理、饮食、用药情况等数据发送给高效缓存单元501以及存储模块10进行存储。The neural network acceleration unit 502 is configured to analyze and process the speech information delivered by the speech analysis module 6 in real time to generate personal health data and send it to the high-efficiency caching unit 501 and the storage module 10 for caching. Specifically, the neural network acceleration unit 502 first analyzes and calculates the voice information received within a certain period of time: voiceprint, diet information, medication information, life language information, etc., and obtains the user's mood, psychology, diet, medication and other data for transmission. Perform visual processing on the data visualization unit 503 to generate textual or graphical conclusions that can be viewed by the user, and store the generated textual or graphical conclusions in the storage module 10; , diet, medication and other data are sent to the high-efficiency cache unit 501 and the storage module 10 for storage.

每隔一段时间,神经网络加速单元502会提取高效缓存单元501中存储的情绪、心理、饮食、用药情况等数据再进行综合分析生成用户该段时间的情绪、心理、饮食、用药等波动情况,在提取后高效缓存单元501内存储的数据会清除,从而使高效缓存单元501能够继续存储新生成的数据。生成的情绪、心理、饮食、用药等波动情况再次发送给高效缓存单元501以及存储模块10存储。这里可将时间设置为每隔5天、10天、半个月等进行一次综合处理分析,具体的时间设置可以根据实际情况确定,本发明对此不作限定。Every once in a while, the neural network acceleration unit 502 will extract the emotions, psychology, diet, medication and other data stored in the high-efficiency cache unit 501, and then conduct a comprehensive analysis to generate the user's mood, psychology, diet, medication and other fluctuations during this period of time, After the extraction, the data stored in the high-efficiency cache unit 501 will be cleared, so that the high-efficiency cache unit 501 can continue to store the newly generated data. The generated fluctuations in mood, psychology, diet, medication, etc. are sent again to the high-efficiency cache unit 501 and the storage module 10 for storage. Here, the time can be set to perform comprehensive processing and analysis every 5 days, 10 days, half a month, etc. The specific time setting can be determined according to the actual situation, which is not limited in the present invention.

数据可视化单元503用于将神经网络加速单元502生成的个人健康数据(包括情绪、心理、饮食、用药情况等数据以及情绪、心理、饮食、用药的波动情况等)进行数据可视化处理,并传输至异常网络信息反馈单元504进行反馈以及传输至存储模块10进行存储。同时如果神经网络加速单元502有无法分析处理的语音信息也可以发送给数据可视化单元503进行可视化处理并传输至异常网络信息反馈单元504进行反馈。The data visualization unit 503 is used to visualize the personal health data generated by the neural network acceleration unit 502 (including data on emotions, psychology, diet, medication, etc., as well as fluctuations in emotions, psychology, diet, medication, etc.), and transmit it to the data visualization unit 503. The abnormal network information feedback unit 504 performs feedback and transmits it to the storage module 10 for storage. At the same time, if the neural network acceleration unit 502 has voice information that cannot be analyzed and processed, it can also be sent to the data visualization unit 503 for visualization processing and transmitted to the abnormal network information feedback unit 504 for feedback.

异常网络信息反馈单元504将通过无线模块或者通信协议把接收到的可视化的数据发给云平台转给第三方,或者通过连接的光学投影模块2显示给用户本人。本发明的投影仪凡是要传输出去供用户或者第三方查看的数据都要传输至异常网络信息反馈单元504进行反馈。The abnormal network information feedback unit 504 transmits the received visualized data to the cloud platform through the wireless module or communication protocol to a third party, or displays it to the user himself through the connected optical projection module 2 . In the projector of the present invention, any data to be transmitted for viewing by a user or a third party must be transmitted to the abnormal network information feedback unit 504 for feedback.

在本发明的有一种实施例中,如图7所示,还提供一种基于上述的带语音分析功能的投影仪的健康数据生成方法,方法包括:In an embodiment of the present invention, as shown in FIG. 7 , a method for generating health data based on the above-mentioned projector with a speech analysis function is also provided, the method comprising:

S101:投影仪通过语音开机或开关开机;S101: The projector is turned on by voice or switch;

S102:语音分析模块开始录入用户语音信息;S102: The voice analysis module starts to input user voice information;

S103:将录入的用户语音信息转换为数字语音信号并提取声纹;S103: Convert the entered user voice information into digital voice signals and extract voiceprints;

S104:声纹匹配;S104: Voiceprint matching;

具体的,判断提取到的声纹与预先存储的声纹是否匹配,若是,执行步骤S105,否则,结束;Specifically, it is judged whether the extracted voiceprint matches the pre-stored voiceprint, if so, go to step S105, otherwise, end;

S105:将数字语音信号以及声纹发送给边缘计算语音处理模块;S105: Send the digital voice signal and voiceprint to the edge computing voice processing module;

S106:进行语义识别将接收到的数字语音信号分类;S106: Perform semantic recognition to classify the received digital speech signal;

具体的,边缘计算语音处理模块对接收到的数字语音信号进行语义识别并根据语义识别结果将接收到的数字语音信号分为饮食信息、用药信息以及生活言语信息。Specifically, the edge computing voice processing module performs semantic recognition on the received digital voice signal and divides the received digital voice signal into diet information, medication information and life language information according to the semantic recognition result.

S107:对分类后的数字语音信号以及声纹信息进行分析处理生成个人健康数据。S107: Analyze and process the classified digital voice signal and voiceprint information to generate personal health data.

具体的,边缘计算语音处理模块分别对饮食信息、用药信息、生活言语信息以及声纹信息进行分析处理生成个人健康数据。使用本发明提供的健康数据生成方法,生成个人健康数据,操作简单,实用性强,生成的个人健康数据可为使用者身体健康分析提供有力的数据支持。Specifically, the edge computing voice processing module analyzes and processes dietary information, medication information, daily speech information and voiceprint information to generate personal health data. Using the health data generating method provided by the present invention to generate personal health data has the advantages of simple operation and strong practicability, and the generated personal health data can provide strong data support for the user's physical health analysis.

本发明提供的带语音分析功能的投影仪,除了具有普通的投影仪都具有的投影,播放视频、图片、音乐等功能外,通过在投影仪上增加语音分析模块以及边缘计算语音处理模块,还能够采集、提取用户的身体生理信息如声纹信息以及记录用户的日常生活信息如日常饮食、用药、生活言语信息,为用户做健康诊断时提供数据支持,用户的生理信息包括用户的声纹信息,通过对声纹信息的特征提取计算还可以得出用户的情绪、心理状况,由于人的声纹会随着人的情绪发生细微的变化,因此通过声纹即可了解人的心理、情绪状况,用户的日常生活信息包括用户的饮食,用户日常服用的药物、生活言语信息等等,通过对用户的饮食进行记录并计算,得出用户的饮食规律,在医生对用户进行健康诊断时,可以提供近期用户的饮食以及日常服用的药物的情况,使医生能够依据上述这些详细的个人数据信息对用户做出正确的健康诊断,降低误诊率。The projector with speech analysis function provided by the present invention, in addition to having the functions of projection, playing video, pictures, music, etc., which are possessed by ordinary projectors, by adding a speech analysis module and an edge computing speech processing module on the projector, also It can collect and extract the user's physical and physiological information such as voiceprint information and record the user's daily life information such as daily diet, medication, life language information, and provide data support for the user's health diagnosis. The user's physiological information includes the user's voiceprint information. , through the feature extraction and calculation of the voiceprint information, the user's mood and psychological state can also be obtained. Since a person's voiceprint will change slightly with the person's mood, it is possible to understand the person's psychological and emotional state through the voiceprint. , the user's daily life information includes the user's diet, the daily medicines the user takes, life language information, etc. By recording and calculating the user's diet, the user's diet rule is obtained. When the doctor makes a health diagnosis for the user, you can Provide the recent user's diet and daily medicines, so that doctors can make a correct health diagnosis for the user based on the above detailed personal data information, and reduce the misdiagnosis rate.

以上借助具体实施例对本发明做了进一步描述,但是应该理解的是,这里具体的描述,不应理解为对本发明的实质和范围的限定,本领域内的普通技术人员在阅读本说明书后对上述实施例做出的各种修改,都属于本发明所保护的范围。The present invention has been further described above with the help of specific embodiments, but it should be understood that the specific description herein should not be construed as a limitation on the spirit and scope of the present invention. Various modifications made in the embodiments all belong to the protection scope of the present invention.

Claims (7)

1.一种带语音分析功能的投影仪,其特征在于,所述投影仪包括:壳体以及设置在所述壳体内部的电路,所述电路包括中央控制模块、光学投影模块、音频输出模块、电源模块、存储模块、无线模块、边缘计算语音处理模块以及语音分析模块;所述中央控制模块分别与所述光学投影模块、所述音频输出模块、所述电源模块、所述无线模块、所述边缘计算语音处理模块、所述语音分析模块电连接;所述存储模块分别与所述中央控制模块、所述边缘计算语音处理模块电连接;1. A projector with a voice analysis function, wherein the projector comprises: a casing and a circuit arranged inside the casing, the circuit comprising a central control module, an optical projection module, and an audio output module , power module, storage module, wireless module, edge computing voice processing module and voice analysis module; the central control module is respectively connected with the optical projection module, the audio output module, the power module, the wireless module, the the edge computing voice processing module and the voice analysis module are electrically connected; the storage module is respectively electrically connected with the central control module and the edge computing voice processing module; 所述语音分析模块包括依次电连接的录音单元、A/D转换单元、去噪单元、声纹检测提取单元;所述录音单元用于录入用户的语音信息并将所述语音信息发送给所述A/D转换单元转换为数字语音信号,所述去噪单元将所述数字语音信号进行去噪处理后传输给所述声纹检测提取单元;The voice analysis module includes a recording unit, an A/D conversion unit, a denoising unit, and a voiceprint detection and extraction unit that are electrically connected in sequence; the recording unit is used to record the user's voice information and send the voice information to the The A/D conversion unit converts the digital voice signal into a digital voice signal, and the denoising unit denoises the digital voice signal and transmits it to the voiceprint detection and extraction unit; 所述声纹检测提取单元接收所述数字语音信号并提取声纹后将所述声纹与预先存储的用户声纹进行比对,若比对成功,检测所述声纹所属用户,并将所述声纹、所述声纹所属用户的用户身份信息以及所述数字语音信号发送给所述边缘计算语音处理模块;The voiceprint detection and extraction unit receives the digital voice signal and extracts the voiceprint, and compares the voiceprint with the pre-stored user voiceprint. The voiceprint, the user identity information of the user to which the voiceprint belongs, and the digital voice signal are sent to the edge computing voice processing module; 所述边缘计算语音处理模块包括高效缓存单元、神经网络加速单元、数据可视化单元以及异常网络信息反馈单元,所述神经网络加速单元用于对语音分析模块输送的语音信息进行分析处理生成个人健康数据并发送至高效缓存单元以及存储模块进行缓存;神经网络加速单元接收到的所述语音信息至少包括:声纹、饮食信息、用药信息及生活语音信息;The edge computing voice processing module includes a high-efficiency cache unit, a neural network acceleration unit, a data visualization unit, and an abnormal network information feedback unit, and the neural network acceleration unit is used to analyze and process the voice information transmitted by the voice analysis module to generate personal health data. And send it to the high-efficiency cache unit and the storage module for caching; the voice information received by the neural network acceleration unit at least includes: voiceprint, diet information, medication information and life voice information; 所述数据可视化单元用于将所述神经网络加速单元生成的个人健康数据进行数据可视化处理,并传输至异常网络信息反馈单元进行反馈以及传输至所述存储模块进行存储;同时,神经网络加速单元将无法分析处理的语音信息,发送给数据可视化单元进行可视化处理并传输至异常网络信息反馈单元进行反馈,所述异常网络信息反馈单元通过无线模块把接收到的可视化的数据发给云平台转给第三方。The data visualization unit is used to perform data visualization processing on the personal health data generated by the neural network acceleration unit, and transmit it to the abnormal network information feedback unit for feedback and to the storage module for storage; at the same time, the neural network acceleration unit Send the voice information that cannot be analyzed and processed to the data visualization unit for visualization processing and transmit it to the abnormal network information feedback unit for feedback, and the abnormal network information feedback unit sends the received visualized data to the cloud platform through the wireless module. third parties. 2.如权利要求1所述的带语音分析功能的投影仪,其特征在于,所述语音分析模块还包括语音指令控制单元,所述语音指令控制单元用于根据用户的语音指令生成指令控制信号发送给所述中央控制模块,所述中央控制模块根据所述指令控制信号控制所述投影仪的开关机以及所述投影仪的内部系统运行;2. The projector with a voice analysis function according to claim 1, wherein the voice analysis module further comprises a voice command control unit, and the voice command control unit is used to generate a command control signal according to a user's voice command Send it to the central control module, and the central control module controls the on-off of the projector and the operation of the internal system of the projector according to the instruction control signal; 所述语音指令控制单元与所述去噪单元、所述声纹检测提取单元电连接。The voice command control unit is electrically connected with the denoising unit and the voiceprint detection and extraction unit. 3.如权利要求1所述的带语音分析功能的投影仪,其特征在于,所述电路还包括远程指纹开关模块,所述远程指纹开关模块与所述中央控制模块电连接或所述远程指纹开关模块与所述中央控制模块无线连接,用户通过所述远程指纹开关模块控制所述投影仪开机,同时,所述光学投影模块出现白屏。3. The projector with speech analysis function according to claim 1, wherein the circuit further comprises a remote fingerprint switch module, the remote fingerprint switch module is electrically connected with the central control module or the remote fingerprint switch The switch module is wirelessly connected with the central control module, the user controls the projector to start up through the remote fingerprint switch module, and at the same time, a white screen appears on the optical projection module. 4.如权利要求1所述的带语音分析功能的投影仪,其特征在于,所述电路还包括散热模块,所述散热模块与所述中央控制模块电连接,用于对运行的所述投影仪进行散热。4 . The projector with speech analysis function according to claim 1 , wherein the circuit further comprises a heat dissipation module, the heat dissipation module is electrically connected to the central control module, and is used for the operation of the projector. 5 . instrument to dissipate heat. 5.如权利要求1所述的带语音分析功能的投影仪,其特征在于,所述电源模块包括电源控制电路、锂电池和外接电源适配接口,所述锂电池和外接电源适配接口通过电源控制电路进行电源的切换和输入。5. The projector with speech analysis function according to claim 1, wherein the power supply module comprises a power supply control circuit, a lithium battery and an external power supply adapter interface, and the lithium battery and the external power supply adapter interface pass through. The power control circuit performs switching and input of power. 6.如权利要求1所述的带语音分析功能的投影仪,其特征在于,所述音频输出模块包括内置扬声器和音频输出接口。6. The projector with speech analysis function according to claim 1, wherein the audio output module comprises a built-in speaker and an audio output interface. 7.一种基于权利要求1-6中任一项所述的带语音分析功能的投影仪的个人健康数据生成方法,其特征在于,所述方法包括:7. A method for generating personal health data based on the projector with speech analysis function according to any one of claims 1-6, wherein the method comprises: S101:投影仪通过语音开机或开关开机;S101: The projector is turned on by voice or switch; S102:语音分析模块开始录入用户语音信息;S102: The voice analysis module starts to input user voice information; S103:将步骤S102 中录入的用户语音信息转换为数字语音信号并提取声纹;S103: Convert the user voice information entered in step S102 into a digital voice signal and extract voiceprints; S104:判断提取到的声纹与预先存储的声纹是否匹配,若是,执行步骤S105,否则,结束;S104: determine whether the extracted voiceprint matches the pre-stored voiceprint, if so, perform step S105, otherwise, end; S105:将数字语音信号以及声纹发送给边缘计算语音处理模块;S105: Send the digital voice signal and voiceprint to the edge computing voice processing module; S106:边缘计算语音处理模块对接收到的数字语音信号进行语义识别并根据语义识别结果将接收到的数字语音信号分为饮食信息、用药信息以及生活言语信息;S106: The edge computing voice processing module performs semantic recognition on the received digital voice signal and divides the received digital voice signal into diet information, medication information and life language information according to the semantic recognition result; S107:边缘计算语音处理模块分别对饮食信息、用药信息、生活言语信息以及声纹信息进行分析处理生成个人健康数据。S107: The edge computing voice processing module analyzes and processes the diet information, medication information, life language information and voiceprint information respectively to generate personal health data.
CN201910979936.6A 2019-10-15 2019-10-15 Projector with speech analysis function and method for generating personal health data Active CN112672120B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910979936.6A CN112672120B (en) 2019-10-15 2019-10-15 Projector with speech analysis function and method for generating personal health data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910979936.6A CN112672120B (en) 2019-10-15 2019-10-15 Projector with speech analysis function and method for generating personal health data

Publications (2)

Publication Number Publication Date
CN112672120A CN112672120A (en) 2021-04-16
CN112672120B true CN112672120B (en) 2022-09-09

Family

ID=75400350

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910979936.6A Active CN112672120B (en) 2019-10-15 2019-10-15 Projector with speech analysis function and method for generating personal health data

Country Status (1)

Country Link
CN (1) CN112672120B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113486306B (en) * 2021-06-28 2024-03-12 深圳市拔超科技股份有限公司 High-definition audio/video matrix control system and method
CN113407922B (en) * 2021-07-14 2022-06-03 上海万向区块链股份公司 Intelligent intention recognition and analysis system and method based on block chain technology

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204945603U (en) * 2015-09-18 2016-01-06 深圳市祈锦通信技术有限公司 A kind of fingerprint recognition projector
CN105596016A (en) * 2015-12-23 2016-05-25 王嘉宇 Human body psychological and physical health monitoring and managing device and method
CN107635147A (en) * 2017-09-30 2018-01-26 上海交通大学 Health information management TV based on multi-modal human-computer interaction
CN108111538A (en) * 2018-01-25 2018-06-01 芜湖应天光电科技有限责任公司 Smart projector speech control system and its method based on sound groove recognition technology in e
CN109584896A (en) * 2018-11-01 2019-04-05 苏州奇梦者网络科技有限公司 A kind of speech chip and electronic equipment
CN109830271A (en) * 2019-01-15 2019-05-31 安徽理工大学 A kind of health data management system and analysis method based on edge calculations and cloud computing
CN109859843A (en) * 2018-10-23 2019-06-07 苏州鱼跃医疗科技有限公司 Smart health all-in-one machine
CN109920544A (en) * 2019-01-28 2019-06-21 浙江工业大学 Real-time adaptive intelligent building system based on somatosensory information

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204945603U (en) * 2015-09-18 2016-01-06 深圳市祈锦通信技术有限公司 A kind of fingerprint recognition projector
CN105596016A (en) * 2015-12-23 2016-05-25 王嘉宇 Human body psychological and physical health monitoring and managing device and method
CN107635147A (en) * 2017-09-30 2018-01-26 上海交通大学 Health information management TV based on multi-modal human-computer interaction
CN108111538A (en) * 2018-01-25 2018-06-01 芜湖应天光电科技有限责任公司 Smart projector speech control system and its method based on sound groove recognition technology in e
CN109859843A (en) * 2018-10-23 2019-06-07 苏州鱼跃医疗科技有限公司 Smart health all-in-one machine
CN109584896A (en) * 2018-11-01 2019-04-05 苏州奇梦者网络科技有限公司 A kind of speech chip and electronic equipment
CN109830271A (en) * 2019-01-15 2019-05-31 安徽理工大学 A kind of health data management system and analysis method based on edge calculations and cloud computing
CN109920544A (en) * 2019-01-28 2019-06-21 浙江工业大学 Real-time adaptive intelligent building system based on somatosensory information

Also Published As

Publication number Publication date
CN112672120A (en) 2021-04-16

Similar Documents

Publication Publication Date Title
US12505190B2 (en) Providing private answers to non-vocal questions
US12154572B2 (en) Identifying silent speech using recorded speech
CN103561652B (en) Method and system for assisting patients
CN110367934B (en) Health monitoring method and system based on non-voice body sounds
US20250173415A1 (en) Using facial movements to generate a conversational record
TWI222622B (en) Robotic vision-audition system
CN112672120B (en) Projector with speech analysis function and method for generating personal health data
US20190267002A1 (en) Intelligent system for creating and editing work instructions
US20220101873A1 (en) Techniques for providing feedback on the veracity of spoken statements
TW202223804A (en) Electronic resource pushing method and system
CN108670275A (en) Signal processing method and related product
TW201826167A (en) Method for face expression feedback and intelligent robot
CN112669963B (en) Intelligent health machine, health data generation method and health data management system
KR20200144821A (en) Smart mirror
US11657814B2 (en) Techniques for dynamic auditory phrase completion
CN112672119B (en) An intelligent projector with a camera function and a method for generating personal health data
US20260037555A1 (en) Conversation-based assistance using a display free body wearable computing device
JP2026047937A (en) system
JP2026062198A (en) system
JP2026064798A (en) system
TW202613980A (en) A facial monitoring system
CN120541788A (en) A multimodal fusion dynamic weighted recognition method and system based on facial emotion recognition and speech recognition
JP2026017991A (en) system
JP2026018048A (en) system
JP2026064781A (en) system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20241215

Address after: 518054 Building A, Phase II, Sunshine Science and Technology Innovation Center, Nanxin Road, Nanshan Community, Nanshan Street, Nanshan District, Shenzhen City, Guangdong Province 1301-17

Patentee after: Shenzhen aiwo Health Network Service Co.,Ltd.

Country or region after: China

Address before: 100176 building 17, yard 2, Tianhua North Street, Yizhuang, Daxing District, Beijing

Patentee before: Xu Guilin

Country or region before: China

TR01 Transfer of patent right