CN112672120B - Projector with speech analysis function and method for generating personal health data - Google Patents
Projector with speech analysis function and method for generating personal health data Download PDFInfo
- Publication number
- CN112672120B CN112672120B CN201910979936.6A CN201910979936A CN112672120B CN 112672120 B CN112672120 B CN 112672120B CN 201910979936 A CN201910979936 A CN 201910979936A CN 112672120 B CN112672120 B CN 112672120B
- Authority
- CN
- China
- Prior art keywords
- module
- voice
- unit
- information
- projector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 75
- 230000036541 health Effects 0.000 title claims abstract description 44
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 67
- 238000000605 extraction Methods 0.000 claims abstract description 30
- 238000001514 detection method Methods 0.000 claims abstract description 29
- 230000003287 optical effect Effects 0.000 claims abstract description 14
- 238000006243 chemical reaction Methods 0.000 claims abstract description 11
- 235000005911 diet Nutrition 0.000 claims description 30
- 230000037213 diet Effects 0.000 claims description 28
- 239000003814 drug Substances 0.000 claims description 28
- 229940079593 drug Drugs 0.000 claims description 27
- 230000006870 function Effects 0.000 claims description 23
- 230000001133 acceleration Effects 0.000 claims description 16
- 238000013528 artificial neural network Methods 0.000 claims description 16
- 238000013079 data visualisation Methods 0.000 claims description 12
- 230000002159 abnormal effect Effects 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 11
- 239000000284 extract Substances 0.000 claims description 10
- 230000017525 heat dissipation Effects 0.000 claims description 9
- 229910052744 lithium Inorganic materials 0.000 claims description 9
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 claims description 8
- 238000012800 visualization Methods 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 abstract description 16
- 238000003745 diagnosis Methods 0.000 abstract description 8
- 230000002996 emotional effect Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000036651 mood Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 230000008451 emotion Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 230000000378 dietary effect Effects 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 206010027940 Mood altered Diseases 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 150000002632 lipids Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000007510 mood change Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
技术领域technical field
本发明涉及投影仪技术领域,尤其涉及一种带语音分析功能的投影仪及个人健康数据生成方法。The invention relates to the technical field of projectors, in particular to a projector with a speech analysis function and a method for generating personal health data.
背景技术Background technique
投影仪,是一种可以将图像或视频投射到幕布上的设备,投影仪目前广泛应用于家庭、多媒体会议、学校和娱乐场所;目前的的投影仪功能单一,无法收集用户的日常生活信息及其他身体生理、心理信息,为用户的健康诊断提供数据支持。A projector is a device that can project images or videos onto a screen. Projectors are currently widely used in homes, multimedia conferences, schools, and entertainment venues. The current projectors have a single function and cannot collect information about users' daily life. Other physical and psychological information provides data support for the user's health diagnosis.
现有技术中有单独的人体健康检测机,如专利号为CN109859843A的专利只能检测用户的生理数据如血糖、血脂等数据,不涉及到心理情绪变化的收集分析,也不会收集用户日常饮食、药物等数据辅助健康诊断。事实上如果医生对病人进行诊断时,不结合病人长期的心理、情绪状态、日常饮食、药物等情况则容易发生误诊。There are separate human health detectors in the prior art. For example, the patent with the patent number of CN109859843A can only detect the user's physiological data such as blood sugar, blood lipid and other data, and does not involve the collection and analysis of psychological and emotional changes, nor does it collect the user's daily diet. , drugs and other data to assist health diagnosis. In fact, if a doctor diagnoses a patient without considering the patient's long-term psychology, emotional state, daily diet, and drugs, misdiagnosis is likely to occur.
发明内容SUMMARY OF THE INVENTION
本发明的一个目的在于提供一种带语音分析功能的投影仪,可实现语音信息以及声纹的采集及处理,为用户身体健康分析提供数据支持;另一个目的在于提供一种基于上述带语音分析功能的投影仪的个人健康数据生成方法。One object of the present invention is to provide a projector with a voice analysis function, which can realize the collection and processing of voice information and voiceprints, and provide data support for the user's physical health analysis; another object is to provide a voice analysis based on the above. A method of generating personal health data for a functional projector.
为实现上述目的,本发明提供一种带语音分析功能的投影仪,包括:壳体以及设置在壳体内部的电路,电路包括中央控制模块、光学投影模块、音频输出模块、电源模块、语音分析模块、边缘计算语音处理模块;中央控制模块分别与光学投影模块、音频输出模块、电源模块、语音分析模块、边缘计算语音处理模块电连接;语音分析模块包括依次电连接的录音单元、A/D转换单元、去噪单元、声纹检测提取单元,录音单元用于录入用户的语音信息并将语音信息发送给A/D转换单元转换为数字语音信号,去噪单元将数字语音信号进行去噪处理后传输给声纹检测提取单元;声纹检测提取单元接收数字语音信号并提取声纹后将声纹与预先存储的用户声纹进行比对,若比对成功,将声纹以及数字语音信号发送给边缘计算语音处理模块;边缘计算语音处理模块用于对接收到的声纹以及数字语音信号进行分析处理生成个人健康数据。In order to achieve the above purpose, the present invention provides a projector with a voice analysis function, comprising: a casing and a circuit arranged inside the casing, the circuit includes a central control module, an optical projection module, an audio output module, a power supply module, and a voice analysis module. module, edge computing voice processing module; the central control module is respectively electrically connected with the optical projection module, audio output module, power supply module, voice analysis module, and edge computing voice processing module; the voice analysis module includes a recording unit, A/D The conversion unit, the denoising unit, the voiceprint detection and extraction unit, the recording unit is used to input the user's voice information and send the voice information to the A/D conversion unit to convert it into a digital voice signal, and the denoising unit denoises the digital voice signal. Then, it is transmitted to the voiceprint detection and extraction unit; the voiceprint detection and extraction unit receives the digital voice signal and extracts the voiceprint, and compares the voiceprint with the pre-stored user voiceprint. If the comparison is successful, the voiceprint and the digital voice signal are sent. To the edge computing voice processing module; the edge computing voice processing module is used to analyze and process the received voiceprint and digital voice signals to generate personal health data.
进一步的,语音分析模块还包括语音指令控制单元,语音指令控制单元用于根据用户的语音指令生成指令控制信号发送给中央控制模块,中央控制模块根据指令控制信号控制投影仪的开关机以及投影仪的内部系统运行;语音指令控制单元与去噪单元、声纹检测提取单元电连接。Further, the voice analysis module also includes a voice command control unit, and the voice command control unit is used to generate a command control signal according to the user's voice command and send it to the central control module, and the central control module controls the on-off of the projector and the projector according to the command control signal. The internal system operates; the voice command control unit is electrically connected with the denoising unit and the voiceprint detection and extraction unit.
进一步的,电路还包括远程指纹开关模块,远程指纹开关模块与中央控制模块电连接或远程指纹开关模块与中央控制模块无线连接,用户通过远程指纹开关模块控制所述投影仪开机,同时,光学投影模块出现白屏;或者,用户通过语音分析模块输入开机语音指令控制投影仪开机,同时,光学投影模块出现白屏。Further, the circuit also includes a remote fingerprint switch module, the remote fingerprint switch module is electrically connected to the central control module or the remote fingerprint switch module is wirelessly connected to the central control module, the user controls the projector to turn on through the remote fingerprint switch module, and at the same time, the optical projection A white screen appears on the module; or, the user controls the projector to turn on by inputting a power-on voice command through the voice analysis module, and at the same time, a white screen appears on the optical projection module.
进一步的,电路还包括散热模块,散热模块与中央控制模块电连接,用于对运行的投影仪进行散热。Further, the circuit further includes a heat dissipation module, and the heat dissipation module is electrically connected with the central control module, and is used for heat dissipation of the running projector.
进一步的,电源模块包括电源控制电路、锂电池和外接电源适配接口,锂电池和外接电源适配接口通过电源控制电路进行电源的切换和输入。Further, the power module includes a power control circuit, a lithium battery and an external power adapter interface, and the lithium battery and the external power adapter interface perform power switching and input through the power control circuit.
进一步的,音频输出模块包括内置扬声器和音频输出接口。Further, the audio output module includes a built-in speaker and an audio output interface.
进一步的,电路还包括无线模块,无线模块与中央控制模块电连接。Further, the circuit further includes a wireless module, and the wireless module is electrically connected with the central control module.
进一步的,电路还包括存储模块,存储模块与中央控制模块、边缘计算语音分析模块电连接。Further, the circuit further includes a storage module, and the storage module is electrically connected with the central control module and the edge computing voice analysis module.
进一步的,边缘计算语音分析模块包括高效缓存单元、神经网络加速单元、数据可视化单元、异常网络信息反馈单元,其中:神经网络加速单元用于对语音分析模块传输的数字语音信号以及声纹进行分析处理生成个人健康数据并发送至高效缓存单元进行缓存;数据可视化单元用于将神经网络加速单元生成的个人健康数据以及神经网络加速单元无法处理的数字语音信号、声纹进行数据可视化处理传输至异常网络信息反馈单元进行反馈。Further, the edge computing voice analysis module includes a high-efficiency cache unit, a neural network acceleration unit, a data visualization unit, and an abnormal network information feedback unit, wherein: the neural network acceleration unit is used to analyze the digital voice signal and voiceprint transmitted by the voice analysis module. Process and generate personal health data and send it to the high-efficiency cache unit for caching; the data visualization unit is used to visualize the personal health data generated by the neural network acceleration unit and the digital voice signals and voiceprints that cannot be processed by the neural network acceleration unit. The network information feedback unit performs feedback.
本发明还提供了一种基于上述的带语音分析功能的投影仪的健康数据生成方法,方法包括:The present invention also provides a method for generating health data based on the above-mentioned projector with a speech analysis function, the method comprising:
S101:投影仪通过语音开机或开关开机;S101: The projector is turned on by voice or switch;
S102:语音分析模块开始录入用户语音信息;S102: The voice analysis module starts to input user voice information;
S103:将步骤S103中录入的用户语音信息转换为数字语音信号并提取声纹;S103: Convert the user voice information entered in step S103 into a digital voice signal and extract voiceprints;
S104:判断提取到的声纹与预先存储的声纹是否匹配,若是,执行步骤S105,否则,结束;S104: determine whether the extracted voiceprint matches the pre-stored voiceprint, if so, perform step S105, otherwise, end;
S105:将数字语音信号以及声纹发送给边缘计算语音处理模块;S105: Send the digital voice signal and voiceprint to the edge computing voice processing module;
S106:边缘计算语音处理模块对接收到的数字语音信号进行语义识别并根据语义识别结果将接收到的数字语音信号分为饮食信息、用药信息、情绪信息以及生活言语信息;S106: The edge computing voice processing module performs semantic recognition on the received digital voice signal and divides the received digital voice signal into diet information, medication information, emotional information and life language information according to the semantic recognition result;
S107:边缘计算语音处理模块分别对饮食信息、用药信息、情绪信息、生活言语信息以及声纹信息进行分析处理生成个人健康数据。S107: The edge computing voice processing module analyzes and processes the dietary information, medication information, emotional information, life speech information and voiceprint information respectively to generate personal health data.
本发明具有以下有益效果:The present invention has the following beneficial effects:
1、本发明提供的带语音分析功能的投影仪增加了语音分析模块、边缘计算语音处理模块,能够通过语音分析模块采集用户的饮食信息、用药信息、情绪信息以及生活言语信息,并提取声纹特征,并对这些数据进行边缘计算,分析得出用户的情绪及心理变化以及日常饮食、用药情况,为之后的用户健康诊断提供数据支持,降低医生误诊率。1. The projector with the speech analysis function provided by the present invention adds a speech analysis module and an edge computing speech processing module, which can collect the user's diet information, medication information, emotional information and life language information through the speech analysis module, and extract the voiceprint. Features, and perform edge computing on these data to analyze the user's emotional and psychological changes, as well as daily diet and medication conditions, provide data support for subsequent user health diagnosis, and reduce the rate of misdiagnosis by doctors.
2、本发明中的语音分析模块具有语音控制功能,能识别出用户指令,从而实现对投影仪的语音控制。2. The voice analysis module in the present invention has a voice control function, which can recognize user commands, thereby realizing voice control of the projector.
附图说明Description of drawings
图1为本发明一种实施例的投影仪内部电路结构示意图;1 is a schematic diagram of the internal circuit structure of a projector according to an embodiment of the present invention;
图2为本发明一种实施例的语音分析模块电路结构示意图;2 is a schematic diagram of a circuit structure of a speech analysis module according to an embodiment of the present invention;
图3为本发明又一种实施例的投影仪内部电路结构示意图;3 is a schematic diagram of an internal circuit structure of a projector according to another embodiment of the present invention;
图4为本发明一种实施例的电源模块电路结构示意图;FIG. 4 is a schematic structural diagram of a power module circuit according to an embodiment of the present invention;
图5为本发明一种实施例的音频输出模块电路结构示意图;5 is a schematic structural diagram of an audio output module circuit according to an embodiment of the present invention;
图6为本发明一种实施例的边缘计算语音处理模块电路结构示意图;6 is a schematic diagram of a circuit structure of an edge computing voice processing module according to an embodiment of the present invention;
图7为本发明一种实施例的个人健康数据生成方法流程图;7 is a flowchart of a method for generating personal health data according to an embodiment of the present invention;
1-中央控制模块、2-光学投影模块、3-音频输出模块、4-电源模块、5-边缘计算语音处理模块、6-语音分析模块、7-远程指纹开关模块、8-散热模块、9-无线模块、10-存储模块、301-音频输出接口、302-内置扬声器、401-电源控制电路、402-锂电池、403-外接电源适配接口、501-高效缓存单元、502-神经网络加速单元、503-数据可视化单元、504-异常网络信息反馈单元、601-录音单元、602-A/D转换单元、603-去噪单元、604-声纹检测提取单元、605-语音指令控制单元。1-central control module, 2-optical projection module, 3-audio output module, 4-power supply module, 5-edge computing voice processing module, 6-voice analysis module, 7-remote fingerprint switch module, 8-cooling module, 9 -Wireless module, 10-storage module, 301-audio output interface, 302-built-in speaker, 401-power control circuit, 402-lithium battery, 403-external power adapter interface, 501-high-efficiency buffer unit, 502-neural network acceleration Units, 503 - data visualization unit, 504 - abnormal network information feedback unit, 601 - recording unit, 602 - A/D conversion unit, 603 - denoising unit, 604 - voiceprint detection and extraction unit, 605 - voice command control unit.
具体实施方式Detailed ways
下面将结合本发明中的附图,对本发明实施例中的技术方案进行清楚、完整的描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通的技术人员在没有做出创造性劳动的前提下所获得的所有其它实施例,都属于本发明的保护范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present invention.
本发明提供一种带语音分析功能的投影仪,包括壳体以及设置在壳体内部的电路,在本发明提供的一实施例的内部电路结构示意图如图1所示,壳体内部的电路结构包括中央控制模块1、光学投影模块2、音频输出模块3、电源模块4、边缘计算语音处理模块5以及语音分析模块6。中央控制模块1分别与光学投影模块2、音频输出模块3、电源模块4、边缘计算语音处理模块5、语音分析模块6电连接,控制各个模块正常运转,例如控制投影仪的开关机、开关操作系统,主要承担系统控制、数据中转等。而语音信息的分析处理则主要由边缘计算语音分析模块5完成。电源模块4分别与中央控制模块1、光学投影模块2、音频输出模块3、语音分析模块6以及边缘计算语音处理模块5电连接,为各个模块供电,保证各个模块的正常工作。The present invention provides a projector with a speech analysis function, which includes a casing and a circuit arranged inside the casing. The schematic diagram of the internal circuit structure of an embodiment provided by the present invention is shown in FIG. 1 . The circuit structure inside the casing is shown in FIG. 1 . It includes a
具体的,如图2所示,语音分析模块6包括录音单元601、A/D转换单元602、去噪单元603、声纹检测提取单元604。Specifically, as shown in FIG. 2 , the
录音单元601用于采集用户语音,录音单元601与A/D转换单元602电连接,可选的,录音单元601可以为麦克风及市售的录音芯片,如型号为WTR050、WT2000的语音芯片等等,用于采集或录制使用者的语音信息,用户录制口述的个人日常饮食、服用药物等情况、日常生活中的言语信息等,采集到用户的语音信息之后输出给A/D转换单元602。A/D转换单元602为模数转换器,可选的,可以使用双八位高速ADC转换器MXT2002,将语音模拟信号转换为投影仪后续能够处理的数字语音信号,A/D转换单元602与去噪单元603电连接,将转换后的数字语音信号输出给去噪单元603进行去噪处理,去噪完成之后再将去噪之后的数字语音信号分别传输给声纹检测提取单元604。经过去噪单元603进行去噪后可以有效的消除数字语音信号中的杂音,得到更加精确的数字语音信号,方便之后的声纹检测提取单元604进行声纹检测提取以及边缘计算语音处理模块5进行分析计算,降低声纹检测提取以及分析计算的难度,提高声纹检测提取、分析计算的准确率并且保证录音的音效。可选的,去噪单元603可以为市售的滤波器。The
声纹检测提取单元604与边缘计算语音处理模块5电连接,对输入的数字信号进行声纹、声波检测,提取声纹特征,与预先存储在声纹检测提取单元604中的投影仪用户的声纹进行对比。可选的,声纹检测提取单元604也可采用市售的声纹识别芯片,如SpeakIn的声纹识别芯片。声纹检测提取单元604中已经预先存储了用户的声纹,当声纹检测提取单元604检测到声纹时,将当前的声纹与预先存储的声纹进行比较,从而判断当前用户是否为投影仪的用户,若当前用户的声纹与预先设置的用户的声纹匹配成功,则声纹检测提取单元604将提取的声纹特征以及接收到的数字语音信号一并发送给边缘计算语音处理模块5进行处理计算。The voiceprint detection and
可选的,在本发明提供的投影仪中的声纹检测提取单元604可以预先存储多个用户信息,包括声纹信息,边缘计算语音处理模块5中也可以建立多个用户独立的个人信息数据库用于临时缓存个人数据。当预先存储的投影仪的用户信息为多个时,在声纹检测提取单元604进行检测提取时还要检测该声纹特征属于哪一位用户,并将该用户身份信息随声纹以及数字语音信号一起发送给边缘计算语音处理模块5,边缘计算语音处理模块5从而能够得知目前分析计算的声纹以及数字语音信号等语音信息是具体哪一个用户的语音信息,从而将语音信息以及分析计算的结果存储在该用户的个人信息数据库中。Optionally, the voiceprint detection and
边缘计算语音处理模块5可以提取语速、语频信息,同时识别语义,分析用户的措辞、进行声纹特征变化分析等,由于人的情绪会对声纹、语速、语频等产生一定影响,在用户生气、开心时发出的声音的声纹、语速、语频是存在区别的,边缘计算语音处理模块5可以通过上述分析从而确定当前用户的情绪、心理状态,在一定时间段内进行综合分析,还可以分析出用户当前的情绪、心理状态波动情况。并且边缘计算语音处理模块5能够识别语义,因此能够分析出用户的饮食信息、用药信息并将这些信息转换为文字进行分析计算得到用户的饮食状况、用药状况。边缘计算语音处理模块5进行分析计算得到的情绪、心理、饮食、用药信息等信息可以作为个人健康数据,为医生进行健康诊断时提供健康数据支持,降低医生的误诊率。The edge computing
在本实施例中,带语音分析功能的投影仪增加了边缘计算语音处理模块5,可选的,边缘计算语音处理模块5可以为地平线公司的XForce边缘AI计算平台,Google的TPU、寒武纪的DianNao系列、Eyeriss的NPU、英特尔至强D-2100处理器等AI芯片。边缘计算语音处理模块5也可以为带有边缘计算功能的GPU,GPU为图形处理器,目前的GPU已经不再局限于3D图形处理了,GPU通用计算技术发展已经引起业界不少的关注,事实也证明在浮点运算、并行计算等部分计算方面,GPU可以提供数十倍乃至于上百倍于CPU的性能,在目前的GPU中加入具有边缘计算功能的芯片能够快速实现对大数据的处理。In this embodiment, an edge computing
边缘计算语音处理模块5可以对上述的声纹、饮食、用药等语音信息实现短期的存储,因此能够在本地即带语音分析功能的投影仪上实现对语音信息的短期计算分析,无需将语音信息传输给云端在云端进行分析。增加边缘计算语音处理模块5,能够产生以下的有益效果:1、大量的计算任务能够在数据采集端处理,无需传输到云端,这大大缓解了网络的传输压力,同时也减小了数据中心的压力;2、边缘计算分布式以及靠近设备端的特性注定它实时处理的优势,所以它能够更好的支撑本地业务实时处理与执行,任务是在边缘处理的,因此,数据在网络中传输的时间急剧减少,用户得到响应的时间会更快;3、由于投影仪提取的的用户的声纹特征是十分隐私的数据,如果将这些个人隐私数据上传到云中心去计算处理,存在一定的安全风险,在投影仪上增加边缘计算语音处理模块5可以更好的保护隐私数据。The edge computing
在本发明的又一实施例中,可选的,如图2所示,语音分析模块还包括语音指令控制单元605,语音指令控制单元605用于根据用户的语音指令生成指令控制信号发送给中央控制模块1,中央控制模块1根据指令控制信号控制投影仪的开关机以及投影仪的内部系统运行;语音指令控制单元605与去噪单元603、声纹检测提取单元604电连接,当声纹检测提取单元604检测到当前提取到的声纹与预存的用户声纹一致,证明当前的使用者为投影仪的用户,可以进行后续操作,语音指令控制单元605即可以根据从去噪单元603处接收到的数字语音信号中识别出的开关机或系统运行命令生成相应的指令控制信号,并将指令控制信号发送给中央控制模块1,由中央控制模块1根据指令控制信号控制投影仪开关机或者系统运行。In another embodiment of the present invention, optionally, as shown in FIG. 2 , the voice analysis module further includes a voice
在本发明的又一实施例中,如图3所示,电路还包括远程指纹开关模块7,远程指纹开关模块7与中央控制模块1电连接或远程指纹开关模块7与中央控制模块无线连接,用户通过远程指纹开关模块7控制投影仪开机,同时,光学投影模块出现白屏。具体的,远程指纹开关模块7主要用于控制带语音分析功能的投影仪的开机,通过按压开关打开电源,同时通过按压输入用户的指纹信息,经指纹信息匹配成功后,投影仪开机;可选择的,为了使用的便利,用户可以通过语音分析模块输入开机语音指令控制投影仪开机,同时,光学投影模块出现白屏。具体的根据语音控制的原理已经再上文提到,在此不过多赘述。In another embodiment of the present invention, as shown in FIG. 3 , the circuit further includes a remote fingerprint switch module 7, which is electrically connected to the
在本发明的又一实施例中,如图3所示,电路还包括散热模块8,散热模块8与中央控制模块1电连接,用于对运行的所述投影仪进行散热。具体的,投影仪在运转过程中,尤其进行大量数据传输与计算时,投影仪不可避免的由于高速运转会导致机器温度急速上升,为了更好的保护投影仪的各个部件免于烧坏以及保证投影仪的高速运转,需要设置散热模块8,对运行的投影仪或主要部件进行散热。散热模块8可以采用现有较成熟的散热板等,本发明不做具体限定。In yet another embodiment of the present invention, as shown in FIG. 3 , the circuit further includes a
在又一实施例中,如图4所示,电源模块4包括电源控制电路401、锂电池402和外接电源适配接口403,锂电池402和外接电源适配接口403通过电源控制电路401进行电源的切换和输入。机器启动后,电源控制电路401内的各稳压芯片为投影仪内部各个模块提供所需的电源电压,并使各功能模块、各驱动电路开始正常工作,若使用外接电源,在完成上述进程的同时,会通过电源控制电路401根据锂电池402的电量确定是否执行充电操作,当不使用外接电源时,则锂电池402放电为投影仪内部的各个模块进行供电。In yet another embodiment, as shown in FIG. 4 , the
在又一实施例中,如图5所示,音频输出模块3包括音频输出接口301和内置扬声器302。内置扬声器302通过位于机壳下表面的喇叭播放声音,音频输出接口301电连接外部的音箱、耳机等设备。In yet another embodiment, as shown in FIG. 5 , the
在又一实施例中,如图3所示,壳体内的电路还包括无线模块9,无线模块9与中央控制模块1电连接,可选的,无线模块9包括无线路由器、红外遥控信号接收器和蓝牙装置,投影仪可以通过无线模块9和其他的智能设备进行信息的交互,如可以和其他的健康检测设备进行信息的交互,收集这些健康检测设备测量的人体生理数据信息,并通过中央控制模块1发送给边缘计算语音处理模块5进行处理计算。无线模块9还可以将边缘计算语音处理模块计算分析的结果输出给用户的其他的智能设备,方便用户查看分析结果。In yet another embodiment, as shown in FIG. 3 , the circuit in the housing further includes a wireless module 9 , and the wireless module 9 is electrically connected to the
在本发明的又一实施例中,如图3所示,电路还包括存储模块10,存储模块10与中央控制模块1、边缘计算语音分析模块5电连接。存储模块10具有大容量的存储器,可以对边缘计算语音处理模块5生成的个人健康数据进行长期存储,边缘计算语音处理模块5虽然也可以对个人健康数据进行暂时的缓存,但是由于个人健康数据量大且边缘计算语音处理模块5无法对这些数据进行长期的存储,只能存储一定时间段内的数据,从而在进行分析处理时也只能进行短期分析,而加入存储模块10后,能够实现对个人健康数据的长期监测与追踪,为边缘计算语音处理模块5进行数据的长期综合计算分析提供支持。边缘计算语音处理模块5进行分析计算的结果存入存储模块10中进行存储,减轻了边缘计算语音处理模块5的存储压力。伴随用户的使用次数、时间的增多,存储模块10存储的个人健康数据量越来越大,继而为后续的边缘计算等提供充足的数据支持。另外,本发明的投影仪的存储模块10,可以根据实际存储的个人健康数据的类型进行分类存储,例如情绪变化库、心理状态变化库、用药情况变化库、饮食情况变化库等等。In another embodiment of the present invention, as shown in FIG. 3 , the circuit further includes a
进一步的,在本发明上述实施例的基础上,如图6所示,边缘计算语音处理模块5包括高效缓存单元501、神经网络加速单元502、数据可视化单元503、异常网络信息反馈单元504,其中:Further, on the basis of the above embodiments of the present invention, as shown in FIG. 6 , the edge computing
神经网络加速单元502用于对语音分析模块6输送的语音信息实时进行分析处理生成个人健康数据并发送至高效缓存单元501以及存储模块10进行缓存。具体的,神经网络加速单元502首先对一定时间内接收到的语音信息:声纹、饮食信息、用药信息、生活语言信息等进行分析计算,得到用户的情绪、心理、饮食、用药情况等数据发送给数据可视化单元503进行可视化处理生成可供用户查看的文字性或图表性结论等,将生成的文字性或图表性的结论存储到存储模块10;同时神经网络加速单元502将得到的情绪、心理、饮食、用药情况等数据发送给高效缓存单元501以及存储模块10进行存储。The neural
每隔一段时间,神经网络加速单元502会提取高效缓存单元501中存储的情绪、心理、饮食、用药情况等数据再进行综合分析生成用户该段时间的情绪、心理、饮食、用药等波动情况,在提取后高效缓存单元501内存储的数据会清除,从而使高效缓存单元501能够继续存储新生成的数据。生成的情绪、心理、饮食、用药等波动情况再次发送给高效缓存单元501以及存储模块10存储。这里可将时间设置为每隔5天、10天、半个月等进行一次综合处理分析,具体的时间设置可以根据实际情况确定,本发明对此不作限定。Every once in a while, the neural
数据可视化单元503用于将神经网络加速单元502生成的个人健康数据(包括情绪、心理、饮食、用药情况等数据以及情绪、心理、饮食、用药的波动情况等)进行数据可视化处理,并传输至异常网络信息反馈单元504进行反馈以及传输至存储模块10进行存储。同时如果神经网络加速单元502有无法分析处理的语音信息也可以发送给数据可视化单元503进行可视化处理并传输至异常网络信息反馈单元504进行反馈。The
异常网络信息反馈单元504将通过无线模块或者通信协议把接收到的可视化的数据发给云平台转给第三方,或者通过连接的光学投影模块2显示给用户本人。本发明的投影仪凡是要传输出去供用户或者第三方查看的数据都要传输至异常网络信息反馈单元504进行反馈。The abnormal network
在本发明的有一种实施例中,如图7所示,还提供一种基于上述的带语音分析功能的投影仪的健康数据生成方法,方法包括:In an embodiment of the present invention, as shown in FIG. 7 , a method for generating health data based on the above-mentioned projector with a speech analysis function is also provided, the method comprising:
S101:投影仪通过语音开机或开关开机;S101: The projector is turned on by voice or switch;
S102:语音分析模块开始录入用户语音信息;S102: The voice analysis module starts to input user voice information;
S103:将录入的用户语音信息转换为数字语音信号并提取声纹;S103: Convert the entered user voice information into digital voice signals and extract voiceprints;
S104:声纹匹配;S104: Voiceprint matching;
具体的,判断提取到的声纹与预先存储的声纹是否匹配,若是,执行步骤S105,否则,结束;Specifically, it is judged whether the extracted voiceprint matches the pre-stored voiceprint, if so, go to step S105, otherwise, end;
S105:将数字语音信号以及声纹发送给边缘计算语音处理模块;S105: Send the digital voice signal and voiceprint to the edge computing voice processing module;
S106:进行语义识别将接收到的数字语音信号分类;S106: Perform semantic recognition to classify the received digital speech signal;
具体的,边缘计算语音处理模块对接收到的数字语音信号进行语义识别并根据语义识别结果将接收到的数字语音信号分为饮食信息、用药信息以及生活言语信息。Specifically, the edge computing voice processing module performs semantic recognition on the received digital voice signal and divides the received digital voice signal into diet information, medication information and life language information according to the semantic recognition result.
S107:对分类后的数字语音信号以及声纹信息进行分析处理生成个人健康数据。S107: Analyze and process the classified digital voice signal and voiceprint information to generate personal health data.
具体的,边缘计算语音处理模块分别对饮食信息、用药信息、生活言语信息以及声纹信息进行分析处理生成个人健康数据。使用本发明提供的健康数据生成方法,生成个人健康数据,操作简单,实用性强,生成的个人健康数据可为使用者身体健康分析提供有力的数据支持。Specifically, the edge computing voice processing module analyzes and processes dietary information, medication information, daily speech information and voiceprint information to generate personal health data. Using the health data generating method provided by the present invention to generate personal health data has the advantages of simple operation and strong practicability, and the generated personal health data can provide strong data support for the user's physical health analysis.
本发明提供的带语音分析功能的投影仪,除了具有普通的投影仪都具有的投影,播放视频、图片、音乐等功能外,通过在投影仪上增加语音分析模块以及边缘计算语音处理模块,还能够采集、提取用户的身体生理信息如声纹信息以及记录用户的日常生活信息如日常饮食、用药、生活言语信息,为用户做健康诊断时提供数据支持,用户的生理信息包括用户的声纹信息,通过对声纹信息的特征提取计算还可以得出用户的情绪、心理状况,由于人的声纹会随着人的情绪发生细微的变化,因此通过声纹即可了解人的心理、情绪状况,用户的日常生活信息包括用户的饮食,用户日常服用的药物、生活言语信息等等,通过对用户的饮食进行记录并计算,得出用户的饮食规律,在医生对用户进行健康诊断时,可以提供近期用户的饮食以及日常服用的药物的情况,使医生能够依据上述这些详细的个人数据信息对用户做出正确的健康诊断,降低误诊率。The projector with speech analysis function provided by the present invention, in addition to having the functions of projection, playing video, pictures, music, etc., which are possessed by ordinary projectors, by adding a speech analysis module and an edge computing speech processing module on the projector, also It can collect and extract the user's physical and physiological information such as voiceprint information and record the user's daily life information such as daily diet, medication, life language information, and provide data support for the user's health diagnosis. The user's physiological information includes the user's voiceprint information. , through the feature extraction and calculation of the voiceprint information, the user's mood and psychological state can also be obtained. Since a person's voiceprint will change slightly with the person's mood, it is possible to understand the person's psychological and emotional state through the voiceprint. , the user's daily life information includes the user's diet, the daily medicines the user takes, life language information, etc. By recording and calculating the user's diet, the user's diet rule is obtained. When the doctor makes a health diagnosis for the user, you can Provide the recent user's diet and daily medicines, so that doctors can make a correct health diagnosis for the user based on the above detailed personal data information, and reduce the misdiagnosis rate.
以上借助具体实施例对本发明做了进一步描述,但是应该理解的是,这里具体的描述,不应理解为对本发明的实质和范围的限定,本领域内的普通技术人员在阅读本说明书后对上述实施例做出的各种修改,都属于本发明所保护的范围。The present invention has been further described above with the help of specific embodiments, but it should be understood that the specific description herein should not be construed as a limitation on the spirit and scope of the present invention. Various modifications made in the embodiments all belong to the protection scope of the present invention.
Claims (7)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910979936.6A CN112672120B (en) | 2019-10-15 | 2019-10-15 | Projector with speech analysis function and method for generating personal health data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910979936.6A CN112672120B (en) | 2019-10-15 | 2019-10-15 | Projector with speech analysis function and method for generating personal health data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112672120A CN112672120A (en) | 2021-04-16 |
| CN112672120B true CN112672120B (en) | 2022-09-09 |
Family
ID=75400350
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910979936.6A Active CN112672120B (en) | 2019-10-15 | 2019-10-15 | Projector with speech analysis function and method for generating personal health data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112672120B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113486306B (en) * | 2021-06-28 | 2024-03-12 | 深圳市拔超科技股份有限公司 | High-definition audio/video matrix control system and method |
| CN113407922B (en) * | 2021-07-14 | 2022-06-03 | 上海万向区块链股份公司 | Intelligent intention recognition and analysis system and method based on block chain technology |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204945603U (en) * | 2015-09-18 | 2016-01-06 | 深圳市祈锦通信技术有限公司 | A kind of fingerprint recognition projector |
| CN105596016A (en) * | 2015-12-23 | 2016-05-25 | 王嘉宇 | Human body psychological and physical health monitoring and managing device and method |
| CN107635147A (en) * | 2017-09-30 | 2018-01-26 | 上海交通大学 | Health information management TV based on multi-modal human-computer interaction |
| CN108111538A (en) * | 2018-01-25 | 2018-06-01 | 芜湖应天光电科技有限责任公司 | Smart projector speech control system and its method based on sound groove recognition technology in e |
| CN109584896A (en) * | 2018-11-01 | 2019-04-05 | 苏州奇梦者网络科技有限公司 | A kind of speech chip and electronic equipment |
| CN109830271A (en) * | 2019-01-15 | 2019-05-31 | 安徽理工大学 | A kind of health data management system and analysis method based on edge calculations and cloud computing |
| CN109859843A (en) * | 2018-10-23 | 2019-06-07 | 苏州鱼跃医疗科技有限公司 | Smart health all-in-one machine |
| CN109920544A (en) * | 2019-01-28 | 2019-06-21 | 浙江工业大学 | Real-time adaptive intelligent building system based on somatosensory information |
-
2019
- 2019-10-15 CN CN201910979936.6A patent/CN112672120B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204945603U (en) * | 2015-09-18 | 2016-01-06 | 深圳市祈锦通信技术有限公司 | A kind of fingerprint recognition projector |
| CN105596016A (en) * | 2015-12-23 | 2016-05-25 | 王嘉宇 | Human body psychological and physical health monitoring and managing device and method |
| CN107635147A (en) * | 2017-09-30 | 2018-01-26 | 上海交通大学 | Health information management TV based on multi-modal human-computer interaction |
| CN108111538A (en) * | 2018-01-25 | 2018-06-01 | 芜湖应天光电科技有限责任公司 | Smart projector speech control system and its method based on sound groove recognition technology in e |
| CN109859843A (en) * | 2018-10-23 | 2019-06-07 | 苏州鱼跃医疗科技有限公司 | Smart health all-in-one machine |
| CN109584896A (en) * | 2018-11-01 | 2019-04-05 | 苏州奇梦者网络科技有限公司 | A kind of speech chip and electronic equipment |
| CN109830271A (en) * | 2019-01-15 | 2019-05-31 | 安徽理工大学 | A kind of health data management system and analysis method based on edge calculations and cloud computing |
| CN109920544A (en) * | 2019-01-28 | 2019-06-21 | 浙江工业大学 | Real-time adaptive intelligent building system based on somatosensory information |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112672120A (en) | 2021-04-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12505190B2 (en) | Providing private answers to non-vocal questions | |
| US12154572B2 (en) | Identifying silent speech using recorded speech | |
| CN103561652B (en) | Method and system for assisting patients | |
| CN110367934B (en) | Health monitoring method and system based on non-voice body sounds | |
| US20250173415A1 (en) | Using facial movements to generate a conversational record | |
| TWI222622B (en) | Robotic vision-audition system | |
| CN112672120B (en) | Projector with speech analysis function and method for generating personal health data | |
| US20190267002A1 (en) | Intelligent system for creating and editing work instructions | |
| US20220101873A1 (en) | Techniques for providing feedback on the veracity of spoken statements | |
| TW202223804A (en) | Electronic resource pushing method and system | |
| CN108670275A (en) | Signal processing method and related product | |
| TW201826167A (en) | Method for face expression feedback and intelligent robot | |
| CN112669963B (en) | Intelligent health machine, health data generation method and health data management system | |
| KR20200144821A (en) | Smart mirror | |
| US11657814B2 (en) | Techniques for dynamic auditory phrase completion | |
| CN112672119B (en) | An intelligent projector with a camera function and a method for generating personal health data | |
| US20260037555A1 (en) | Conversation-based assistance using a display free body wearable computing device | |
| JP2026047937A (en) | system | |
| JP2026062198A (en) | system | |
| JP2026064798A (en) | system | |
| TW202613980A (en) | A facial monitoring system | |
| CN120541788A (en) | A multimodal fusion dynamic weighted recognition method and system based on facial emotion recognition and speech recognition | |
| JP2026017991A (en) | system | |
| JP2026018048A (en) | system | |
| JP2026064781A (en) | system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20241215 Address after: 518054 Building A, Phase II, Sunshine Science and Technology Innovation Center, Nanxin Road, Nanshan Community, Nanshan Street, Nanshan District, Shenzhen City, Guangdong Province 1301-17 Patentee after: Shenzhen aiwo Health Network Service Co.,Ltd. Country or region after: China Address before: 100176 building 17, yard 2, Tianhua North Street, Yizhuang, Daxing District, Beijing Patentee before: Xu Guilin Country or region before: China |
|
| TR01 | Transfer of patent right |