TWI909997B - Tracking method for tongue and its rehabilitation system for tongue muscle - Google Patents

Tracking method for tongue and its rehabilitation system for tongue muscle

Info

Publication number
TWI909997B
TWI909997B TW114109909A TW114109909A TWI909997B TW I909997 B TWI909997 B TW I909997B TW 114109909 A TW114109909 A TW 114109909A TW 114109909 A TW114109909 A TW 114109909A TW I909997 B TWI909997 B TW I909997B
Authority
TW
Taiwan
Prior art keywords
tongue
image
value
coordinate value
generate
Prior art date
Application number
TW114109909A
Other languages
Chinese (zh)
Inventor
張萬榮
陳嘉炘
Original Assignee
國立高雄科技大學
高雄醫學大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 國立高雄科技大學, 高雄醫學大學 filed Critical 國立高雄科技大學
Priority to TW114109909A priority Critical patent/TWI909997B/en
Priority to JP2025109576A priority patent/JP7846849B1/en
Application granted granted Critical
Publication of TWI909997B publication Critical patent/TWI909997B/en

Links

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The present invention provides a tracking method for tongue and a rehabilitation system for tongue muscle, wherein the tracking method for tongue comprises steps: placing a tongue suction device on a tongue, wherein the tongue suction device is configured with a tracking point; acquiring a first tongue muscle exercise image of the tongue; converting a color space of the first tongue muscle exercise image; filtering a specified color value in the color space to generate a filtering result; performing image analysis based on the filtering result to generate plural regional image shapes; determining aforementioned plural regional image shapes to generate a target object corresponding to the tracking point; drawing a contour information corresponding to the target object; identifying a coordinate values of the contour information; and calculating the coordinate values to generate a first position information corresponding to the tongue. By integrating with the tongue muscle rehabilitation system, the efficiency in rehabilitation is significantly enhanced.

Description

舌部追蹤方法及其舌肌復健系統Tongue tracking methods and tongue muscle rehabilitation system

一種追蹤方法及其復健系統,特別是涉及一種舌部追蹤方法及其舌肌復健系統。A tracking method and its rehabilitation system, particularly relating to a tongue tracking method and its tongue muscle rehabilitation system.

據內政部資料統計,於2024年全台65歲以上人口已達400多萬人,占總人口的17.8%,老化指數來到147.9,而從國際高齡化指標來看,將65歲以上人口占比的7%、14%及20%作為不同程度的高齡化指標,其中,7%表示高齡化社會、14%表示高齡社會以及20%表示超高齡社會,因此根據國家發展委員會預測,台灣即將於2025年邁入超高齡社會,而今年也已經有40個國家和地區邁入超高齡社會,也預估在未來數年陸續有更多國家邁入超高齡社會。According to statistics from the Ministry of the Interior, in 2024, the number of people aged 65 and above in Taiwan reached more than 4 million, accounting for 17.8% of the total population, with an aging index of 147.9. From the perspective of international aging indicators, 7%, 14%, and 20% of the population aged 65 and above are used as indicators of different degrees of aging. Among them, 7% represents an aging society, 14% represents an aged society, and 20% represents a super-aged society. Therefore, according to the National Development Council's prediction, Taiwan will enter a super-aged society in 2025. This year, 40 countries and regions have already entered super-aged societies, and it is estimated that more countries will enter super-aged societies in the coming years.

隨著超高齡社會的來臨,緊隨而來的即為醫療需求,根據國內外研究年齡對於舌肌力量的影響十分顯著,而疾病亦可能導致舌肌功能異常,例如:肌少症、帕金森氏症、中風或失智症等慢性疾病,而該些疾病大多隨著年齡增加患病風險,根據文獻研究指出,針對舌肌復健方法大致分為兩種運動,一為頭部運動,另一則為嘴部周圍運動,其中,頭部運動例如為頭部抬舉運動及頭部伸展吞嚥運動,大多以舌肌力量紀錄設備進行輔助,而嘴部周圍運動則例如為張口運動及縮下巴阻抗運動,則可以分別以舌定位器及彈力球作為輔助,以此,改善舌部各肌群之運動能力。With the arrival of a super-aged society, the demand for medical care is increasing. Domestic and international research indicates that age has a significant impact on tongue muscle strength, and diseases can also lead to tongue muscle dysfunction, such as sarcopenia, Parkinson's disease, stroke, or dementia. The risk of developing these diseases often increases with age. According to literature, tongue muscle rehabilitation methods can be broadly categorized into... There are two types of exercises: one is head exercises, and the other is mouth-circumference exercises. The head exercises, such as head lifting and head extension swallowing exercises, are mostly assisted by tongue muscle strength recording equipment. The mouth-circumference exercises, such as mouth opening and chin retraction resistance exercises, can be assisted by tongue positioners and bouncy balls, respectively. In this way, the motor ability of various tongue muscle groups can be improved.

因此於現有的技術中,針對舌肌復健的設備例如為IOPI Pro Device、口部機能訓練組、健舌器、Electric Tongue Exerciser Kit或牽引裝置,惟該些舌肌復健設備大多缺乏互動性,而針對舌復健遊戲的設備,主要以舌壓儀結合表面肌電儀器(sEMG)測得使用者舌肌與吞嚥狀況,並評估其吞嚥效果,另一種則是採用影像感測結合頭戴式顯示器獲取舌部運作狀態,惟該些復健設備需搭配多種輔助設備,除了價格不斐以外,亦有空間限制。Therefore, in existing technologies, devices for tongue muscle rehabilitation include IOPI Pro Device, oral function training kits, tongue exercisers, Electric Tongue Exerciser Kits, or traction devices. However, most of these tongue muscle rehabilitation devices lack interactivity. Devices for tongue rehabilitation games mainly use tongue depressors combined with surface electromyography (sEMG) to measure the user's tongue muscles and swallowing status and evaluate their swallowing effect. Another method is to use image sensing combined with a head-mounted display to obtain the tongue's movement status. However, these rehabilitation devices require a variety of auxiliary devices, which are not only expensive but also space-limited.

為解決此一問題,本發明提供一種舌部追蹤方法及其舌肌復健系統,在現有的吸舌器基礎下,以舌部追蹤方法透過影像辨識獲取舌部位置,並結合復健任務,大幅提升舌肌復健的互動性,並且不局限於空間或設備,即便使用者在復健過程中移動頭部,仍可以精準的獲取舌部位置,並辨識其舌部運動方向,有效提高復健成效。To address this problem, this invention provides a tongue tracking method and its tongue muscle rehabilitation system. Based on existing tongue suction devices, the tongue tracking method uses image recognition to obtain the tongue position and combines it with rehabilitation tasks to significantly improve the interactivity of tongue muscle rehabilitation. Moreover, it is not limited by space or equipment. Even if the user moves their head during rehabilitation, the tongue position can still be accurately obtained and the direction of tongue movement can be identified, effectively improving the rehabilitation effect.

本發明之主要目的,係提供一種舌部追蹤方法,其以第一舌肌運動影像進行色彩空間轉換,並透過篩選之指定色彩數值進行影像分析,有效獲取並追蹤吸舌器位置,大幅提高追蹤精準度。The main purpose of this invention is to provide a tongue tracking method that performs color space conversion on the image of the first tongue muscle movement and performs image analysis through the selection of specified color values, effectively acquiring and tracking the position of the tongue suction device and greatly improving tracking accuracy.

本發明之另一目的,係提供一種舌肌復健系統,其以舌部追蹤方法辨識吸舌器位置,並通過控制模組使虛擬物件可跟隨著吸舌器位置同步移動,以此完成復健任務,確保正確的執行舌肌運動,有效提高復健成效。Another objective of this invention is to provide a tongue muscle rehabilitation system that identifies the position of a tongue suction device using a tongue tracking method and enables a virtual object to move synchronously with the position of the tongue suction device through a control module, thereby completing the rehabilitation task, ensuring the correct execution of tongue muscle movements, and effectively improving rehabilitation results.

為了達到上述之目的,本發明之一實施例係揭示一種舌部追蹤方法,步驟包含: 於一舌部設置一吸舌器,該吸舌器設有一追蹤點;獲取該舌部之一第一舌肌運動影像;轉換該第一舌肌運動影像之一色彩空間;篩選該色彩空間之一指定色彩數值,以產生一篩選結果;以該篩選結果進行影像分析,產生複數個區域影像形狀;判定該些個區域影像形狀,產生對應於該追蹤點之一目標物件;根據該目標物件繪製對應之一輪廓資訊;辨識該輪廓資訊之一座標值;及運算該座標值,以產生該舌部對應之一第一位置資訊。To achieve the above objectives, one embodiment of the present invention discloses a tongue tracking method, comprising the following steps: installing a tongue suction device on a tongue, the suction device having a tracking point; acquiring a first tongue muscle movement image of the tongue; converting a color space of the first tongue muscle movement image; filtering a specified color value in the color space to generate a filtering result; performing image analysis on the filtering result to generate a plurality of regional image shapes; determining the regional image shapes to generate a target object corresponding to the tracking point; drawing corresponding contour information based on the target object; identifying a coordinate value of the contour information; and calculating the coordinate value to generate a first position information corresponding to the tongue.

於較佳實施例中,於判定該些個區域影像形狀,產生對應於該追蹤點之一目標物件之步驟中,分別提取該些個區域影像形狀之一參數值,並計算每一區域影像形狀之一面積值及一周長,根據該面積值及該周長生成對應之一擬合橢圓,根據該擬合橢圓計算一橢圓軸比及一圓度數值,根據該橢圓軸比及圓度數值判定該目標物件。In a preferred embodiment, in the step of determining the shapes of the regional images and generating a target object corresponding to the tracking point, parameter values of the shapes of the regional images are extracted respectively, and an area value and perimeter of each regional image shape are calculated. A corresponding fitted ellipse is generated based on the area value and the perimeter. An ellipse aspect ratio and a roundness value are calculated based on the fitted ellipse. The target object is determined based on the ellipse aspect ratio and roundness value.

於較佳實施例中,於辨識該輪廓資訊之一座標值之步驟中,該輪廓資訊係於對應該目標物件之該擬合橢圓及對應該擬合橢圓之一外切矩形,辨識該擬合橢圓及該外切矩形之該座標值,該座標值包含該擬合橢圓之一中心點座標值及該外切矩形之一第一座標值及一第二座標值。In a preferred embodiment, in the step of identifying a coordinate value of the contour information, the contour information is the approximate ellipse corresponding to the target object and a circumscribed rectangle corresponding to the approximate ellipse, and the coordinate value of the approximate ellipse and the circumscribed rectangle is identified. The coordinate value includes the coordinate value of the center point of the approximate ellipse and a first coordinate value and a second coordinate value of the circumscribed rectangle.

於較佳實施例中,以該第一舌肌運動影像、該輪廓資訊、該座標值及該第一位置資訊執行一迴歸分析,產生一分析結果;輸入一第二舌肌運動影像;及以該分析結果判定該第二舌肌影像中之該追蹤點之一第二位置資訊。In a preferred embodiment, a regression analysis is performed using the first tongue muscle movement image, the contour information, the coordinate value, and the first position information to generate an analysis result; a second tongue muscle movement image is input; and the analysis result is used to determine the second position information of the tracking point in the second tongue muscle image.

於較佳實施例中,於運算該座標值,以產生該舌部對應之一第一位置資訊之步驟中,設置該舌部之一移動範圍,以該座標值及該移動範圍進行運算,以產生該第一位置資訊。In a preferred embodiment, in the step of calculating the coordinate value to generate a first position information corresponding to the tongue, a range of movement of the tongue is set, and the first position information is generated by calculating the coordinate value and the range of movement.

為了達到上述之另一目的,本發明之一實施例係揭示一種舌肌復健系統,包含: 一吸舌器,設置於一舌部,該吸舌器設有一追蹤點;一影像擷取模組,用以獲取該舌部之一第一舌肌運動影像;一辨識模組,與該影像擷取模組訊號連接,用以辨識該第一舌肌運動影像,以產生該舌部對應之一第一位置資訊;一控制模組,與該辨識模組訊號連接,用以根據該第一位置資訊控制一虛擬物件移動;及一復健模組,與該控制模組訊號連接,用以提供一復健任務,使該虛擬物件根據該復健任務進行移動。To achieve another objective mentioned above, one embodiment of the present invention discloses a tongue muscle rehabilitation system, comprising: a tongue suction device disposed on a tongue, the tongue suction device having a tracking point; an image capture module for acquiring an image of the movement of a first tongue muscle; a recognition module signal-connected to the image capture module for recognizing the image of the first tongue muscle to generate first position information corresponding to the tongue; a control module signal-connected to the recognition module for controlling the movement of a virtual object based on the first position information; and a rehabilitation module signal-connected to the control module for providing a rehabilitation task, causing the virtual object to move according to the rehabilitation task.

於較佳實施例中,該辨識模組以該第一舌肌運動影像進行色彩空間轉換,並於篩選一指定色彩數值後進行影像分析,以產生一目標物件,以該目標物件繪製對應之一輪廓資訊,並辨識該輪廓資訊之一座標值,根據該座標值及該舌部之一移動範圍進行運算,以產生該第一位置資訊,該目標物件係對應於該吸舌器之該追蹤點。In a preferred embodiment, the recognition module performs color space conversion on the first tongue muscle movement image, and performs image analysis after filtering a specified color value to generate a target object. The module then draws corresponding outline information based on the target object, identifies a coordinate value of the outline information, and performs calculations based on the coordinate value and a range of movement of the tongue to generate the first position information. The target object corresponds to the tracking point of the tongue suction device.

於較佳實施例中,該辨識模組係以篩選該指定色彩數值後產生複數個區域影像形狀,並分別提取該些個區域影像形狀之一參數值,計算每一區域影像形狀之一面積值及一周長,根據該面積值及該周長生成對應之一擬合橢圓,根據該擬合橢圓計算一橢圓軸比及一圓度數值,根據該橢圓軸比及圓度數值判定該目標物件。In a preferred embodiment, the recognition module generates a plurality of regional image shapes after filtering the specified color values, extracts a parameter value of each regional image shape, calculates an area value and a perimeter of each regional image shape, generates a corresponding fitted ellipse based on the area value and the perimeter, calculates an ellipse aspect ratio and a roundness value based on the fitted ellipse, and determines the target object based on the ellipse aspect ratio and roundness value.

於較佳實施例中,該輪廓資訊係於對應該目標物件之該擬合橢圓及對應該擬合橢圓之一外切矩形,辨識該擬合橢圓及該外切矩形之該座標值,該座標值包含該擬合橢圓之一中心點座標值及該外切矩形之一第一座標值及一第二座標值。In a preferred embodiment, the contour information is obtained by identifying the coordinate values of the fitting ellipse and the circumscribed rectangle corresponding to the target object. The coordinate values include the coordinate value of the center point of the fitting ellipse and the first and second coordinate values of the circumscribed rectangle.

於較佳實施例中,該辨識模組獲取該第一舌肌運動影像、該輪廓資訊、該座標值及該第一位置資訊,以執行一迴歸分析,產生對應之一分析結果,當自該影像擷取模組獲取一第二舌肌運動影像時,該辨識模組以該分析結果判定該第二舌肌影像中之該追蹤點,以產生該舌部對應之一第二位置資訊。In a preferred embodiment, the recognition module acquires the first tongue muscle movement image, the contour information, the coordinate value, and the first position information to perform a regression analysis and generate a corresponding analysis result. When a second tongue muscle movement image is acquired from the image extraction module, the recognition module uses the analysis result to determine the tracking point in the second tongue muscle image to generate a second position information corresponding to the tongue.

本發明之有益功效在於以現有的吸舌器結合舌部追蹤方法快速追蹤舌部位置,以此控制舌部完成復健任務,此一復健方式不須增設其它輔助設備,大幅降低建置成本,同時,不侷限使用空間,大幅增加復健成效,解決現有技術須搭配多種輔助設備、不利於居家使用的問題。The beneficial effects of this invention lie in its ability to quickly track the position of the tongue by combining the existing tongue suction device with a tongue tracking method, thereby controlling the tongue to complete rehabilitation tasks. This rehabilitation method does not require additional auxiliary equipment, which greatly reduces the construction cost. At the same time, it is not limited by the space of use and greatly increases the rehabilitation effect, solving the problem that existing technologies require a variety of auxiliary equipment and are not conducive to home use.

有關本發明之相關申請專利特色與技術內容,在以下配合參考圖式之較佳實施例的詳細說明中,將可清楚的呈現。The relevant patent features and technical contents of this invention will be clearly presented in the following detailed description of the preferred embodiments with reference to the accompanying drawings.

請參閱圖1,其為本發明之一實施例之方法流程圖。如圖所示,本發明之一種舌部追蹤方法,步驟包含:Please refer to Figure 1, which is a flowchart of a method according to an embodiment of the present invention. As shown in the figure, a tongue tracking method of the present invention includes the following steps:

步驟S1: 於一舌部設置一吸舌器,該吸舌器設有一追蹤點;Step S1: Install a tongue suction device on a tongue, the tongue suction device having a tracking point;

步驟S2: 獲取該舌部之一第一舌肌運動影像;Step S2: Acquire an image of the movement of one of the first tongue muscles;

步驟S3: 轉換該第一舌肌運動影像之一色彩空間;Step S3: Change the color space of one of the first tongue muscle movement images;

步驟S4: 篩選該色彩空間之一指定色彩數值,以產生一篩選結果;Step S4: Filter the specified color values of one of the color spaces to produce a filter result;

步驟S5: 以該篩選結果進行影像分析,產生複數個區域影像形狀;Step S5: Perform image analysis based on the filtering results to generate multiple regional image shapes;

步驟S6: 判定該些個區域影像形狀,產生對應於該追蹤點之一目標物件;Step S6: Determine the shape of these regional images and generate a target object corresponding to the tracking point;

步驟S7: 根據該目標物件繪製對應之一輪廓資訊;Step S7: Draw the corresponding outline information based on the target object;

步驟S8: 辨識該輪廓資訊之一座標值; 及Step S8: Identify one of the coordinate values of the contour information; and

步驟S9: 運算該座標值,以產生該舌部對應之一第一位置資訊。Step S9: Calculate the coordinate value to generate one of the first position information corresponding to the tongue.

請一併參閱圖2,其為本發明之一實施例之系統示意圖。如圖所示,本發明之一種舌肌復健系統S,包含:影像擷取模組1、辨識模組2、控制模組3及復健模組4,其中,辨識模組2係分別與影像擷取模組1及控制模組3訊號連接,復健模組4係與控制模組3訊號連接,並以下列舌部追蹤方法之步驟詳細說明之。Please also refer to Figure 2, which is a schematic diagram of a system according to an embodiment of the present invention. As shown in the figure, a tongue muscle rehabilitation system S of the present invention includes: an image acquisition module 1, a recognition module 2, a control module 3, and a rehabilitation module 4. The recognition module 2 is connected to the image acquisition module 1 and the control module 3 by signal, and the rehabilitation module 4 is connected to the control module 3 by signal. The steps of the tongue tracking method are explained in detail below.

如步驟S1所示,請一併參閱圖3,其為本發明之一實施例之實施示意圖。如圖所示,於舌部上設置吸舌器H,其中,吸舌器H包含但不僅限於主動式復健用吸舌器H,較佳的,吸舌器H的一端設有追蹤點H1,其中,追蹤點H1可為單一顏色,顏色種類並不被限制,於本實施例中,以紅色作為示例。As shown in step S1, please also refer to Figure 3, which is a schematic diagram of one embodiment of the present invention. As shown in the figure, a tongue suction device H is provided on the tongue. The tongue suction device H includes, but is not limited to, an active rehabilitation tongue suction device H. Preferably, one end of the tongue suction device H is provided with a tracking point H1. The tracking point H1 can be a single color, and the type of color is not limited. In this embodiment, red is used as an example.

如步驟S2所示,以影像擷取模組1獲取使用者設有吸舌器H的舌部之第一舌肌運動影像,其中,影像擷取模組1可平放或懸置於使用者前方。As shown in step S2, the image capture module 1 captures the first tongue muscle movement image of the user's tongue with the tongue suction device H. The image capture module 1 can be placed flat or suspended in front of the user.

如步驟S3所示,辨識模組2係根據前一步驟所獲取之第一舌肌運動影像轉換其色彩空間,於一實施例中,第一舌肌運動影像之色彩空間可為RGB色彩空間,並根據其RGB色彩空間轉換為HSV色彩空間,轉換之色彩空間能夠更直觀的界定顏色的範圍,其中,RGB分別代表紅(Red)、綠(Green)、藍(Blue)三原色的色光,而HSV分別代表色相(Hue)、飽和度(Saturation)以及明度(Value),在視覺上, RGB色彩空間的座標體系為三維直角座標系,而HSV色彩空間的座標體系則為球面座標系。As shown in step S3, the recognition module 2 converts the color space of the first tongue muscle movement image obtained in the previous step. In one embodiment, the color space of the first tongue muscle movement image can be RGB color space, and it is converted into HSV color space according to its RGB color space. The converted color space can more intuitively define the range of colors. RGB represents the three primary colors of light: red, green, and blue, respectively, while HSV represents hue, saturation, and value. Visually, the coordinate system of RGB color space is a three-dimensional rectangular coordinate system, while the coordinate system of HSV color space is a spherical coordinate system.

如步驟S4所示,接續,辨識模組2可根據轉換後的色彩空間篩選指定色彩數值,而可產生篩選結果,於一實施例中,指定色彩數值係對應吸舌器H一端設置之追蹤點H1的顏色,較佳的,本實施例係採用紅色,故指定色彩數值可針對紅色的色相、飽和度及明度進行定義,具體而言,如下表1,其為本實施例所採用的HSV色彩空間的顏色範圍通值,其中,紅色在0~180的色相範圍中恰為一分為二,需特別定義0~10及156~180的兩個範圍,飽和度則定義為43~255,剔除顏色較淡之區域,以及明度則為46~255,剔除顏色較暗之區域,但並不在此限,亦可採用其他指定色彩數值。As shown in step S4, the identification module 2 can then filter specified color values based on the converted color space to generate a filtering result. In one embodiment, the specified color value corresponds to the color of the tracking point H1 set at one end of the tongue suction device H. Preferably, this embodiment uses red. Therefore, the specified color value can be defined for the hue, saturation, and brightness of red. Specifically, as shown in Table 1 below, it is the subject of this embodiment. The HSV color space adopted in the regulations has the following general values: red is divided into two parts in the hue range of 0 to 180, specifically the ranges of 0 to 10 and 156 to 180; saturation is defined as 43 to 255, excluding lighter areas; and lightness is defined as 46 to 255, excluding darker areas. However, these are not restrictions, and other specified color values may also be used.

表1 HSV色彩空間的顏色範圍通值 黑色 灰色 白色 紅色 橙色 黃色 綠色 青色 藍色 紫色 Hmin 0 0 0 0 156 11 26 35 78 100 125 Hmax 180 180 180 10 180 25 34 77 99 124 155 Smin 0 0 0 43 43 43 43 43 43 43 Smax 255 43 30 255 255 255 255 255 255 255 Vmin 0 46 221 46 46 46 46 46 46 46 Vmax 46 220 255 255 255 255 255 255 255 255 *Hmin為最小色相值;Hmax為最大色相值;Smin為最小飽和值;Smax為最大飽和值;Vmin為最小明度值;及Vmax為最大明度值。Table 1. Color Range General Values of HSV Color Space black grey White red orange color yellow green blue blue Purple H min 0 0 0 0 156 11 26 35 78 100 125 H max 180 180 180 10 180 25 34 77 99 124 155 S min 0 0 0 43 43 43 43 43 43 43 S max 255 43 30 255 255 255 255 255 255 255 V min 0 46 221 46 46 46 46 46 46 46 V max 46 220 255 255 255 255 255 255 255 255 *H min is the minimum hue value; H max is the maximum hue value; S min is the minimum saturation value; S max is the maximum saturation value; V min is the minimum lightness value; and V max is the maximum lightness value.

如步驟S5所示,辨識模組2將根據前述色彩篩選結果進行影像分析,以產生複數個區域影像形狀,於一實施例中,可經由計算篩選結果之影像中各區域之輪廓像素值,並根據各區域數值判斷過濾預設像素值以下之區域,以此,決定欲保留的特定區域(即圖3中綠色數值部分),即多個區域影像形狀,而被過濾的特定區域(即圖3中紅色數值部分),於一實施例中,預設像素值可以是8~12,但不在此限。As shown in step S5, the identification module 2 will perform image analysis based on the aforementioned color filtering results to generate multiple regional image shapes. In one embodiment, the outline pixel values of each region in the filtered image can be calculated, and regions below a preset pixel value can be filtered based on the values of each region. In this way, the specific regions to be retained (i.e., the green value portion in Figure 3), i.e., multiple regional image shapes, can be determined. In one embodiment, the preset pixel value of the specific regions to be filtered (i.e., the red value portion in Figure 3) can be 8 to 12, but is not limited to this.

如步驟S6所示,請參閱圖4,其為本發明之一實施例之實施示意圖。如圖所示,辨識模組2將會判定該些個區域影像形狀何者為吸舌器H對應的目標物件,即找出設置於吸舌器H一端的追蹤點H1位置,於一實施例中,為判定該些個區域影像形狀是否為目標物件,需先提取出各區域的個別參數值,並計算出每一區域影像形狀的面積值(如圖4之(a)部分)及周長(如圖4之(b)部分),以獲取每一區域影像形狀之面積值及周長生成對應之擬合橢圓(如圖4之(c)、(d)部分),接續,根據該些個擬合橢圓計算橢圓軸比(如圖4之(e)部分)及圓度數值(如圖4之(f)部分),以此,根據橢圓軸比及圓度數值判定目標物件,其中,橢圓軸比範圍為0.5~1.5,且,圓度最高者,即判定為目標物件,較佳者,圓度大於0.4,但不在此限,其計算公式如下:As shown in step S6, please refer to Figure 4, which is a schematic diagram of one embodiment of the present invention. As shown in the figure, the identification module 2 will determine which of the regional image shapes is the target object corresponding to the tongue suction device H, that is, find the tracking point H1 set at one end of the tongue suction device H. In one embodiment, in order to determine whether the regional image shapes are target objects, it is necessary to first extract the individual parameter values of each region, and calculate the area value (as shown in part (a) of Figure 4) and perimeter (as shown in part (b) of Figure 4) of each regional image shape to obtain the area of each regional image shape. The value and perimeter are used to generate corresponding approximate ellipses (as shown in parts (c) and (d) of Figure 4). Next, the ellipse ratio (as shown in part (e) of Figure 4) and roundness value (as shown in part (f) of Figure 4) are calculated based on these approximate ellipses. The target object is then determined based on the ellipse ratio and roundness value. The ellipse ratio ranges from 0.5 to 1.5, and the object with the highest roundness is determined to be the target object. Ideally, the roundness should be greater than 0.4, but this is not a limitation. The calculation formula is as follows:

如步驟S7所示,請參閱圖5,其為本發明之一實施例之實施示意圖。如圖所示,辨識模組2根據前一步驟獲取之目標物件,繪製其輪廓資訊,於一實施例中,繪製之輪廓資訊係對應目標物件之擬合橢圓(如圖5中綠色線條處)及對應此一擬合橢圓之外切矩形(如圖5白色框處),但不在此限。As shown in step S7, please refer to Figure 5, which is a schematic diagram of one embodiment of the present invention. As shown in the figure, the identification module 2 draws the outline information of the target object obtained in the previous step. In one embodiment, the outline information drawn is the fitting ellipse corresponding to the target object (as shown by the green line in Figure 5) and the circumscribed rectangle corresponding to this fitting ellipse (as shown by the white box in Figure 5), but it is not limited to this.

如步驟S8所示,如圖5所示,辨識模組2辨識前一步驟所繪製的輪廓資訊,以此辨識出擬合橢圓及外切矩形之座標值,較佳的,座標值包含擬合橢圓之中心點座標值及外切矩形之第一座標值及第二座標值,其中,外切矩形之第一座標值可為第二座標值的對角座標。As shown in step S8 and Figure 5, the identification module 2 identifies the outline information drawn in the previous step, thereby identifying the coordinate values of the fitted ellipse and the circumscribed rectangle. Preferably, the coordinate values include the coordinate values of the center point of the fitted ellipse. and the first coordinate value of the circumscribed rectangle and the second coordinate value The first coordinate value of the circumscribed rectangle can be the diagonal coordinate of the second coordinate value.

於一實施例中,座標值的計算方式說明如下:In one embodiment, the calculation method for coordinate values is explained as follows:

首先,擬合橢圓之中心點座標值定義為,且,擬合橢圓任一點座標為,而外切矩形之第一座標值及第二座標值分別假設為B1(x1,y1)及B2(x2,y2),並結合下列公式:First, the coordinates of the center point of the ellipse are approximated. Defined as Furthermore, the coordinates of any point on the approximate ellipse are: Let the first and second coordinates of the circumscribed rectangle be B1 ( x1 , y1 ) and B2 ( x2 , y2 ) respectively, and combine them with the following formula:

(1) (1)

(2) (2)

(3) (3)

(4) (4)

其中,公式(1)(2)為無傾斜角度的擬合橢圓之座標算法,而公式(3)(4)則為具有傾斜角度之座標算法。Formulas (1) and (2) are coordinate algorithms for a fitted ellipse without tilt angle, while formulas (3) and (4) are coordinate algorithms for a fitted ellipse with tilt angle. The coordinate algorithm.

由於外切矩形與擬合橢圓呈現切線關係,故第一座標值B1與第二座標值B2之座標值由公式(3)(4)計算所獲得之最大值與最小值,具體為下列參數:Since the circumscribed rectangle and the fitting ellipse are tangent to each other, the maximum and minimum values of the coordinates of the first coordinate B1 and the second coordinate B2 , calculated by formulas (3) and (4), are as follows:

如步驟S9所示,辨識模組2根據獲取之座標值進行運算後,即可獲取舌部對應之第一位置資訊,於一實施例中,請參閱圖6A,其為本發明之一實施例之實施示意圖。如圖所示,可進一步定義吸舌器H於口腔內的移動範圍,當影像擷取模組1與使用者距離為n公分時,假設一移動邊界框可完全覆蓋嘴部,又,由於不同使用者的嘴型可能有所不同,故將上述的移動邊界框範圍可以嘴部寬度延伸1.5倍的數值作為移動邊界框的寬度LTBwidth以及嘴部高度延伸1.5倍並加上吸舌器H厚度TSDthi作為移動邊界框的高度LTBheight,以此作為吸舌器H於口腔內的移動範圍門檻,舉例而言,嘴部寬度為50mm為例,則移動邊界框的寬度,以及嘴部高度為20mm為例,則移動邊界框的寬度,其中,此移動邊界框的座標值包含第三座標值LTB1(X1,Y1)、第四座標值LTB2(X2,Y2)以及中心點座標LTBc(Xc,Yc),且,第三座標值為第四座標值的對角座標。As shown in step S9, after the identification module 2 performs calculations based on the acquired coordinate values, it can obtain the first position information corresponding to the tongue. In one embodiment, please refer to Figure 6A, which is a schematic diagram of an embodiment of the present invention. As shown in the figure, the range of movement of the tongue suction device H within the oral cavity can be further defined. When the distance between the image capture module 1 and the user is n cm, assuming that a moving boundary frame can completely cover the mouth, and considering that different users may have different mouth shapes, the range of the aforementioned moving boundary frame can be defined as the width LTB of the moving boundary frame, which is 1.5 times the width of the mouth, and the height LTB is defined as the height LTB of the moving boundary frame, which is 1.5 times the height of the mouth plus the thickness TSD of the tongue suction device H. This serves as the threshold for the range of movement of the tongue suction device H within the oral cavity. For example, if the mouth width is 50 mm, then the width of the moving boundary frame... For example, if the mouth height is 20mm, then the width of the border frame can be moved. The coordinates of this moving bounding box include a third coordinate value LTB1 ( X1 , Y1 ), a fourth coordinate value LTB2 ( X2 , Y2 ), and a center point coordinate LTBc ( Xc , Yc ), and the third coordinate value is the diagonal of the fourth coordinate value.

舉例而言,如圖6A所示,以影像擷取模組1獲取影像之像素值為1280pixel(長)*720 pixel(寬)為例,將實際的移動邊界框的寬度及高度轉換為像素值,的計算公式如下:For example, as shown in Figure 6A, the image captured by image capture module 1 has a pixel value of 1280 pixels (length). 720 pixels (width) For example, the actual width of the move bounding box. and height Convert to pixel values and The calculation formula is as follows:

藉此,由移動邊界框的中心點座標與擬合橢圓之中心點座標值之間的距離,即可辨識吸舌器H的移動距離與方向。In this way, the coordinates of the center point of the moving bounding box are determined. The distance between the coordinates of the center point of the approximate ellipse and the distance between the center point ...

具體而言,請一併參閱圖6B至圖6C,其為本發明之一實施例之實施示意圖。如圖所示,當使用者與影像擷取模組1之間距離60cm時,當嘴部寬度為50mm可轉換為100pixel,則移動邊界框的寬度75mm可轉換為150pixel,移動邊界框的寬度60mm可轉換為120pixel,其中,當移動邊界框的中心點座標及擬合橢圓之中心點座標值時,則計算結果如下:Specifically, please refer to Figures 6B to 6C, which are schematic diagrams of one embodiment of the present invention. As shown in the figures, when the distance between the user and the image capturing module 1 is 60cm, a mouth width of 50mm can be converted to 100 pixels, a moving bounding box width of 75mm can be converted to 150 pixels, and a moving bounding box width of 60mm can be converted to 120 pixels. The coordinates of the center point of the moving bounding box are... and the coordinates of the center point of the approximate ellipse At that time, and The calculation results are as follows:

Right now

Right now

此時,吸舌器H的水平移動距離如下:At this time, the horizontal movement distance of the tongue suction device H is... as follows:

以此,根據正負數值即可判讀為追蹤點H1(即舌部)左或右的方向,即當時,則判讀為追蹤點H1(即舌部)往左,或當時,則判讀為追蹤點H1(即舌部)往右。Therefore, the positive or negative value can be used to determine the left or right direction of the tracking point H1 (i.e., the tongue). When, it is interpreted as the tracking point H1 (i.e., the tongue) moving to the left, or when When the time is right, it is interpreted as tracking point H1 (i.e., the tongue) to the right.

此時,吸舌器H的垂直移動距離如下:At this time, the vertical movement distance of the tongue suction device H is... as follows:

以此,根據正負數值即可判讀為追蹤點H1(即舌部)上或下的方向,即當時,則判讀為追蹤點H1(即舌部)往上,或當時,則判讀為追蹤點H1(即舌部)往下。Therefore, the direction of the tracking point H1 (i.e., the tongue) can be determined by the positive or negative value. When, it is interpreted as tracking point H1 (i.e., the tongue) moving upwards, or when When the time is right, it is interpreted as tracking point H1 (i.e., the tongue) downwards.

於一實施例中,更可根據影像擷取模組1獲取影像的像素值,藉此,設定動態調整座標(Dynamic Adjustment Of Coordinates, DAC),以此將矩形區域的位置隨著影像擷取模組1進行動態調整,舉例而言,以1280x720(長寬比(Aspect ratio)為16:9)為影像擷取模組1的像素值,設定動態調整座標則為影像擷取模組1的高度像素尺寸除以720,即DAC=720/720。In one embodiment, the pixel values of the image obtained by the image capturing module 1 can be used to set dynamic adjustment of coordinates (DAC) so that the position of the rectangular area can be dynamically adjusted with the image capturing module 1. For example, if the pixel value of the image capturing module 1 is 1280x720 (with an aspect ratio of 16:9), the dynamic adjustment coordinates are set to the height pixel size of the image capturing module 1 divided by 720, i.e., DAC = 720/720.

於一實施例中,更可以根據座標映射公式取決於最終映射於顯示器的區域尺寸,如圖6B所示,以X座標軸為例,假設最終映射範圍的左上角座標為以及最終映射範圍的右下角座標為,當顯示器的顯示像素值為1080p時,則計算公式如下:In one embodiment, the coordinate mapping formula can be used to determine the final size of the area mapped to the display, as shown in Figure 6B. Taking the X-axis as an example, let's assume the coordinates of the upper left corner of the final mapped area are... And the coordinates of the lower right corner of the final mapping range are When the display resolution is 1080p, the calculation formula is as follows:

如圖6C所示,以Y座標軸為例,則計算公式如下:As shown in Figure 6C, taking the Y-axis as an example, the calculation formula is as follows:

於一實施例中,更可以將上述步驟所獲取之辨識資料執行迴歸分析,首先,辨識模組2獲取第一舌肌運動影像、輪廓資訊、座標值及第一位置資訊進行迴歸分析,以此,產生對應之分析結果,而後,則可使辨識模組2以此一分析結果判定其所獲取之第二舌肌運動影像其中之舌部所對應之第二位置資訊,但不在此限。In one embodiment, the identification data obtained in the above steps can be subjected to regression analysis. First, the identification module 2 acquires the first tongue muscle movement image, contour information, coordinate values and first position information for regression analysis, thereby generating corresponding analysis results. Then, the identification module 2 can use this analysis result to determine the second position information corresponding to the tongue in the second tongue muscle movement image it has acquired, but this is not limited to this.

為更詳細說明本實施例之作動方式,具體舉例說明如下:To illustrate the operation of this embodiment in more detail, specific examples are provided below:

以復健模組4提供復健任務,其中,復健任務可分為舌部之左右復健、上下復健或繞環復健,復健任務可以遊戲模式呈現,使用者可設置吸舌器H於舌部,並經由影像擷取模組1獲取舌部之舌肌運動影像後,由辨識模組2辨識吸舌器H之追蹤點H1位置,以產生舌部對應之位置資訊,以此,判定追蹤點H1(即舌部)移動方向,例如: 左右、上下及繞環,同時,判讀移動距離,以此透過控制模組3根據第一位置資訊控制虛擬物件移動,此時,即可根據復健任務的需求移動舌部,使虛擬物件對應舌部移動,以完成對應的復健任務。Rehabilitation module 4 provides rehabilitation tasks, which can be divided into left-right, up-down, or circular tongue rehabilitation. The rehabilitation tasks can be presented in a game mode. The user can set the tongue suction device H on the tongue, and after the image capture module 1 obtains the tongue muscle movement image, the recognition module 2 identifies the tracking point H1 of the tongue suction device H to generate the corresponding position information of the tongue. Based on this, the direction of movement of the tracking point H1 (i.e., the tongue) is determined, such as left-right, up-down, and circular. At the same time, the movement distance is read. Based on the first position information, the control module 3 controls the movement of the virtual object. At this time, the tongue can be moved according to the needs of the rehabilitation task, so that the virtual object moves accordingly to complete the corresponding rehabilitation task.

綜上所述,本發明之一實施例之舌部追蹤方法及其舌肌復健系統,透過影像辨識獲取吸舌器上之追蹤點 (即舌部)位置,並結合復健任務,大幅提升舌肌復健的互動性,並且不局限於空間或設備,即便使用者在復健過程中移動頭部,仍可以精準的獲取舌部位置,並辨識其舌部運動方向,大幅提高復健成效。In summary, the tongue tracking method and tongue muscle rehabilitation system of one embodiment of the present invention obtain the position of the tracking point (i.e., the tongue) on the tongue suction device through image recognition, and combined with rehabilitation tasks, greatly enhances the interactivity of tongue muscle rehabilitation. Moreover, it is not limited by space or equipment. Even if the user moves his head during the rehabilitation process, the tongue position can still be accurately obtained and the direction of tongue movement can be identified, which greatly improves the rehabilitation effect.

惟以上所述者,僅為本發明之較佳實施例而已,當不能以此限定本發明實施之範圍,即凡依本發明申請專利範圍及發明說明內容所作之簡單的等效變化與修飾,皆仍屬本發明專利涵蓋之範圍內。However, the above description is merely a preferred embodiment of the present invention and should not be used to limit the scope of the present invention. Any simple equivalent changes and modifications made in accordance with the scope of the patent application and the description of the invention shall still fall within the scope of the present invention.

1:影像擷取模組2:辨識模組3:控制模組4:復健模組H:吸舌器H1:追蹤點S:舌肌復健系統S1:步驟S2:步驟S3:步驟S4:步驟S5:步驟S6:步驟S7:步驟S8:步驟S9:步驟1: Image Acquisition Module 2: Recognition Module 3: Control Module 4: Rehabilitation Module H: Tongue Suction Device H1: Tracking Point S: Tongue Muscle Rehabilitation System S1: Step S2: Step S3: Step S4: Step S5: Step S6: Step S7: Step S8: Step S9: Step

圖1: 其為本發明之一實施例之方法流程圖;圖2: 其為本發明之一實施例之系統示意圖;圖3: 其為本發明之一實施例之實施示意圖;圖4: 其為本發明之一實施例之實施示意圖;圖5: 其為本發明之一實施例之實施示意圖;圖6A: 其為本發明之一實施例之實施示意圖;圖6B: 其為本發明之一實施例之實施示意圖;及圖6C: 其為本發明之一實施例之實施示意圖。Figure 1: A flowchart illustrating a method according to an embodiment of the present invention; Figure 2: A system diagram according to an embodiment of the present invention; Figure 3: An implementation diagram according to an embodiment of the present invention; Figure 4: An implementation diagram according to an embodiment of the present invention; Figure 5: An implementation diagram according to an embodiment of the present invention; Figure 6A: An implementation diagram according to an embodiment of the present invention; Figure 6B: An implementation diagram according to an embodiment of the present invention; and Figure 6C: An implementation diagram according to an embodiment of the present invention.

S1:步驟 S1: Steps

S2:步驟 S2: Steps

S3:步驟 S3: Steps

S4:步驟 S4: Steps

S5:步驟 S5: Steps

S6:步驟 S6: Steps

S7:步驟 S7: Steps

S8:步驟 S8: Steps

S9:步驟 S9: Steps

Claims (10)

一種舌部追蹤方法,步驟包含:於一舌部設置一吸舌器,該吸舌器設有一追蹤點;獲取該舌部之一第一舌肌運動影像;轉換該第一舌肌運動影像之一色彩空間;篩選該色彩空間之一指定色彩數值,以產生一篩選結果;以該篩選結果進行影像分析,產生複數個區域影像形狀;判定該些個區域影像形狀,產生對應於該追蹤點之一目標物件;根據該目標物件繪製對應之一輪廓資訊;辨識該輪廓資訊之一座標值;及運算該座標值,以產生該舌部對應之一第一位置資訊。A tongue tracking method includes the following steps: installing a tongue suction device on a tongue, the suction device having a tracking point; acquiring a motion image of a first tongue muscle on the tongue; converting a color space of the first tongue muscle motion image; filtering a specified color value in the color space to generate a filtering result; performing image analysis on the filtering result to generate a plurality of regional image shapes; determining the regional image shapes to generate a target object corresponding to the tracking point; drawing corresponding contour information based on the target object; identifying a coordinate value of the contour information; and calculating the coordinate value to generate a first position information corresponding to the tongue. 依據請求項1所述之舌部追蹤方法,於判定該些個區域影像形狀,產生對應於該追蹤點之一目標物件之步驟中,分別提取該些個區域影像形狀之一參數值,並計算每一區域影像形狀之一面積值及一周長,根據該面積值及該周長生成對應之一擬合橢圓,根據該擬合橢圓計算一橢圓軸比及一圓度數值,根據該橢圓軸比及圓度數值判定該目標物件。According to the tongue tracking method described in claim 1, in the step of determining the shape of the regional images and generating a target object corresponding to the tracking point, a parameter value of the shape of the regional images is extracted respectively, and an area value and a perimeter of each regional image shape are calculated. A corresponding fitted ellipse is generated based on the area value and the perimeter. An ellipse axis ratio and a roundness value are calculated based on the fitted ellipse. The target object is determined based on the ellipse axis ratio and the roundness value. 依據請求項2所述之舌部追蹤方法,於辨識該輪廓資訊之一座標值之步驟中,該輪廓資訊係於對應該目標物件之該擬合橢圓及對應該擬合橢圓之一外切矩形,辨識該擬合橢圓及該外切矩形之該座標值,該座標值包含該擬合橢圓之一中心點座標值及該外切矩形之一第一座標值及一第二座標值。According to the tongue tracking method described in claim 2, in the step of identifying a coordinate value of the contour information, the contour information is the approximate ellipse corresponding to the target object and a circumscribed rectangle corresponding to the approximate ellipse, and the coordinate value of the approximate ellipse and the circumscribed rectangle is identified. The coordinate value includes the coordinate value of the center point of the approximate ellipse and a first coordinate value and a second coordinate value of the circumscribed rectangle. 依據請求項1所述之舌部追蹤方法,包含步驟:以該第一舌肌運動影像、該輪廓資訊、該座標值及該第一位置資訊執行一迴歸分析,產生一分析結果;輸入一第二舌肌運動影像;及以該分析結果判定該第二舌肌影像中之該追蹤點之一第二位置資訊。The tongue tracking method according to claim 1 includes the following steps: performing a regression analysis on the first tongue muscle motion image, the contour information, the coordinate value and the first position information to generate an analysis result; inputting a second tongue muscle motion image; and determining a second position information of the tracking point in the second tongue muscle image based on the analysis result. 依據請求項1所述之舌部追蹤方法,於運算該座標值,以產生該舌部對應之一第一位置資訊之步驟中,設置該舌部之一移動範圍,以該座標值及該移動範圍進行運算,以產生該第一位置資訊。According to the tongue tracking method described in claim 1, in the step of calculating the coordinate value to generate a first position information corresponding to the tongue, a range of movement of the tongue is set, and the first position information is generated by calculating the coordinate value and the range of movement. 一種舌肌復健系統,包含:一吸舌器,設置於一舌部,該吸舌器設有一追蹤點;一影像擷取模組,用以獲取該舌部之一第一舌肌運動影像;一辨識模組,與該影像擷取模組訊號連接,用以辨識該第一舌肌運動影像,以產生該舌部對應之一第一位置資訊;一控制模組,與該辨識模組訊號連接,用以根據該第一位置資訊控制一虛擬物件移動;及一復健模組,與該控制模組訊號連接,用以提供一復健任務,使該虛擬物件根據該復健任務進行移動。A tongue muscle rehabilitation system includes: a tongue suction device disposed on a tongue, the tongue suction device having a tracking point; an image capture module for acquiring an image of the movement of a first tongue muscle on the tongue; a recognition module signal-connected to the image capture module for recognizing the image of the first tongue muscle movement to generate first position information corresponding to the tongue; a control module signal-connected to the recognition module for controlling the movement of a virtual object based on the first position information; and a rehabilitation module signal-connected to the control module for providing a rehabilitation task, causing the virtual object to move according to the rehabilitation task. 依據請求項6所述之舌肌復健系統,其中,該辨識模組以該第一舌肌運動影像進行色彩空間轉換,並於篩選一指定色彩數值後進行影像分析,以產生一目標物件,以該目標物件繪製對應之一輪廓資訊,並辨識該輪廓資訊之一座標值,根據該座標值及該舌部之一移動範圍進行運算,以產生該第一位置資訊,該目標物件係對應於該吸舌器之該追蹤點。According to the tongue muscle rehabilitation system described in claim 6, the recognition module performs color space conversion on the first tongue muscle movement image, and performs image analysis after filtering a specified color value to generate a target object. The target object is used to draw a corresponding outline information, and a coordinate value of the outline information is identified. The first position information is generated based on the coordinate value and a range of movement of the tongue. The target object corresponds to the tracking point of the tongue suction device. 依據請求項7所述之舌肌復健系統,其中,該辨識模組係以篩選該指定色彩數值後產生複數個區域影像形狀,並分別提取該些個區域影像形狀之一參數值,計算每一區域影像形狀之一面積值及一周長,根據該面積值及該周長生成對應之一擬合橢圓,根據該擬合橢圓計算一橢圓軸比及一圓度數值,根據該橢圓軸比及圓度數值判定該目標物件。According to the tongue muscle rehabilitation system described in claim 7, the recognition module generates a plurality of regional image shapes after filtering the specified color values, extracts a parameter value of each regional image shape, calculates an area value and a perimeter of each regional image shape, generates a corresponding fitted ellipse based on the area value and the perimeter, calculates an ellipse axis and a roundness value based on the fitted ellipse, and determines the target object based on the ellipse axis and roundness value. 依據請求項8所述之舌肌復健系統,其中,該輪廓資訊係於對應該目標物件之該擬合橢圓及對應該擬合橢圓之一外切矩形,辨識該擬合橢圓及該外切矩形之該座標值,該座標值包含該擬合橢圓之一中心點座標值及該外切矩形之一第一座標值及一第二座標值。According to the tongue muscle rehabilitation system described in claim 8, the contour information is based on the approximate ellipse corresponding to the target object and a circumscribed rectangle corresponding to the approximate ellipse, identifying the coordinate values of the approximate ellipse and the circumscribed rectangle, the coordinate values including the coordinate value of the center point of the approximate ellipse and a first coordinate value and a second coordinate value of the circumscribed rectangle. 依據請求項7所述之舌肌復健系統,其中,該辨識模組獲取該第一舌肌運動影像、該輪廓資訊、該座標值及該第一位置資訊,以執行一迴歸分析,產生對應之一分析結果,當自該影像擷取模組獲取一第二舌肌運動影像時,該辨識模組以該分析結果判定該第二舌肌影像中之該追蹤點,以產生該舌部對應之一第二位置資訊。According to the tongue muscle rehabilitation system described in claim 7, the recognition module acquires the first tongue muscle movement image, the contour information, the coordinate value, and the first position information to perform a regression analysis and generate a corresponding analysis result. When a second tongue muscle movement image is acquired from the image extraction module, the recognition module uses the analysis result to determine the tracking point in the second tongue muscle image to generate a second position information corresponding to the tongue.
TW114109909A 2025-03-17 2025-03-17 Tracking method for tongue and its rehabilitation system for tongue muscle TWI909997B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW114109909A TWI909997B (en) 2025-03-17 2025-03-17 Tracking method for tongue and its rehabilitation system for tongue muscle
JP2025109576A JP7846849B1 (en) 2025-03-17 2025-06-27 Tongue tracking method and its tongue muscle rehabilitation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW114109909A TWI909997B (en) 2025-03-17 2025-03-17 Tracking method for tongue and its rehabilitation system for tongue muscle

Publications (1)

Publication Number Publication Date
TWI909997B true TWI909997B (en) 2025-12-21

Family

ID=98974597

Family Applications (1)

Application Number Title Priority Date Filing Date
TW114109909A TWI909997B (en) 2025-03-17 2025-03-17 Tracking method for tongue and its rehabilitation system for tongue muscle

Country Status (2)

Country Link
JP (1) JP7846849B1 (en)
TW (1) TWI909997B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200121924A1 (en) * 2018-10-17 2020-04-23 Signifier Medical Technologies Limited Oral muscle training
CN114420250A (en) * 2022-03-29 2022-04-29 西安交通大学城市学院 Rehabilitation training self-adaption method and system based on OpenCV tongue muscle movement recognition

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7602301B1 (en) * 2006-01-09 2009-10-13 Applied Technology Holdings, Inc. Apparatus, systems, and methods for gathering and processing biometric and biomechanical data
KR101672088B1 (en) * 2014-05-12 2016-11-02 인제대학교 산학협력단 Rehabilitation apparatus for dysphagia
JP2016150024A (en) * 2015-02-16 2016-08-22 コニカミノルタ株式会社 Organ imaging device
JP2017225503A (en) * 2016-06-20 2017-12-28 株式会社エフ・ウェイ Tongue movement measuring device, information processing apparatus, and program

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200121924A1 (en) * 2018-10-17 2020-04-23 Signifier Medical Technologies Limited Oral muscle training
CN114420250A (en) * 2022-03-29 2022-04-29 西安交通大学城市学院 Rehabilitation training self-adaption method and system based on OpenCV tongue muscle movement recognition

Also Published As

Publication number Publication date
JP7846849B1 (en) 2026-04-16

Similar Documents

Publication Publication Date Title
CN105719318B (en) Magic square color identification method based on HSV in a kind of Educational toy external member
CN103279191B (en) A kind of 3D virtual interacting method based on Gesture Recognition and system
CN101853286B (en) Intelligent selection method of video thumbnails
CN101966083B (en) Abnormal skin area calculation system and its calculation method
JP5801237B2 (en) Part estimation apparatus, part estimation method, and part estimation program
CN110335266B (en) Intelligent traditional Chinese medicine visual inspection image processing method and device
CN101271517A (en) Face area detection device, method and computer readable recording medium
CN107239748A (en) Robot target identification and localization method based on gridiron pattern calibration technique
CN110032932B (en) Human body posture identification method based on video processing and decision tree set threshold
CN107154058B (en) Method for guiding user to restore magic cube
JP2022098932A (en) Viewing distance estimation method, viewing distance estimation device, and viewing distance estimation program
CN106355592A (en) Educational toy suite and its circuit elements and electric wires identifying method thereof
CN101628174B (en) Automatic distortion correction extraction method of coordinates of Snooker tabletop
CN103218615A (en) Face judgment method
CN116974369B (en) Intraoperative medical imaging operation method, system, device and storage medium
JPWO2022074865A5 (en) LIFE DETECTION DEVICE, CONTROL METHOD, AND PROGRAM
CN102074017A (en) Method and device for detecting and tracking barbell central point
TWI909997B (en) Tracking method for tongue and its rehabilitation system for tongue muscle
US20160345887A1 (en) Moisture feeling evaluation device, moisture feeling evaluation method, and moisture feeling evaluation program
CN114004889B (en) Three-dimensional eyeball movement direction judging method integrating head gestures
CN114519684A (en) A pull-up counting method based on image difference
US20230169790A1 (en) Eyeball locating method, image processing device, and image processing system
CN114862765A (en) A Cell Layered Image Processing Method
CN111259683A (en) Skin detection method and image processing apparatus
CN116563375A (en) Camera-based pupil tracking method