CN109215413A - A kind of mold design teaching method, system and mobile terminal based on mobile augmented reality - Google Patents
A kind of mold design teaching method, system and mobile terminal based on mobile augmented reality Download PDFInfo
- Publication number
- CN109215413A CN109215413A CN201811103967.7A CN201811103967A CN109215413A CN 109215413 A CN109215413 A CN 109215413A CN 201811103967 A CN201811103967 A CN 201811103967A CN 109215413 A CN109215413 A CN 109215413A
- Authority
- CN
- China
- Prior art keywords
- mold
- display
- reality
- image
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to application of the mobile augmented reality in mold design teaching, disclose a kind of mold design teaching method based on mobile augmented reality, system and mobile terminal, method includes: to shoot bookish two-dimensional mold image by camera, augmented reality content information corresponding with two-dimensional mold image is recalled from server by images match, then the corresponding content in the Overlapping display augmented reality content information above the books, gesture information is obtained using gesture tracking equipment, display pattern, which is determined, according to gesture information and dispatches picture reproducer and audio playing device is accordingly shown or played.The present invention has time and economic cost saving, and classroom interactions' property, human-computer interaction are good, and student can be helped to construct three-dimensional thinking, rapidly enters learning state, all-dimensional multi-angle learns mold design, the advantages of improving learning efficiency.
Description
Technical field
The present invention relates to application of the mobile augmented reality in mold design teaching, more particularly to one kind is based on mobile enhancing
Mold design teaching method, system and the mobile terminal of reality.
Background technique
Mold design is a core trunk class of Vocational Colleges material shaping and control engineering specialty (mold direction)
Journey.The flowing law of curriculum requirements students mould structure, Sheet metal forming can correctly design general stamping die
Tool, and the judgement being in the main true is made to the defect often occurred in punching production.Teaching efficiency quality directly affects subsequent each
The height of teaching link quality, therefore the learning initiative and initiative of student how are excited, mold design ability is improved, is religion
Key.
Traditional teaching technique be by study textbook on mold two dimension cross-sectional view, meanwhile, in conjunction with teacher explain, make to learn
Autonomous complete design process after the raw effect for grasping mould inside structure, composition and each components.Right actual conditions are that student does not have
There is mold perceptual recognition, and each component part understanding whole to mold is shallower, cannot immediately enter role, learning efficiency is low.
With the progress of science and technology, mold design educational aid has also obtained promotion functionally, such as production two dimension
Flash animation, video and by CAD software carry out three-dimensional modeling after comprehensive displaying impart knowledge to students.For another example by a set of
Complicated and expensive equipment imports the method that study scene carries out immersive VR study, this method by three-dimensional modeling
Before the threedimensional model of mold comprehensively capable of being presented in Eyes of Students, so that I shall appreciate it as a personal favour, with deep impression by student, study effect is improved
Rate；But student need to wear bulky wear-type display screen when imparting knowledge to students, and experience as immersion, lack on classroom and textbook and teacher
Interaction, and use for a long time is easy to produce dizziness and fatigue symptom；In addition, being equipped with equipment set somewhat expensive, it is unfavorable for
It promotes, and when source of students is more, and wear-type display screen is again less, student can only be grouped in batches to learn, when considerably increasing
Between cost.For another example " AR augmented reality tutoring system " disclosed in patent document of the notification number for CN206115752U, including set
The teaching material that is equipped with two dimensional image, for identification two dimensional image and the use that two dimensional image is converted to three-dimensional animation and played in teaching material
Family terminal, the user terminal include for acquiring the image capture module of two dimensional image in teaching material, being stored with several X-Y schemes
The memory module of picture and three-dimensional animation, for identification identification module of the collected two dimensional image of image capture module are used for root
According to identification module recognition result to play the playing module of three-dimensional animation image information in memory module, for playing three-dimensional animation
The sound module of sound intermediate frequency information, the control module for being controlled, the control module and image capture module, storage mould
Block, identification module, playing module, sound module electrical connection are to be controlled.The study of immersion is got rid of, close friend can be facilitated
Show three-dimensional animation on the subscriber terminal for student, excite students ' interest of study, improve learning efficiency, but user terminal need to be deposited
Several two dimensional images and three-dimensional animation are stored up, when needing identification learning two dimensional image numerous in teaching material, is easy to occupy user terminal
Amount of storage, other for being unfavorable for user terminal routinely use, and mold are only understood from animation, really few deeply connecing with mold
Touching, not vivid enough, study floats on surface.
Summary of the invention
The technical problem to be solved by the present invention is in view of the above shortcomings of the prior art, provide a kind of time and economic cost
It saves, it is interactive good, student can be helped to rapidly enter learning state, all-dimensional multi-angle learns mold design, improves study
Mold design teaching method, system and the mobile terminal based on mobile augmented reality of efficiency.
To achieve the goals above, the technical solution adopted by the present invention are as follows:
A kind of mold design teaching method based on mobile augmented reality, comprising the following steps:
S10: the real mold image of identification camera shooting extracts the characteristic value of the real mold image；The reality mould
Having image includes bookish two-dimensional mold image；
S20: transferring sample mold image in presetting database to server request, and by the feature of the real mold image
Value carries out characteristic matching with the sample mold image, if successful match, transfers and the matched sample mould to server request
Has a corresponding augmented reality content information of image, the augmented reality content information includes that mold complete three-dimensional model, mold cut open
Depending on threedimensional model, components explanation audio-video and operation interface；
S30: spatial position and direction of the reality mold image described in reality scene with respect to picture reproducer are calculated, according to real field
Reality mold image described in scape dispatches the picture reproducer in reality scene with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image；
S40: obtaining the gesture information in the operation interface using gesture tracking equipment, is determined and is shown according to the gesture information
Mode simultaneously dispatches the picture reproducer and audio playing device and is accordingly shown or played；The display pattern includes in display
Appearance, angles of display and display scale.
In actual life, mobile terminal (such as mobile phone or plate) almost manpower one, and it is powerful based on existing mobile terminal
Operating system, camera function and network interdynamic performance, the above method completely can be using mobile terminal as carrier, with imaging
Equipment and the cooperation of gesture tracking equipment, execute all steps, in this way, be conducive to save part economic expenditure；Further, since
Mobile terminal is easy to carry, and student opens mold design study class in the environment for being equipped with picture reproducer and gesture tracking equipment
This, corresponding mold stereoscopic three-dimensional model (including overview, cross-sectional view) can be realized on books in the picture scanned on textbook
The vivid displaying of Fang Liti helps student to rapidly enter compared to only showing to be more advantageous in the screen of mobile terminal
Habit state, all-dimensional multi-angle learn mold design, improve learning efficiency, while also not interfering the interaction between teacher and student
Teaching；In addition to this, gesture tracking equipment can track the gesture motion of student, and determine display pattern simultaneously according to gesture motion
It dispatches the picture reproducer and audio playing device accordingly to be shown or played, the display pattern includes display content, shows
Show angle and display scale；Be conducive to increase the inquiry learning that interacts between student and the mold threedimensional model of display, deepen to learn
Raw impression, further promotes learning effect.
Further, the step S40 further include: display state is determined according to the gesture information and dispatches the imaging
Equipment and audio playing device accordingly shown or played, the display state include play, pause, acceleration or deceleration.
Further, further comprising the steps of between the step S20 and step S30:
S21: prompt user chooses display mode, and the display mode includes Overlapping display, throws screen display and the display of this screen, when
When user chooses Overlapping display, step S30 and step S40 is just successively executed.
A kind of mold design tutoring system based on mobile augmented reality, comprising:
It identifies extraction module, for identification the real mold image of camera shooting, extracts the feature of the real mold image
Value；
Matching module is transferred, for transferring sample mold image in presetting database to server request, and by the reality
The characteristic value of mold image and the sample mold image carry out characteristic matching, if successful match, transfer to server request
Augmented reality content information corresponding with the matched sample mold image, the augmented reality content information include mold complete three
Dimension module, mold section view threedimensional model, components explanation audio-video and operation interface；
Scheduler module is calculated, for calculating spatial position and side of reality mold image described in reality scene with respect to picture reproducer
To the reality mold image according to reality scene dispatches the picture reproducer with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image described in reality scene；
Human-computer interaction module, for obtaining the gesture information in the operation interface using gesture tracking equipment, according to the hand
Gesture information determines display pattern and dispatches the picture reproducer and audio playing device and accordingly shown or played；The display
Mode includes display content, angles of display and display scale.
Further, the human-computer interaction module is also used to according to the gesture information determines display state and dispatches
Picture reproducer and audio playing device accordingly shown or played, and the display state includes playing, suspend, accelerate or subtracting
Speed.
It further, further include cue module, for prompting user to choose display mode, the display mode includes superposition
Screen display and the display of this screen are thrown in display.
Further, the matching module of transferring includes:
Unit is transferred in first request, for transferring the sample mold image in presetting database to server request；
Matching unit, for the characteristic value of the real mold image and the sample mold image to be carried out characteristic matching；
Unit is transferred in second request, for being transferred and the matched sample after the matching unit successful match to server request
The corresponding augmented reality content information of mold image, the augmented reality content information include mold complete three-dimensional model, mold
Section view threedimensional model, components explanation audio-video and operation interface.
Further, the calculating scheduler module includes:
Computing unit, for calculating spatial position and direction of reality mold image described in reality scene with respect to picture reproducer；
Scheduling unit, spatial position and direction tune for the reality mold image according to reality scene with respect to picture reproducer
Spend picture reproducer augmented reality content information described in Overlapping display above the reality mold image described in reality scene.
A kind of mobile terminal, comprising:
Camera, for shooting real mold image；
It identifies extraction module, for identification the real mold image of the camera shooting, extracts the real mold image
Characteristic value；
Matching module is transferred, for transferring sample mold image in presetting database to server request, and by the reality
The characteristic value of mold image and the sample mold image carry out characteristic matching, if successful match, transfer to server request
Augmented reality content information corresponding with the matched sample mold image, the augmented reality content information include mold complete three
Dimension module, mold section view threedimensional model, components explanation audio-video and operation interface；
Scheduler module is calculated, for calculating spatial position and side of reality mold image described in reality scene with respect to picture reproducer
To the reality mold image according to reality scene dispatches the picture reproducer with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image described in reality scene；
Human-computer interaction module, for obtaining the gesture information in the operation interface using gesture tracking equipment, according to the hand
Gesture information determines display pattern and dispatches the picture reproducer and audio playing device and accordingly shown or played；The display
Mode includes display content, angles of display and display scale.
Further, further includes:
Cue module, for prompting user to choose display mode, the display mode includes Overlapping display, throwing screen is shown and this
Screen display.
After adopting the above technical scheme, the beneficial effects of the present invention are: by identifying bookish two-dimensional real mold
Image finally transfers out corresponding augmented reality content information (including mold complete three-dimensional model, mold section view from server end
Threedimensional model, components explanation audio-video and operation interface), and Overlapping display comes out above books in three-dimensional form,
Be conducive to student and construct three-dimensional thinking, rapidly enter learning state, all-dimensional multi-angle learns mold design；
Display pattern is determined by gesture tracking equipment, is changed corresponding display content, angles of display and display scale, is able to achieve
Real-time interactive, it is more intuitive three-dimensionally to show mold threedimensional model and related audio-video；
The carrier of scheduling is obtained and three-dimensionally shown as augmented reality content information using mobile terminal, easy to carry, study
It is convenient, be conducive to save economic cost and learning time cost；
Display mode (including Overlapping display, the display of throwing screen and the display of this screen) step is chosen by setting prompt user, favorably
In completing to show according to the actual displayed demand of user, practicability is enhanced, allows user in a variety of different actual environments
Under the conditions of rational allocation mode of learning.
Detailed description of the invention
In order to illustrate the embodiments of the present invention more clearly or the technical solution of the prior art, attached drawing are as follows:
Fig. 1 is a kind of mold design teaching method flow chart based on mobile augmented reality that the embodiment of the present invention 1 provides；
Fig. 2 is a kind of preferred mold design teaching method flow chart based on mobile augmented reality of the embodiment of the present invention 2；
Fig. 3 is a kind of mold design teaching based on mobile augmented reality under the embodiment that the embodiment of the present invention 3 provides
System block diagram；
Fig. 4 is a kind of mold design religion based on mobile augmented reality under the preferred embodiment that the embodiment of the present invention 3 provides
Learn system block diagram.
Specific embodiment
Following is a specific embodiment of the present invention in conjunction with the accompanying drawings, technical scheme of the present invention will be further described,
However, the present invention is not limited to these examples.
Embodiment 1
As shown in Figure 1, the present embodiment provides a kind of mold design teaching method based on mobile augmented reality, can be developed to
Software APP is applied to mobile terminal (mobile phone or plate), method the following steps are included:
S10: the real mold image of identification camera shooting extracts the characteristic value of the real mold image；The reality mould
Having image includes bookish two-dimensional mold image；
Before this step, mobile terminal is first using the included bookish real mold image of camera scanning shoot, then
In this step, mobile terminal can identify the real mold image, extract the characteristic value of the real mold image；Specifically,
Corresponding software APP can be developed based on Vuforia SDK.The key characteristic of Vuforia includes to picture, object, text and mark
The identification and tracking of note, and rebuild environment.Vuforia5.5 version is more the introduction of the branch of correct portion's rotation and gesture tracking
It holds, while being also equipped with the three-dimensional rendering capability with distortion correction, allow it normal in the AR/VR application on digital eyes
Operation.
S20: transferring sample mold image in presetting database to server request, and by the real mold image
Characteristic value and the sample mold image carry out characteristic matching, if successful match, transfer and the matching sample to server request
The corresponding augmented reality content information of this mold image, the augmented reality content information include mold complete three-dimensional model, mould
Have section view threedimensional model, components explanation audio-video and operation interface；
The mold Complete three-dimensional mould of sample mold image Yu augmented reality content information is stored in the presetting database of server
Type, mold section view threedimensional model, components explain the one-to-one data of audio-video, such as sample mold image is stamping die
It is complete then to store stamping die A corresponding with the two-dimentional standard drawing of stamping die A for the two-dimentional standard drawing of A in presetting database
Whole threedimensional model, stamping die A section view threedimensional model and inner components explain audio-video, or even can also include stamping die
Has the three-dimensional explosive view of A, it may include the title to components, effect and the explanation of design standard that components, which explain audio-video,.
Operation interface is then that independent storage is a, because the layout that server returns to the operation interface of mobile terminal can not be because
The difference of mold and it is different.
Specifically, in step S20, mobile terminal sends the sample mold image transferred in presetting database to server
Request, server receive request, return to all sample mold image in presetting database, and mobile terminal is by the real mold
The characteristic value of image and all sample mold images carry out characteristic matching one by one, successful match will again to server request with
The corresponding augmented reality content information of the matched sample mold image.
The technology that step S10 and step S20 are mainly applied to is exactly image recognition and data communication, general image recognition
Including image input, pretreatment, feature extraction and images match, this has more mature in existing mobile augmented reality technology
Utilization, therefore in this not go into detail, and in the prior art, mobile terminal obtains corresponding augmented reality content letter to server
Using directly in such a way that mobile terminal screen output plays, realization is to reality mold image described in camera view after breath
Enhancing.The present embodiment is different from above-mentioned technology, is additionally provided with following steps:
S30: spatial position and direction of the reality mold image described in reality scene with respect to picture reproducer are calculated, according to real field
Reality mold image described in scape dispatches the picture reproducer in reality scene with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image；
In this step, calculate reality scene described in reality mold image with respect to picture reproducer spatial position and direction, be for
Control picture reproducer finally being capable of accurate reality described in augmented reality content information to reality scene described in Overlapping display
Above mold image, thus help user (student or teacher) building to the sense organ of three-dimensional mold on a corresponding position, and
The learning Content for understanding detail parameters effect of each components in mold etc. in depth is provided, student can be helped to rapidly enter study
State, all-dimensional multi-angle learn mold design, and multi-angle herein does not refer to the different angles of display of mold, but the increasing
Different angle that strong real content information is embodied, such as section view three-dimensional figure, components explanation animation etc..Picture reproducer can be complete
Cease projector, it is emphasized that, as technology develops, in the case where conditions permit, micro projection is can be set into projector
Instrument is installed to mobile terminal, so as to allow users to show respective mode on books using mobile terminal anywhere or anytime
The three-dimensional model of tool；Without being limited to be equipped with the places such as the classroom of picture reproducer.
Specifically, spatial position and direction of the reality mold image described in reality scene with respect to picture reproducer are calculated, just
Be the process positioned to target scene display position, under a kind of embodiment, following calculating process can be passed through: it is mobile eventually
End obtains spatial position and direction of its own camera with respect to picture reproducer first；Then the opposite imaging of itself camera is obtained
In equipment reality scene on books real mold image spatial position and direction；Finally seat is built using two above-mentioned parameters
Mark system calculates spatial position and direction of the reality mold image described in reality scene with respect to picture reproducer.
Obtaining its own camera can be fixed by optical system positioning, GPS with respect to the spatial position of picture reproducer and direction
A variety of location technologies such as position, ultrasonic wave positioning, gyroscope positioning and Magnetic oriented can also be shot by camera and be based on calculating
Machine vision calculates；Obtain spatial position of itself camera with respect to mold image real on books in picture reproducer reality scene
With direction most directly, the mode of low cost be exactly real mold image while to obtain reality on the shooting books by camera
The depth of view information of mold image；I.e. setting mobile terminal itself camera is depth of field camera.
Under another embodiment, picture reproducer is set to mobile terminal and is merged with camera, Tracing Registration technology is utilized
Obtain in reality scene on books real mold image the coordinate of reality scene coordinate system be picture reproducer need to project it is aobvious
The display position shown, tracking technique are mainly manifested in the camera coordinates system and reality scene coordinate system of mobile terminal itself camera
Between transformation relation；Registration technology is mainly manifested in position appearance of detection mobile terminal itself camera relative to reality scene
State and deflection, it is final to determine display of the augmented reality content information in reality scene according to the parameter that tracking technique obtains
Position will realize that augmented reality content information merges (enhancing with the seamless of reality scene since mobile terminal is mobile equipment
Real content information changes with the mobile simultaneous display of mobile terminal), it is also necessary to real-time tracking reality scene, and accurately complete
Good registration process, compares embodiment above-mentioned, and technical difficulty is relatively large.
S40: obtaining the gesture information in the operation interface using gesture tracking equipment, is determined according to the gesture information
Display pattern and dispatch the picture reproducer and audio playing device accordingly shown or played (wherein, display be picture and text
Display plays the broadcasting of as sound or video, similarly hereinafter)；The display pattern includes display content, angles of display and display
Ratio.Such as: the virtual push button of " section view " printed words is clicked in the operation interface, then shows mold section view threedimensional model, is clicked
" threedimensional model " printed words virtual push button then returns to mold complete three-dimensional model, clicks a certain of the mold complete three-dimensional model of display
Components then start to play components explanation audio-video, explain title, effect and design standard of the part etc.；Pass through gesture
Single finger or both hands refer to sliding in the operation interface, are rotated accordingly or Zoom display.
Step S40 makes the present embodiment be not limited solely to show and play, moreover it is possible to the three-dimensional mold model of display into
Row interaction inquiry learning carries out the behaviour such as click of gesture motion or virtual option in the operation interface that user can show above books
Make, and the process for the operations such as clicking of gesture motion or virtual option can be obtained one by one by gesture tracking equipment and be sent to movement
Terminal is interpreted, and is finally determined that display pattern, display pattern include display content, angles of display and display scale, is shown content
It include: complete three-dimensional model, mold section view threedimensional model, components explanation audio-video, explosive view etc.；The main table of angles of display
Sign is the user oriented angle of threedimensional model；Display scale is characterized primarily by the whole size of threedimensional model.
To sum up, the present embodiment is by almost manpower one mobile terminal (such as mobile phone or plate) in actual life, by
The powerful operating system of mobile terminal, camera function and network interdynamic performance, with picture reproducer, audio playing device and gesture
Tracking equipment cooperation, executes above-mentioned all steps, in this way, be conducive to save part economic expenditure；Further, since mobile whole
Hold it is easy to carry, student be equipped with picture reproducer, audio playing device and gesture tracking equipment environment in, open mold design
Learn textbook, the picture on scanning textbook can be realized corresponding mold stereoscopic three-dimensional model (including overview, cross-sectional view) and exist
The vivid displaying of books top perspective helps student quick compared to only showing to be more advantageous in the screen of mobile terminal
Into learning state, all-dimensional multi-angle (section view angle, whole angle, parts title effect etc.) study mold design is mentioned
High learning efficiency, while the interactive teaching between teacher and student is not interfered yet；In addition to this, gesture tracking equipment can track
The gesture motion of student, and display pattern is determined according to gesture motion, realize the selection of different display contents, different angles of display
Transformation and display scale scaling, be conducive to increase between student and the mold threedimensional model of display and interact inquiry learning,
Deepen student's impression, further promotes learning effect.It solves under some teaching methods in the prior art, student does not have mold sense
Property cognition or economic cost, time cost expend big, interact few problem with teacher, textbook and mold.
Embodiment 2
The present embodiment the difference from embodiment 1 is that, the step S40 further include: according to the gesture information determine display shape
State simultaneously dispatches the picture reproducer and audio playing device and is accordingly shown or played, and the display state includes playing, temporarily
Stop, acceleration or deceleration.Above-mentioned design is so that teacher can stop the broadcasting of audio-video, explain the puzzle for student in the gap of explanation；So that
Student can adjust display state according to itself study ability to accept and study schedule, learn on demand.
As shown in Fig. 2, further comprising the steps of between the step S20 and step S30:
S21: prompt user chooses display mode, and the display mode includes Overlapping display, throws screen display and the display of this screen, when
When user chooses Overlapping display, step S30 and step S40 is just successively executed.
In this step, mobile terminal prompts user to choose display mode, and the mode of prompt can be for voice prompting or in movement
Text importing on terminal screen；When voice prompting, user speech input can be prompted to want the display mode chosen, it is defeated to voice
Enter to terminate, identify particular content and enters corresponding display mode；When text importing, can occur prompting frame on mobile terminal screen
With selection item, chooses and finish to user, execute corresponding display mode.Display mode includes but is not limited to Overlapping display, throws screen
Display and the display of this screen then follow the steps the relevant operation in S30 and step S40 if result is Overlapping display, and completion increases
Strong stereoscopic display of the real content information above reality scene books；If result is to throw screen display, in mobile terminal screen
The equipment that can carry out throwing screen broadcasting in upper display current environment is chosen for user, and selection terminates can be by augmented reality content information
Screen is thrown to relevant device；If result is the display of this screen, augmented reality content information is directly shown on mobile terminal screen.It throws
Screen display and the display of this screen, have explanation deep in more detail, therefore details are not described herein again in the prior art.
The setting of this step is conducive to complete to show according to the actual displayed demand of user, enhances practicability, so that with
Family can under the conditions of a variety of different actual environments rational allocation mode of learning.For example, when user be student, in the bedroom in want
Study, but be not desired to bother other same class hours, it can choose the display of this screen, when student is equipped with picture reproducer, sound broadcasting
In the environment of equipment and gesture tracking equipment, it is desirable to when closely deep study understands mold design, it is aobvious that superposition may be selected
Show；When user is teacher, when needing to carry out mold design teaching, Overlapping display can be selected or throw screen display two ways.
Embodiment 3
As shown in figure 3, the present embodiment provides a kind of mold design tutoring system based on mobile augmented reality, the present embodiment are
System is for the support of 2 the method for embodiment 1 and embodiment；Include:
It identifies extraction module 100, for identification the real mold image of camera shooting, extracts the spy of the real mold image
Value indicative；
Matching module 200 is transferred, for transferring the sample mold image in presetting database to server request, and will be described existing
The characteristic value of real mold image and the sample mold image carry out characteristic matching, if successful match, request to adjust to server
Augmented reality content information corresponding with the matched sample mold image is taken, the augmented reality content information includes that mold is complete
Threedimensional model, mold section view threedimensional model, components explanation audio-video and operation interface；
Scheduler module 300 is calculated, for calculating spatial position of reality mold image described in reality scene with respect to picture reproducer
And direction, the reality mold image according to reality scene dispatch the imaging with respect to the spatial position of picture reproducer and direction
Equipment augmented reality content information described in Overlapping display above the reality mold image described in reality scene；
Human-computer interaction module 400, for obtaining the gesture information in the operation interface using gesture tracking equipment, according to described
Gesture information determines display pattern and dispatches the picture reproducer and audio playing device and accordingly shown or played；It is described aobvious
Show that mode includes display content, angles of display and display scale.
And specifically, it is preferable to identify extraction module 100, matching module 200 is transferred, calculates scheduler module 300 and man-machine friendship
Mutual module 400 is respectively integrated in same application (APP) with software design scheme, for student in oneself portable shifting
It is installed on dynamic terminal (mobile phone or tablet computer), then by opening the APP installed on mobile phone or tablet computer, into main boundary
Face, the bookish mold two dimensional image of scanning shoot, after a series of processing, the final corresponding mould X-Y scheme on the books
360 ° of fusions show the related threedimensional model of the mold above the position of picture, in addition, can also carry out three-dimensional mould by gesture operation
The rotation of type, scaling.
Further, the human-computer interaction module 400 is also used to determine display state according to the gesture information and dispatch
The picture reproducer and audio playing device accordingly shown or played, the display state include play, pause, accelerate or
Slow down.So that user can also be shown by the broadcasting that gesture operation controls augmented reality content information, static status display, accelerated or subtracted
Speed display, and then realize that teacher explains the puzzle and explain the pause of the augmented reality content information audio and video playing of interactive process, it realizes not
The purpose of corresponding skill learning is carried out with the user of study ability to accept, study schedule.
Preferably, as shown in figure 4, further including cue module 500, for prompting user to choose display mode, the display
Mode includes Overlapping display, throws screen display and the display of this screen.Detailed process is referring to corresponding to the content in embodiment 2.It needs
, it is emphasized that calculating scheduler module when cue module 500 receives the display mode that user's selective stacking is shown
300 and human-computer interaction module 400 can just execute relevant device (picture reproducer, audio playing device and gesture tracking equipment)
It opens or dispatches, to play the role of to a certain extent energy-efficient.
Preferably, as shown in figure 4, the matching mould 200 of transferring includes:
Unit 210 is transferred in first request, for transferring the sample mold image in presetting database to server request；
Matching unit 220, for the characteristic value of the real mold image and the sample mold image to be carried out characteristic matching；
Unit 230 is transferred in second request, for being transferred and this after 220 successful match of matching unit to server request
With the corresponding augmented reality content information of sample mold image, the augmented reality content information includes mold Complete three-dimensional mould
Type, mold section view threedimensional model, components explanation audio-video and operation interface.
The calculating scheduler module 300 includes:
Computing unit 310, for calculating spatial position and side of reality mold image described in reality scene with respect to picture reproducer
To；
Scheduling unit 320, spatial position and side for the reality mold image according to reality scene with respect to picture reproducer
Believe to augmented reality content described in Overlapping display above picture reproducer reality mold image described in reality scene is dispatched
Breath.
Embodiment 4
The present embodiment provides a kind of mobile terminals, and the method for realizing that embodiment 1 and embodiment 2 are mentioned can be applied to by user,
Include:
Camera, for shooting real mold image；The preferred binocular camera of camera.
It identifies extraction module, for identification the real mold image of the camera shooting, extracts the real die drawing
The characteristic value of picture；
Matching module is transferred, for transferring sample mold image in presetting database to server request, and by the reality
The characteristic value of mold image and the sample mold image carry out characteristic matching, if successful match, transfer to server request
Augmented reality content information corresponding with the matched sample mold image, the augmented reality content information include mold complete three
Dimension module, mold section view threedimensional model, components explanation audio-video and operation interface；
Scheduler module is calculated, for calculating spatial position and side of reality mold image described in reality scene with respect to picture reproducer
To the reality mold image according to reality scene dispatches the picture reproducer with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image described in reality scene；
Human-computer interaction module, for obtaining the gesture information in the operation interface using gesture tracking equipment, according to the hand
Gesture information determines display pattern and dispatches the picture reproducer and audio playing device and accordingly shown or played；The display
Mode includes display content, angles of display and display scale.
Memory module, for storing data；Including but not limited to scratch pad memory, SD card etc..
Further, further includes:
Cue module, for prompting user to choose display mode, the display mode includes Overlapping display, throwing screen is shown and this
Screen display.The mode of prompt can be voice prompting or text importing on the screen.
It is emphasized that identify extraction module, transfer matching module, calculate scheduler module, human-computer interaction module and
Cue module can be hardware module of the patch with corresponding function of hardware design composition on mobile terminal circuit plate,
It can be that composition is write by program code and store software module in a storage module, and the utilization of the software need to pass through tune
Respective function is completed with the internal corresponding hardware module of existing mobile terminal (mobile phone and tablet computer) in the prior art, because
This, if above-mentioned module is written as program code, the mobile terminal of the present embodiment should have mobile phone or plate on existing market
The basic hardware of bare machine is equipped with.
Specific embodiment described herein is only an example for the spirit of the invention, and is not to the present invention
Embodiment restriction.For those of ordinary skill in the art, it can also make on the basis of the above description
Other various forms of variations or variation.There is no necessity and possibility to exhaust all the enbodiments.Skill belonging to the present invention
The technical staff in art field can make various modifications or additions to the described embodiments or using similar side
Formula substitution, however, it does not deviate from the spirit of the invention or beyond the scope of the appended claims.
Claims (10)
1. a kind of mold design teaching method based on mobile augmented reality, which comprises the following steps:
S10: the real mold image of identification camera shooting extracts the characteristic value of the real mold image；The reality mould
Having image includes bookish two-dimensional mold image；
S20: transferring sample mold image in presetting database to server request, and by the feature of the real mold image
Value carries out characteristic matching with the sample mold image, if successful match, transfers and the matched sample mould to server request
Has a corresponding augmented reality content information of image, the augmented reality content information includes that mold complete three-dimensional model, mold cut open
Depending on threedimensional model, components explanation audio-video and operation interface；
S30: spatial position and direction of the reality mold image described in reality scene with respect to picture reproducer are calculated, according to real field
Reality mold image described in scape dispatches the picture reproducer in reality scene with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image；
S40: obtaining the gesture information in the operation interface using gesture tracking equipment, is determined and is shown according to the gesture information
Mode simultaneously dispatches the picture reproducer and audio playing device and is accordingly shown or played；The display pattern includes in display
Appearance, angles of display and display scale.
2. a kind of mold design teaching method based on mobile augmented reality according to claim 1, which is characterized in that institute
State step S40 further include: display state is determined according to the gesture information and dispatches the picture reproducer and audio playing device
It is accordingly shown or is played, the display state includes playing, suspending, acceleration or deceleration.
3. a kind of mold design teaching method based on mobile augmented reality according to claim 1, which is characterized in that institute
It states further comprising the steps of between step S20 and step S30:
S21: prompt user chooses display mode, and the display mode includes Overlapping display, throws screen display and the display of this screen, when
When user chooses Overlapping display, step S30 and step S40 is just successively executed.
4. a kind of mold design tutoring system based on mobile augmented reality characterized by comprising
It identifies extraction module, for identification the real mold image of camera shooting, extracts the feature of the real mold image
Value；
Matching module is transferred, for transferring sample mold image in presetting database to server request, and by the reality
The characteristic value of mold image and the sample mold image carry out characteristic matching, if successful match, transfer to server request
Augmented reality content information corresponding with the matched sample mold image, the augmented reality content information include mold complete three
Dimension module, mold section view threedimensional model, components explanation audio-video and operation interface；
Scheduler module is calculated, for calculating spatial position and side of reality mold image described in reality scene with respect to picture reproducer
To the reality mold image according to reality scene dispatches the picture reproducer with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image described in reality scene；
Human-computer interaction module, for obtaining the gesture information in the operation interface using gesture tracking equipment, according to the hand
Gesture information determines display pattern and dispatches the picture reproducer and audio playing device and accordingly shown or played；The display
Mode includes display content, angles of display and display scale.
5. a kind of mold design tutoring system based on mobile augmented reality according to claim 4, which is characterized in that institute
It states human-computer interaction module and is also used to determine display state according to the gesture information and dispatch the picture reproducer and sound broadcasting
Equipment accordingly shown or played, the display state include play, pause, acceleration or deceleration.
6. a kind of mold design tutoring system based on mobile augmented reality according to claim 4, which is characterized in that also
Including cue module, for prompting user to choose display mode, the display mode includes Overlapping display, throwing screen is shown and this
Screen display.
7. a kind of mold design tutoring system based on mobile augmented reality according to claim 4, which is characterized in that institute
It states and transfers matching module and include:
Unit is transferred in first request, for transferring the sample mold image in presetting database to server request；
Matching unit, for the characteristic value of the real mold image and the sample mold image to be carried out characteristic matching；
Unit is transferred in second request, for being transferred and the matched sample after the matching unit successful match to server request
The corresponding augmented reality content information of mold image, the augmented reality content information include mold complete three-dimensional model, mold
Section view threedimensional model, components explanation audio-video and operation interface.
8. a kind of mold design tutoring system based on mobile augmented reality according to claim 4, which is characterized in that institute
Stating calculating scheduler module includes:
Computing unit, for calculating spatial position and direction of reality mold image described in reality scene with respect to picture reproducer；
Scheduling unit, spatial position and direction tune for the reality mold image according to reality scene with respect to picture reproducer
Spend picture reproducer augmented reality content information described in Overlapping display above the reality mold image described in reality scene.
9. a kind of mobile terminal characterized by comprising
Camera, for shooting real mold image；
It identifies extraction module, for identification the real mold image of the camera shooting, extracts the real mold image
Characteristic value；
Matching module is transferred, for transferring sample mold image in presetting database to server request, and by the reality
The characteristic value of mold image and the sample mold image carry out characteristic matching, if successful match, transfer to server request
Augmented reality content information corresponding with the matched sample mold image, the augmented reality content information include mold complete three
Dimension module, mold section view threedimensional model, components explanation audio-video and operation interface；
Scheduler module is calculated, for calculating spatial position and side of reality mold image described in reality scene with respect to picture reproducer
To the reality mold image according to reality scene dispatches the picture reproducer with respect to the spatial position of picture reproducer and direction
Augmented reality content information described in Overlapping display above the reality mold image described in reality scene；
Human-computer interaction module, for obtaining the gesture information in the operation interface using gesture tracking equipment, according to the hand
Gesture information determines display pattern and dispatches the picture reproducer and audio playing device and accordingly shown or played；The display
Mode includes display content, angles of display and display scale.
10. a kind of mobile terminal according to claim 9, which is characterized in that further include:
Cue module, for prompting user to choose display mode, the display mode includes Overlapping display, throwing screen is shown and this
Screen display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811103967.7A CN109215413A (en) | 2018-09-21 | 2018-09-21 | A kind of mold design teaching method, system and mobile terminal based on mobile augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811103967.7A CN109215413A (en) | 2018-09-21 | 2018-09-21 | A kind of mold design teaching method, system and mobile terminal based on mobile augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109215413A true CN109215413A (en) | 2019-01-15 |
Family
ID=64984479
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811103967.7A Pending CN109215413A (en) | 2018-09-21 | 2018-09-21 | A kind of mold design teaching method, system and mobile terminal based on mobile augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109215413A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110009952A (en) * | 2019-04-12 | 2019-07-12 | 上海乂学教育科技有限公司 | Adaptive learning mobile terminal and learning method based on augmented reality |
| CN110286767A (en) * | 2019-06-25 | 2019-09-27 | 惠州学院 | A method for making virtual display courses based on physical teaching materials |
| CN111060733A (en) * | 2019-12-25 | 2020-04-24 | 北京像素软件科技股份有限公司 | Circuit measurement method, circuit measurement device, terminal equipment and computer readable storage medium |
| CN111079496A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Display method of click-to-read state and electronic equipment |
| CN111127669A (en) * | 2019-12-30 | 2020-05-08 | 北京恒华伟业科技股份有限公司 | Information processing method and device |
| CN111416971A (en) * | 2020-03-30 | 2020-07-14 | 咪咕视讯科技有限公司 | A control method, control system, electronic device and readable storage medium |
| CN111639567A (en) * | 2020-05-19 | 2020-09-08 | 广东小天才科技有限公司 | Interactive display method of three-dimensional model, electronic equipment and storage medium |
| CN111818265A (en) * | 2020-07-16 | 2020-10-23 | 北京字节跳动网络技术有限公司 | Interaction method, device, electronic device and medium based on augmented reality model |
| CN112164258A (en) * | 2019-12-26 | 2021-01-01 | 昆山时记信息科技有限公司 | AR intelligent teaching method, device, teaching aid system and computer equipment |
| CN112785882A (en) * | 2019-11-08 | 2021-05-11 | 李少锋 | Teaching system for presenting working principle of machine equipment |
| CN113744586A (en) * | 2020-05-28 | 2021-12-03 | 上海联影医疗科技股份有限公司 | Magnetic resonance imaging auxiliary information display method, device, equipment and storage medium |
| CN115064023A (en) * | 2022-05-06 | 2022-09-16 | 中国人民解放军陆军防化学院 | Portable terminal teaching and training system based on AR glasses |
| CN115115958A (en) * | 2021-03-19 | 2022-09-27 | 暗物智能科技(广州)有限公司 | Augmented reality display method and device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN103606310A (en) * | 2013-10-29 | 2014-02-26 | 中兴通讯股份有限公司 | Teaching method and system |
| CN206115752U (en) * | 2016-07-20 | 2017-04-19 | 广东沃赛科技有限公司 | Ar augmented reality teaching system |
| CN106601043A (en) * | 2016-11-07 | 2017-04-26 | 爱可目（北京）科技股份有限公司 | Multimedia interaction education device and multimedia interaction education method based on augmented reality |
| CN107895515A (en) * | 2017-12-20 | 2018-04-10 | 岭南师范学院 | The CAD teaching methods and tutoring system of a kind of augmented reality |
-
2018
- 2018-09-21 CN CN201811103967.7A patent/CN109215413A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN103606310A (en) * | 2013-10-29 | 2014-02-26 | 中兴通讯股份有限公司 | Teaching method and system |
| CN206115752U (en) * | 2016-07-20 | 2017-04-19 | 广东沃赛科技有限公司 | Ar augmented reality teaching system |
| CN106601043A (en) * | 2016-11-07 | 2017-04-26 | 爱可目（北京）科技股份有限公司 | Multimedia interaction education device and multimedia interaction education method based on augmented reality |
| CN107895515A (en) * | 2017-12-20 | 2018-04-10 | 岭南师范学院 | The CAD teaching methods and tutoring system of a kind of augmented reality |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110009952A (en) * | 2019-04-12 | 2019-07-12 | 上海乂学教育科技有限公司 | Adaptive learning mobile terminal and learning method based on augmented reality |
| CN111079496A (en) * | 2019-06-09 | 2020-04-28 | 广东小天才科技有限公司 | Display method of click-to-read state and electronic equipment |
| CN111079496B (en) * | 2019-06-09 | 2023-05-26 | 广东小天才科技有限公司 | A display method and electronic device for point-reading status |
| CN110286767A (en) * | 2019-06-25 | 2019-09-27 | 惠州学院 | A method for making virtual display courses based on physical teaching materials |
| CN112785882A (en) * | 2019-11-08 | 2021-05-11 | 李少锋 | Teaching system for presenting working principle of machine equipment |
| CN111060733A (en) * | 2019-12-25 | 2020-04-24 | 北京像素软件科技股份有限公司 | Circuit measurement method, circuit measurement device, terminal equipment and computer readable storage medium |
| CN111060733B (en) * | 2019-12-25 | 2022-08-23 | 北京像素软件科技股份有限公司 | Circuit measurement method, circuit measurement device, terminal equipment and computer readable storage medium |
| CN112164258A (en) * | 2019-12-26 | 2021-01-01 | 昆山时记信息科技有限公司 | AR intelligent teaching method, device, teaching aid system and computer equipment |
| CN111127669A (en) * | 2019-12-30 | 2020-05-08 | 北京恒华伟业科技股份有限公司 | Information processing method and device |
| CN111416971A (en) * | 2020-03-30 | 2020-07-14 | 咪咕视讯科技有限公司 | A control method, control system, electronic device and readable storage medium |
| CN111639567A (en) * | 2020-05-19 | 2020-09-08 | 广东小天才科技有限公司 | Interactive display method of three-dimensional model, electronic equipment and storage medium |
| CN111639567B (en) * | 2020-05-19 | 2024-03-22 | 广东小天才科技有限公司 | Interactive display method of three-dimensional model, electronic equipment and storage medium |
| CN113744586A (en) * | 2020-05-28 | 2021-12-03 | 上海联影医疗科技股份有限公司 | Magnetic resonance imaging auxiliary information display method, device, equipment and storage medium |
| CN111818265A (en) * | 2020-07-16 | 2020-10-23 | 北京字节跳动网络技术有限公司 | Interaction method, device, electronic device and medium based on augmented reality model |
| CN111818265B (en) * | 2020-07-16 | 2022-03-04 | 北京字节跳动网络技术有限公司 | Interaction method and device based on augmented reality model, electronic equipment and medium |
| CN115115958A (en) * | 2021-03-19 | 2022-09-27 | 暗物智能科技(广州)有限公司 | Augmented reality display method and device and electronic equipment |
| CN115064023A (en) * | 2022-05-06 | 2022-09-16 | 中国人民解放军陆军防化学院 | Portable terminal teaching and training system based on AR glasses |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109215413A (en) | A kind of mold design teaching method, system and mobile terminal based on mobile augmented reality | |
| CN111726536B (en) | Video generation method, device, storage medium and computer equipment | |
| Cheng et al. | Construction of interactive teaching system for course of mechanical drawing based on mobile augmented reality technology | |
| CN104461318B (en) | Reading method based on augmented reality and system | |
| CN114144790A (en) | Personalized speech-to-video with three-dimensional skeletal regularization and representative body gestures | |
| CN110364049A (en) | A professional skill training auxiliary teaching system and auxiliary teaching method with automatic deviation feedback data closed-loop deviation correction control | |
| CN107515674A (en) | A method for implementing multi-interaction in mining operations based on virtual reality and augmented reality | |
| CN105590486A (en) | Machine vision-based pedestal-type finger reader, related system device and related method | |
| CN106875764A (en) | Network virtual reality foreign language learning system and control method | |
| CN109215416A (en) | A kind of Chinese character assistant learning system and method based on augmented reality | |
| CN106601043A (en) | Multimedia interaction education device and multimedia interaction education method based on augmented reality | |
| CN103745423B (en) | A kind of shape of the mouth as one speaks teaching system and teaching method | |
| CN106408480A (en) | Sinology three-dimensional interactive learning system and method based on augmented reality and speech recognition | |
| CN109739353A (en) | A kind of virtual reality interactive system identified based on gesture, voice, Eye-controlling focus | |
| CN108389249A (en) | A kind of spaces the VR/AR classroom of multiple compatibility and its construction method | |
| CN107833503A (en) | Distribution core job augmented reality simulation training system | |
| CN109598198A (en) | The method, apparatus of gesture moving direction, medium, program and equipment for identification | |
| CN108986577A (en) | A kind of design method of the mobile augmented reality type experiment based on forward type | |
| CN111223337A (en) | Calligraphy teaching machine based on machine vision and augmented reality | |
| CN108628455B (en) | Virtual sand painting drawing method based on touch screen gesture recognition | |
| US20240362861A1 (en) | Character and text recognition in extended reality environments | |
| CN109671317A (en) | Types of facial makeup in Beijing operas interactive teaching method based on AR | |
| CN118394215A (en) | Digital transmission method for national dance based on virtual digital man technology | |
| CN115379278B (en) | Recording method and system for immersion type micro lessons based on augmented reality (XR) technology | |
| Schäfer | Improving essential interactions for immersive virtual environments with novel hand gesture authoring tools |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190115 |
|
| RJ01 | Rejection of invention patent application after publication |