CN109035368A - For the information processing method of AR scene, device, equipment and storage medium - Google Patents
For the information processing method of AR scene, device, equipment and storage medium Download PDFInfo
- Publication number
- CN109035368A CN109035368A CN201810720339.7A CN201810720339A CN109035368A CN 109035368 A CN109035368 A CN 109035368A CN 201810720339 A CN201810720339 A CN 201810720339A CN 109035368 A CN109035368 A CN 109035368A
- Authority
- CN
- China
- Prior art keywords
- text
- checked
- information
- equipment
- enhancement information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—Two-dimensional [2D] image generation
- G06T11/60—Creating or editing images; Combining images with text
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention provides a kind of for the information processing method of AR scene, device, equipment and storage medium, this method can include: from acquisition image, obtains text to be checked；The request for being directed to the text to be checked is sent to server；Receive the enhancement information for the text to be checked that the server is sent；The enhancement information includes: the paraphrase information of at least one type of the text to be checked；The enhancement information is shown in the acquisition image.The present invention can simplify the operating process of user query text paraphrase, improve user experience.
Description
Technical field
The present invention relates to field of computer technology, more particularly to it is a kind of for augmented reality (Augmented Reality,
Abbreviation AR) scene information processing method, device, equipment and storage medium.
Background technique
Some scenes in life, user may need to obtain paraphrase, allusion or relevant information of text etc..
For the relevant information for obtaining text, user can be by inputting corresponding query text in the search engine of terminal device
It is inquired, terminal device can send searching request to server, be determined by server after receiving the search instruction of input
The information of the query text is simultaneously sent to terminal device and is shown.
However, the mode of the information of above-mentioned query text, operating process is more complex, and the exhibition method of query result is single,
So that user experience is poor.
Summary of the invention
The present invention provide it is a kind of for the information processing method of AR scene, device, equipment and storage medium, to simplify user
The operating process of text paraphrase is inquired, user experience is improved.
In a first aspect, the present invention provides a kind of information processing method for augmented reality AR scene, comprising:
From acquisition image, text to be checked is obtained；
The request for being directed to the text to be checked is sent to server；
Receive the enhancement information for the text to be checked that the server is sent；The enhancement information include: it is described to
Inquire the paraphrase information of at least one type of text；
The enhancement information is shown in the acquisition image.
Second aspect, the present invention also provides a kind of information processing methods for AR scene, comprising:
The request for text to be checked that AR equipment is sent is received, the text to be checked is the AR equipment from acquisition
Acquired text in image；
Determine the enhancement information of the text to be checked；The enhancement information includes: at least the one of the text to be checked
The paraphrase information of seed type；
Enhancement information is sent to the AR equipment, so that the AR equipment shows the enhancement information in the acquisition
In image
The third aspect, the present invention provide a kind of information processing unit for augmented reality AR scene, comprising:
Module is obtained, for obtaining text to be checked from acquisition image；
Sending module sends the request for being directed to the text to be checked to server；
Receiving module, for receiving the enhancement information for the text to be checked that the server is sent；The enhancing letter
Breath includes: the paraphrase information of at least one type of the text to be checked；
Display module, for showing the enhancement information in the acquisition image.
Fourth aspect, the present invention provide a kind of information processing unit for augmented reality AR scene, comprising:
Receiving module, for receiving the request for text to be checked of AR equipment transmission, the text to be checked is institute
State AR equipment text acquired from acquisition image；
Determining module, for determining the enhancement information of the text to be checked；The enhancement information includes: described to be checked
The paraphrase information of at least one type of text；
Sending module, for sending enhancement information to the AR equipment, so that the AR equipment is by the enhancement information
It is shown in the acquisition image.
5th aspect, the present invention provide a kind of augmented reality AR equipment, comprising: memory and processor；The memory
It is connected to the processor；
The memory, for storing program instruction；
The processor, for being performed in program instruction, it can be achieved that stating described in first aspect for AR scene
Information processing method.
6th aspect, the present invention provide a kind of server, comprising: memory and processor；The memory and the place
Manage device connection；
The memory, for storing program instruction；
The processor, for being performed in program instruction, it can be achieved that stating described in second aspect for AR scene
Information processing method.
7th aspect, the present invention provide a kind of computer readable storage medium, are stored thereon with computer program, the calculating
The information processing method that AR scene is used for described in first aspect is realized when machine program is executed by processor.
Eighth aspect, the present invention provide a kind of computer readable storage medium, are stored thereon with computer program, the calculating
The information processing method that AR scene is used for described in second aspect is realized when machine program is executed by processor.
The present invention provides a kind of for the information processing method of AR scene, device, equipment and storage medium, can be set by AR
It is standby that text to be checked is obtained from acquisition image, and the request for being directed to the text to be checked is sent to server, receive server
The enhancement information of the text to be checked sent, the enhancement information include the paraphrase letter of at least one type of the text to be checked
Breath, then shows the enhancement information in the acquisition image.In this method, operation is inputted without user, can be obtained to be checked
The paraphrase information for asking text simplifies the operating process of user query text paraphrase, improves user experience.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to do one simply to introduce, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of flow chart one of the information processing method for AR scene provided in an embodiment of the present invention；
Fig. 2 is a kind of flowchart 2 of the information processing method for AR scene provided in an embodiment of the present invention；
Fig. 3 is a kind of flow chart 3 of the information processing method for AR scene provided in an embodiment of the present invention；
Fig. 4 is a kind of structural schematic diagram one of the information processing unit for AR scene provided in an embodiment of the present invention；
Fig. 5 is a kind of structural schematic diagram two of the information processing unit for AR scene provided in an embodiment of the present invention；
Fig. 6 is the structural schematic diagram of AR equipment provided in an embodiment of the present invention；
Fig. 7 is the structural schematic diagram of server provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
It should be noted that term " first ", " second " and " third " etc. in each section of the embodiment of the present invention and attached drawing
It is to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that the number used in this way
According to being interchangeable under appropriate circumstances, so that the embodiment of the present invention described herein can be in addition to illustrating herein or describing
Those of other than sequence implement.In addition, term " includes " and " having " and their any deformation, it is intended that covering is not
Exclusive includes, for example, the process, method, system, product or equipment for containing a series of steps or units be not necessarily limited to it is clear
Step or unit those of is listed on ground, but is not clearly listed or for these process, methods, product or is set
Standby intrinsic other step or units.
Method flow diagram involved in the following embodiments of the present invention is merely illustrative, it is not necessary in all
Appearance and step, nor is it necessary that and execute in the described sequence.For example, some steps can also decompose, and some steps can
To merge or partially merge, therefore, the sequence actually executed can change according to the actual situation.
Functional module in block diagram involved in the following embodiments of the present invention is only functional entity, not necessarily must be with
Physically separate entity is corresponding.I.e., it is possible to realize these functional entitys using software form, or in one or more hardware
It is realized in module or integrated circuit in these functional entitys or heterogeneous networks and/or processor and/or microcontroller and realizes this
A little functional entitys.
As follows in conjunction with multiple examples to the information processing method provided in an embodiment of the present invention for AR scene, device, set
Standby and storage medium is illustrated.AR is also referred to as mixed reality, and the virtual information that can provide computer increases in real scene,
To enhance perception of the user to real world.
Fig. 1 is a kind of flow chart one of the information processing method for AR scene provided in an embodiment of the present invention.The information
Processing method can interact realization with server by AR equipment.Wherein, which is, for example, desktop computer, notebook, a number
Word assistant (Personal Digital Assistant, referred to as: PDA), smart phone, tablet computer etc. are any to have the function of AR
Terminal device.The server for example can be the corresponding server of AR function.
Illustratively, the terminal device with AR function is for example mountable AR application program, which for example can be
The application server of the AR application program.It is of course also possible to except for other server such as application servers, for inquiring
The server of text.
As shown in Figure 1, the information processing method shown in the present embodiment for AR scene may include as follows:
S101, AR equipment obtain text to be checked from acquisition image.
The AR equipment can first acquire the image including text to be checked, then to the acquired image, i.e. acquisition image
It is handled, obtains the text to be checked.The text to be checked can include: all or part of texts in the acquisition image.It should
Text to be checked can be with are as follows: the image or view that the text on printout, the text on hand-written part or other display equipment are shown
Text in frequency file.The printout can be for example file, picture, books etc..
It is assumed that AR equipment can first acquire the image of the printout, and right if the text to be checked is the text on printout
The image of printout is handled, and the text to be checked in the image of the printout is obtained.
For example, the AR equipment can pass through optical character identification (Optical Character Recognition, abbreviation
OCR) technology carries out Text region to the acquisition image, to obtain the text to be checked.
In this method, AR equipment directly can carry out Text region to the acquisition image, can also first carry out to the acquisition image
Pretreatment carries out Text region to the image after pretreatment, to obtain the text to be checked.Wherein, which for example may be used
It include: the adjustment of brightness of image, clarity, contrast etc..
Certainly, it uses OCR technique to carry out Text region to obtain the text to be checked, possible shows for one kind of the S101
Example.In some other scenes, which also can be used other technologies, handles the acquisition image, is somebody's turn to do
Text to be checked.
The acquisition image for example can be the image that the AR equipment is acquired by image capture device.The image of the AR equipment
Acquisition for example can be a device of the AR equipment, or the other image capture devices connecting with the AR equipment.
Image capture device can be got by this and adopted for the situation of a device of AR equipment, the image capture device
Collect image, the as AR equipment gets the acquisition image.It is the situation of the external device of AR equipment for image capture device,
After the image capture device obtains the acquisition image, also need the acquisition image transmitting to the AR equipment.
Based on this, in a kind of example, which can obtain the acquisition image by camera, such as to including to be checked
Ask text file, picture, display interface etc. shot, with obtain include the text to be checked acquisition image.The camera shooting
Head can be the camera of the AR equipment or other cameras in the AR equipment external world.
In another example, which can obtain the acquisition image by optical scanning device, for example, to include to
File, the picture etc. of inquiry text are scanned, and obtain corresponding soft copy, which includes as the text to be checked
Acquire image.Optical scanning device can be the scanner of AR equipment connection, alternatively, the AR equipment with scanning function is swept
Retouch device.
The some possible examples that above are only the acquisition image, in some other examples, which can be with
For the image that the AR equipment is got from preset memory, alternatively, the image that the other AR equipment received are sent, or
Person, the image downloaded from network.
S102, AR equipment send the request for being directed to the text to be checked to server.
The request can be for example the corresponding inquiry request of the text to be checked or paraphrase acquisition request.The request at least may be used
It include: the information of the text to be checked.
S103, server receive the request for the text to be checked from AR equipment.
S104, server determine the enhancement information of the inquiry text, the enhancement information include the text to be checked at least
A type of paraphrase information.
Server, can be according to the information of the text to be checked, really after receiving the request for the text to be checked
The paraphrase information of at least one type of the fixed text to be checked, then obtains the enhancement information of the text to be checked.
There can be a knowledge base on the server, dictionary, encyclopaedia application, question and answer application etc. can be stored in the knowledge base extremely
Paraphrase information in few a type of text information library.
The paraphrase information is for example can include: the allusion information of the text to be checked, is somebody's turn to do at the explanation information of the text to be checked
The information of at least one type such as the translation information of text to be checked.The paraphrase information for example may also include the text to be checked
Ancient Chinese prose source.
If the text to be checked is Chinese idiom, proverb or writing in classical Chinese etc., which can be allusion information, source
Information etc..This, which explains information for example, to be the literal interpretation of text to be checked or meaning.
Can for example have text query option on the interface of the AR equipment, for example, allusion, paraphrase, translation etc..When
User inputs the selection operation of corresponding option, and AR equipment can carry the inquiry in the case where sending the request to server
The information of option, the inquiry type selecting are used to indicate the server and determine the corresponding paraphrase information of the inquiry type selecting.
If user does not input any selection operation, AR equipment, can not in the case where sending more than the request to server
Option information is carried, the corresponding paraphrase information of preset kind of the text to be checked is determined by server.The preset kind can be with
It is some or all in multiple queries type selecting.
Optionally, which for example may include following at least one form: visual form, graphic form and animation
Form etc..The enhancement information of the visual form for example can be small video, i.e., playing duration be less than or equal to preset duration when
Frequency file.The enhancement information of the graphic form for example can be dynamic image or still image.The enhancement information of the animation form
It such as can be allusion animation.
S105, server send the enhancement information to AR equipment.
The enhancement information can be sent to the AR equipment after obtaining the enhancement information by server.
S106, AR equipment receive the information to be reinforced from server.
S107, AR equipment show the enhancement information in the acquisition image.
The AR equipment can be shown the enhancement information in the acquisition image by being superimposed Rendering.Enhancement information is for example
It can be shown in by transparent mode in the acquisition image, be blocked to avoid to the acquisition image.The transparent mode is corresponding
Show that transparency can be preset transparency.
For example, the AR equipment can show the enhancement information in the acquisition image, around text to be checked, alternatively, this is adopted
Collect the predeterminated position in image.
The AR equipment shows the enhancement information in the acquisition image, may make user see it is to be checked in acquisition image
In the case where asking text, the paraphrase information of the text to be checked can be also more intuitively seen, enrich the aobvious of text paraphrase information
Show mode.
Information processing method provided in an embodiment of the present invention for AR scene can be obtained from acquisition image by AR equipment
Text to be checked is taken, and sends the request for being directed to the text to be checked to server, receives the text to be checked that server is sent
The enhancement information of word, which includes the paraphrase information of at least one type of the text to be checked, then by the enhancing
Information is shown in the acquisition image.In this method, operation is inputted without user, the paraphrase letter of text to be checked can be obtained
Breath simplifies the operating process of user query text paraphrase, improves user experience.
Simultaneously as this method, the paraphrase inquiry of text can be carried out in AR scene, and by the paraphrase information including text
Enhancement information be shown in acquisition image, enrich the display mode of text paraphrase query result, improve interest, improve and use
Family experience.
On the basis of the above embodiments, a kind of information processing side for AR scene can also be provided in the embodiment of the present invention
Method.Fig. 2 is a kind of flowchart 2 of the information processing method for AR scene provided in an embodiment of the present invention.Side shown in Fig. 2
Method can be a kind of possible example of enhancement information determining in above-mentioned method shown in FIG. 1.It should be noted that determining enhancing letter
Breath also realizes that the present invention is not to this limitation in other manners.As shown in Fig. 2, AR equipment is sent out to server in above-mentioned S102
Before sending the request for the text to be checked, this method can include:
S201, AR equipment carry out semantic analysis to the text to be checked, obtain the semantic information of the text to be checked.
The AR equipment for example can carry out semantic analysis to the text to be checked, obtain to use preset semantic model
The semantic information of the text to be checked.The preset semantic model for example can be natural language processing (Natural
Language Processing, abbreviation NLP) model, it is also referred to as natural language understanding (Natural Language
Understanding, abbreviation NLU).Wherein, which is alternatively referred to as semantic parsing.
Illustratively, AR equipment can be used NLP model and carry out semantic analysis to the text to be checked, obtain the text to be checked
It is natural semantic, and be the logical semantics of the text to be checked by the natural semantic conversion of the text to be checked.
This method may also include that
S202, AR equipment send the request for being directed to the text to be checked to server, which includes the text to be checked
Semantic information.
The semantic information for the text to be checked for including in the request, such as may include the logical semantics of the text to be checked
Information, or natural semantic information.If natural semantic information, server upon receiving a request, also needs to be converted into logic
Semantic information.
S203, server receive the request for the text to be checked from AR equipment.
S204, server determine the enhancement information of the text to be checked according to the semantic information of the text to be checked.
In a kind of example, the server receive include the text to be checked semantic information after, can basis
The semantic information of the text to be checked determines the paraphrase information of at least one type of the text to be checked, then according to should be to
The paraphrase information for inquiring at least one type of text, generates the enhancement information of the text to be checked.
In another example, which can be according to the semantic information of the text to be checked, from preset enhancement information
In library, determine that the corresponding enhancement information of the semantic information is the enhancement information of the text to be checked.The preset enhancement information library
In can for example be stored with enhancement information corresponding to the semantic information of at least one text.
In some other examples, server can also be according to the voice messaging of the text to be checked, from other servers
Obtain the enhancement information that the corresponding enhancement information of the semantic information is the text to be checked.
Certainly, which also can be used the enhancement information that other modes obtain the text to be checked, and above-mentioned example is only
For some possible examples, details are not described herein.
The information processing method for AR scene that the embodiment provides, server can be according in the requests that AR equipment is sent
The semantic information of the entrained text to be checked, obtains the enhancement information of the text to be checked, may make enhancement information and is somebody's turn to do
The semanteme of text to be checked more matches, and preferably annotates the paraphrase information of the text to be checked, improves the inquiry of text paraphrase
Accuracy, to improve user experience.
On the basis of the above embodiments, a kind of information processing side for AR scene can also be provided in the embodiment of the present invention
Method.Fig. 3 is a kind of flow chart 3 of the information processing method for AR scene provided in an embodiment of the present invention.This is shown in Fig. 3
Method can be the alternatively possible example of enhancement information determining in above-mentioned method shown in FIG. 1.Increase it should be noted that determining
Strong information also realizes that the present invention is not to this limitation in other manners.
Optionally, it may include the text to be checked that AR equipment, which is sent in the request of the text to be checked of the server,.
If in the request including the text to be checked, the request for example may include the mark of the text to be checked, serial number,
Any informations such as index.It compares and carries the semantic information of the text to be checked, the information carried in request can be simplified, simultaneously
Simplify the processing pressure of AR equipment.
As shown in figure 3, server determines the enhancement information of the inquiry text in S104 as shown above, it may include:
S301, server carry out semantic analysis to the text to be checked, determine the semantic information of the text to be checked.
The mode similar with above-mentioned S201 can be used in the server, determines the semantic information of the text to be checked.Specifically
Referring to above-mentioned, details are not described herein.
S302, server determine the enhancement information of the text to be checked according to the semantic information of the text to be checked.
The enhancement information that the mode similar with above-mentioned S204 determines the text to be checked can be used in server.Referring specifically to upper
It states, details are not described herein.
The information processing method for AR scene that the embodiment provides, server can be by carrying out the text to be checked
Semantic analysis determines the semantic information of the text to be checked, and it is to be checked according to the semantic information of the text to be checked to obtain this
The enhancement information of text may make enhancement information more to match with the semanteme of the text to be checked, preferably annotate the text to be checked
The paraphrase information of word, improves the query accuracy of text paraphrase, to improve user experience.
Also, in this method, semantic analysis is carried out to the text to be checked by server, obtains the language of the text to be checked
Adopted information can effectively avoid information of the semantic information in transmission process and omit or malfunction；It is stronger using processing capacity simultaneously
Server carries out semantic analysis, may make that semantic information is more acurrate, the accuracy of enhancement information is effectively ensured, so that enhancement information
It is more matched with the semanteme of the text to be checked, preferably annotates the paraphrase information of the text to be checked, improve text paraphrase
Query accuracy, to improve user experience.
Following is apparatus of the present invention embodiment, can be used for executing above method embodiment of the present invention, realization principle and
Technical effect is similar.
Fig. 4 is a kind of structural schematic diagram one of the information processing unit for AR scene provided in an embodiment of the present invention.It should
The mode of information processing unit software and/or hardware for AR scene is integrated in AR equipment.As shown in figure 4, the present embodiment
The information processing unit 40 for AR scene may include:
Module 41 is obtained, for obtaining text to be checked from acquisition image.
Sending module 42 sends the request for being directed to the text to be checked to server.
Receiving module 43, the enhancement information of the text to be checked for receiving server transmission；The enhancement information includes:
The paraphrase information of at least one type of the text to be checked.
Display module 44, for showing the enhancement information in the acquisition image.
Optionally, module 41 is obtained, is specifically used for through optical character recognition technology, text knowledge is carried out to the acquisition image
Not, the text to be checked is obtained.
Optionally, module 41 is obtained, is also used to before obtaining text to be checked, pass through camera from acquisition image
Or optical scanning device, obtain the acquisition image.
Optionally, may also include that for the information processing unit 40 of AR scene
Analysis module obtains the semantic information of the text to be checked for carrying out semantic analysis to the text to be checked.
The request includes: the semantic information of the text to be checked；The request is used for so that the server is to be checked according to this
The semantic information of text determines the enhancement information of the text to be checked.
Optionally, which may include following at least one form: visual form, graphic form and animation form.
Optionally, which includes following at least one type information: the allusion information of the text to be checked, should be to
Inquire the explanation information of text, the translation information of the text to be checked.
The information processing side that any AR equipment executes into Fig. 3 above-mentioned Fig. 1 can be performed in the device of the present embodiment
Method, specific implementation and beneficial effect are referring to above-mentioned, and details are not described herein.
Fig. 5 is a kind of structural schematic diagram two of the information processing unit for AR scene provided in an embodiment of the present invention.It should
The mode of information processing unit software and/or hardware for AR scene is integrated in the server.As shown in figure 5, the present embodiment
The information processing unit 50 for AR scene may include:
Receiving module 51, for receiving the request for text to be checked of AR equipment transmission, which is should
AR equipment text acquired from acquisition image.
Determining module 52, for determining the enhancement information of the text to be checked；The enhancement information includes: the text to be checked
At least one type paraphrase information.
Sending module 53, for sending enhancement information to the AR equipment, so that the AR equipment shows the enhancement information
In the acquisition image.
In one implementation, which includes: the semantic information of the text to be checked.
Determining module 52 determines the enhancing of the text to be checked specifically for the semantic information according to the text to be checked
Information.
In another implementation, which includes: the text to be checked.
Determining module 52 is specifically used for carrying out semantic analysis to the text to be checked, determines the semanteme of the text to be checked
Information；According to the semantic information of the text to be checked, the enhancement information of the text to be checked is determined.
Optionally, which includes following at least one form: visual form, graphic form and animation form.
Optionally, which includes the information of following at least one type: the allusion information of the text to be checked is somebody's turn to do
The translation information of the explanation information of text to be checked, the text to be checked.
Device provided in this embodiment can be performed above-mentioned Fig. 1 it is any into Fig. 3 shown in server execute information processing
Method, specific implementation and effective effect, reference can be made to above-mentioned, details are not described herein.
Fig. 6 is the structural schematic diagram of AR equipment provided in an embodiment of the present invention.As shown in fig. 6, the AR equipment of the present embodiment
60 include: memory 61 and processor 62.Wherein, memory 61 is connect by bus with processor 62.
Memory 61, for storing program instruction.
Processor 62, for being performed in program instruction, so that processor 62 executes above-mentioned Fig. 1 any institute into Fig. 3
The information processing method that the AR equipment shown executes.
The AR equipment of the present embodiment can be performed above-mentioned Fig. 1 it is any into Fig. 3 shown in AR equipment execute information processing side
Method, specific implementation and effective effect, reference can be made to above-mentioned, details are not described herein.
The embodiment of the present invention also provides a kind of computer readable storage medium, is stored thereon with computer program, the calculating
Machine program can the processor 62 described in above-mentioned Fig. 6 execute the information processing for realizing that AR equipment shown in upper any embodiment executes
Method, specific implementation and effective effect, reference can be made to above-mentioned, details are not described herein.
Fig. 7 is the structural schematic diagram of server provided in an embodiment of the present invention.As shown in fig. 7, the server of the present embodiment
70 include: memory 71 and processor 72.Wherein, memory 71 is connect by bus with processor 72.
Memory 71, for storing program instruction.
Processor 72, for being performed in program instruction, so that processor 72 executes above-mentioned Fig. 1 any institute into Fig. 3
The information processing method that the server shown executes.
The server of the present embodiment can be performed above-mentioned Fig. 1 it is any into Fig. 3 shown in server execute information processing side
Method, specific implementation and effective effect, reference can be made to above-mentioned, details are not described herein.
The embodiment of the present invention also provides a kind of computer readable storage medium, is stored thereon with computer program, the calculating
Machine program can the processor 72 described in above-mentioned Fig. 7 execute the information processing for realizing that server shown in upper any embodiment executes
Method, specific implementation and effective effect, reference can be made to above-mentioned, details are not described herein.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above-mentioned each method embodiment can lead to
The relevant hardware of program instruction is crossed to complete.Computer program above-mentioned can store in a computer-readable storage medium
In.When being executed, execution includes the steps that above-mentioned each method embodiment to the program；And storage medium above-mentioned includes: in read-only
Deposit (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or light
The various media that can store program code such as disk.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme.
Claims (17)
1. a kind of information processing method for augmented reality AR scene characterized by comprising
From acquisition image, text to be checked is obtained；
The request for being directed to the text to be checked is sent to server；
Receive the enhancement information for the text to be checked that the server is sent；The enhancement information includes: described to be checked
The paraphrase information of at least one type of text；
The enhancement information is shown in the acquisition image.
2. obtaining text to be checked includes: the method according to claim 1, wherein described from acquisition image
By optical character recognition technology, Text region is carried out to the acquisition image, obtains the text to be checked.
3. the method according to claim 1, wherein it is described from acquisition image in, before obtaining text to be checked,
The method also includes:
By camera or optical scanning device, the acquisition image is obtained.
4. method according to any one of claim 1-3, which is characterized in that it is described to server send for it is described to
It inquires before the request of text, the method also includes:
Semantic analysis is carried out to the text to be checked, obtains the semantic information of the text to be checked；
The request includes: the semantic information of the text to be checked；The request is used for so that the server is according to
The semantic information of text to be checked determines the enhancement information of the text to be checked.
5. method according to any one of claim 1-3, which is characterized in that the enhancement information includes following at least one
Kind form: visual form, graphic form and animation form.
6. method according to any one of claim 1-3, which is characterized in that the paraphrase information includes following at least one
Seed type information: the allusion information of the text to be checked, the explanation information of the text to be checked, the text to be checked
Translation information.
7. a kind of information processing method for augmented reality AR scene characterized by comprising
Receive AR equipment send the request for text to be checked, the text to be checked be the AR equipment from acquire image
In acquired text；
Determine the enhancement information of the text to be checked；The enhancement information includes: at least one class of the text to be checked
The paraphrase information of type；
Enhancement information is sent to the AR equipment, so that the AR equipment shows the enhancement information in the acquisition image
In.
8. the method according to the description of claim 7 is characterized in that the request includes: the semantic letter of the text to be checked
Breath；
The enhancement information of the determination text to be checked, comprising:
According to the semantic information of the text to be checked, the enhancement information of the text to be checked is determined.
9. the method according to the description of claim 7 is characterized in that the acquisition request includes: the text to be checked；It is described
Determine the enhancement information of the text to be checked, comprising:
Semantic analysis is carried out to the text to be checked, determines the semantic information of the text to be checked；
According to the semantic information of the text to be checked, the enhancement information of the text to be checked is determined.
10. the method according to any one of claim 7-9, which is characterized in that the enhancement information include it is following at least
A kind of form: visual form, graphic form and animation form.
11. the method according to any one of claim 7-9, which is characterized in that the paraphrase information include it is following at least
A type of information: the allusion information of the text to be checked, the explanation information of the text to be checked, the text to be checked
The translation information of word.
12. a kind of information processing unit for augmented reality AR scene characterized by comprising
Module is obtained, for obtaining text to be checked from acquisition image；
Sending module sends the request for being directed to the text to be checked to server；
Receiving module, for receiving the enhancement information for the text to be checked that the server is sent；The enhancement information packet
It includes: the paraphrase information of at least one type of the text to be checked；
Display module, for showing the enhancement information in the acquisition image.
13. a kind of information processing unit for augmented reality AR scene characterized by comprising
Receiving module, for receiving the request for text to be checked of AR equipment transmission, the text to be checked is the AR
Equipment text acquired from acquisition image；
Determining module, for determining the enhancement information of the text to be checked；The enhancement information includes: the text to be checked
At least one type paraphrase information；
Sending module, for sending enhancement information to the AR equipment, so that the AR equipment shows the enhancement information
In the acquisition image.
14. a kind of augmented reality AR equipment characterized by comprising memory and processor；The memory and the processing
Device connection；
The memory, for storing program instruction；
The processor is realized described in any one of claims 1-6 for AR scene for being performed in program instruction
Information processing method.
15. a kind of server characterized by comprising memory and processor；The memory is connected to the processor；
The memory, for storing program instruction；
The processor realizes that claim 7-11 is described in any item existing for enhancing for being performed in program instruction
The information processing method of real AR scene.
16. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The information processing method described in any one of claims 1-6 for augmented reality AR scene is realized when being executed by processor.
17. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
Claim 7-11 described in any item information processing methods for augmented reality AR scene are realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810720339.7A CN109035368A (en) | 2018-07-03 | 2018-07-03 | For the information processing method of AR scene, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810720339.7A CN109035368A (en) | 2018-07-03 | 2018-07-03 | For the information processing method of AR scene, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109035368A true CN109035368A (en) | 2018-12-18 |
Family
ID=65521840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810720339.7A Pending CN109035368A (en) | 2018-07-03 | 2018-07-03 | For the information processing method of AR scene, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109035368A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109871753A (en) * | 2019-01-08 | 2019-06-11 | 上海玄彩美科网络科技有限公司 | A kind of text handling method and equipment based on augmented reality |
| CN109871432A (en) * | 2019-02-19 | 2019-06-11 | 广东小天才科技有限公司 | Word searching method and device, terminal equipment and computer readable storage medium |
| CN111274352A (en) * | 2020-01-14 | 2020-06-12 | 北大方正集团有限公司 | Method and equipment for marking characteristic characters in tool book |
| CN111858855A (en) * | 2020-07-20 | 2020-10-30 | 百度在线网络技术（北京）有限公司 | Information query method, device, system, electronic device and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103050025A (en) * | 2012-12-20 | 2013-04-17 | 广东欧珀移动通信有限公司 | Mobile terminal learning method and learning system thereof |
| US20140081634A1 (en) * | 2012-09-18 | 2014-03-20 | Qualcomm Incorporated | Leveraging head mounted displays to enable person-to-person interactions |
| CN103761326A (en) * | 2014-01-29 | 2014-04-30 | 百度在线网络技术（北京）有限公司 | Image search method and search engine |
| CN106294666A (en) * | 2016-08-04 | 2017-01-04 | 上海汽笛生网络科技有限公司 | A kind of method realizing text visualization Dynamic Display |
| CN106469112A (en) * | 2015-08-17 | 2017-03-01 | 深圳市中兴微电子技术有限公司 | A kind of information processing system, method and electronic equipment |
| CN107122039A (en) * | 2017-03-15 | 2017-09-01 | 苏州大学 | A kind of intelligent vision auxiliary strengthening system and its application method |
| CN107169430A (en) * | 2017-05-02 | 2017-09-15 | 哈尔滨工业大学深圳研究生院 | Reading environment audio strengthening system and method based on image procossing semantic analysis |
| CN107423392A (en) * | 2017-07-24 | 2017-12-01 | 上海明数数字出版科技有限公司 | Word, dictionaries query method, system and device based on AR technologies |
| CN107832229A (en) * | 2017-12-03 | 2018-03-23 | 中国直升机设计研究所 | A kind of system testing case automatic generating method based on NLP |
| CN107885345A (en) * | 2017-10-17 | 2018-04-06 | 深圳市金立通信设备有限公司 | A kind of method, terminal and computer-readable medium for aiding in amendment word |
| CN108182249A (en) * | 2017-12-28 | 2018-06-19 | 深圳Tcl新技术有限公司 | Text query method, apparatus and computer readable storage medium |
-
2018
- 2018-07-03 CN CN201810720339.7A patent/CN109035368A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140081634A1 (en) * | 2012-09-18 | 2014-03-20 | Qualcomm Incorporated | Leveraging head mounted displays to enable person-to-person interactions |
| CN103050025A (en) * | 2012-12-20 | 2013-04-17 | 广东欧珀移动通信有限公司 | Mobile terminal learning method and learning system thereof |
| CN103761326A (en) * | 2014-01-29 | 2014-04-30 | 百度在线网络技术（北京）有限公司 | Image search method and search engine |
| CN106469112A (en) * | 2015-08-17 | 2017-03-01 | 深圳市中兴微电子技术有限公司 | A kind of information processing system, method and electronic equipment |
| CN106294666A (en) * | 2016-08-04 | 2017-01-04 | 上海汽笛生网络科技有限公司 | A kind of method realizing text visualization Dynamic Display |
| CN107122039A (en) * | 2017-03-15 | 2017-09-01 | 苏州大学 | A kind of intelligent vision auxiliary strengthening system and its application method |
| CN107169430A (en) * | 2017-05-02 | 2017-09-15 | 哈尔滨工业大学深圳研究生院 | Reading environment audio strengthening system and method based on image procossing semantic analysis |
| CN107423392A (en) * | 2017-07-24 | 2017-12-01 | 上海明数数字出版科技有限公司 | Word, dictionaries query method, system and device based on AR technologies |
| CN107885345A (en) * | 2017-10-17 | 2018-04-06 | 深圳市金立通信设备有限公司 | A kind of method, terminal and computer-readable medium for aiding in amendment word |
| CN107832229A (en) * | 2017-12-03 | 2018-03-23 | 中国直升机设计研究所 | A kind of system testing case automatic generating method based on NLP |
| CN108182249A (en) * | 2017-12-28 | 2018-06-19 | 深圳Tcl新技术有限公司 | Text query method, apparatus and computer readable storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109871753A (en) * | 2019-01-08 | 2019-06-11 | 上海玄彩美科网络科技有限公司 | A kind of text handling method and equipment based on augmented reality |
| CN109871432A (en) * | 2019-02-19 | 2019-06-11 | 广东小天才科技有限公司 | Word searching method and device, terminal equipment and computer readable storage medium |
| CN111274352A (en) * | 2020-01-14 | 2020-06-12 | 北大方正集团有限公司 | Method and equipment for marking characteristic characters in tool book |
| CN111274352B (en) * | 2020-01-14 | 2023-05-26 | 北大方正集团有限公司 | Method and equipment for marking characteristic words in tool book |
| CN111858855A (en) * | 2020-07-20 | 2020-10-30 | 百度在线网络技术（北京）有限公司 | Information query method, device, system, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20250342828A1 (en) | Digital assistant control of applications | |
| JP7247442B2 (en) | Information processing method, device, electronic device and storage medium in user interaction | |
| KR102482262B1 (en) | Apparatus and method for augmenting data using object segmentation and background synthesis | |
| KR102576135B1 (en) | Sensory eyewear | |
| US20210097089A1 (en) | Knowledge graph building method, electronic apparatus and non-transitory computer readable storage medium | |
| US20220329922A1 (en) | Method and platform of generating a short video, electronic device, and storage medium | |
| US11392213B2 (en) | Selective detection of visual cues for automated assistants | |
| JP6986187B2 (en) | Person identification methods, devices, electronic devices, storage media, and programs | |
| CN110446063A (en) | Generation method, device and the electronic equipment of video cover | |
| CN109783094A (en) | Front end page generation method, device, computer equipment and storage medium | |
| CN109035368A (en) | For the information processing method of AR scene, device, equipment and storage medium | |
| CN111666006B (en) | Method and device for drawing question and answer, drawing question and answer system and readable storage medium | |
| US20170337222A1 (en) | Image searching method and apparatus, an apparatus and non-volatile computer storage medium | |
| CN109063662A (en) | Data processing method, device, equipment and storage medium | |
| CN105912717A (en) | Image-based information searching method and device | |
| CN109309878A (en) | The generation method and device of barrage | |
| CN112487242A (en) | Method and device for identifying video, electronic equipment and readable storage medium | |
| CN113596601A (en) | Video picture positioning method, related device, equipment and storage medium | |
| CN115810062A (en) | Scene graph generation method, device and equipment | |
| WO2025031067A1 (en) | Image processing method and apparatus, device, and computer readable storage medium | |
| CN120493947B (en) | A method, device and equipment for constructing multimodal cross-domain question-answering data | |
| CN117351952A (en) | Voice command interaction method, device, electronic device and storage medium | |
| CN118312071A (en) | Display method and display system | |
| CN116934923A (en) | Digital person generation method, device, electronic equipment and storage medium | |
| CN109241299A (en) | Multimedia resource searching method, device, storage medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181218 |