CN101764839A - Data access method and uniform resource locator (URL) server - Google Patents

Data access method and uniform resource locator (URL) server Download PDF

Info

Publication number
CN101764839A
CN101764839A CN200910252514A CN200910252514A CN101764839A CN 101764839 A CN101764839 A CN 101764839A CN 200910252514 A CN200910252514 A CN 200910252514A CN 200910252514 A CN200910252514 A CN 200910252514A CN 101764839 A CN101764839 A CN 101764839A
Authority
CN
China
Prior art keywords
url
server
url server
resource
stored
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN200910252514A
Other languages
Chinese (zh)
Other versions
CN101764839B (en
Inventor
文海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Huawei Technology Co Ltd
Original Assignee
Huawei Symantec Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Symantec Technologies Co Ltd filed Critical Huawei Symantec Technologies Co Ltd
Priority to CN200910252514.5A priority Critical patent/CN101764839B/en
Publication of CN101764839A publication Critical patent/CN101764839A/en
Application granted granted Critical
Publication of CN101764839B publication Critical patent/CN101764839B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)

Abstract

本发明实施例公开了一种数据访问方法以及统一资源定位符服务器，用于提高网络文件系统可靠性、系统性能以及可扩展性。本发明实施例方法包括：第一URL服务器接收用户发送的携带有URL地址的数据访问请求；若第一URL服务器确定URL地址所指向的资源存储在第一URL服务器中，则根据数据访问请求对资源执行相应的读写操作；若不存储在第一URL服务器中，则查询URL地址所指向的资源所在的第二URL服务器，向第二URL服务器转发数据访问请求，以使得第二URL服务器根据数据访问请求对资源执行相应的读写操作。本发明实施例还提供统一资源定位符服务器。本发明实施例可以有效提高网络文件系统可靠性、系统性能以及可扩展性。

The embodiment of the invention discloses a data access method and a uniform resource locator server, which are used to improve the reliability, system performance and scalability of the network file system. The method in the embodiment of the present invention includes: the first URL server receives the data access request carrying the URL address sent by the user; if the first URL server determines that the resource pointed to by the URL address is stored in the first URL server, then according to the data access request The resource performs corresponding read and write operations; if it is not stored in the first URL server, query the second URL server where the resource pointed to by the URL address is located, and forward the data access request to the second URL server, so that the second URL server according to Data access requests perform corresponding read and write operations on resources. The embodiment of the present invention also provides a uniform resource locator server. The embodiments of the present invention can effectively improve the reliability, system performance and scalability of the network file system.

Description

A kind of data access method and URL server
Technical field
The present invention relates to the communications field, relate in particular to a kind of data access method and URL server.
Background technology
Along with the development of large scale network storage, visit by network and to be stored in when becoming more and more general, also performance is also had higher requirement.The visit data most common form is passed through browser access exactly on the internet, the URL(uniform resource locator) (URL, Uniform Resource Locator) that is similar to " http://www.myweb.com/html_2/1.html " is exactly the most frequently used expression mode of access to netwoks.
A kind of network file storage mode of the prior art is traditional network distribution type storage, several data storage servers link to each other with a meta data server, this meta data server links to each other with an interface server again, this interface server can provide user interface to the user, the user can carry out data access by this interface server, after meta data server receives user's access request, can inquire about to each data storage server, feed back to the user after inquiring corresponding resource.
But in the above-mentioned technical scheme, metadata is all concentrated and is kept in the meta data server, in case meta data server breaks down, then whole NFS is paralysis directly;
Secondly, the processing of request that the user sends and the processing of network file are all finished by interface server, this has proposed very high performance requirement with regard to the docking port server, this may make interface server become the bottleneck of NFS, thereby influence the performance of NFS, and when the interface server fault, whole NFS also can directly be paralysed.
Summary of the invention
The embodiment of the invention provides a kind of data access method and URL server, can improve reliability, systematic function and the extensibility of NFS.
The embodiment of the invention provides a kind of data access method, comprising:
The first uniform resource position mark URL server receives the data access request that the user sends, and carries the URL address in the described data access request;
The one URL server judges whether described URL address resource pointed is stored in the URL server;
If a URL server determines that described URL address resource pointed is stored in the URL server, then carries out corresponding read-write operation according to described data access request to described resource;
If a URL server determines that described URL address resource pointed is not stored in the URL server, then inquires about the 2nd URL server at resource place pointed, described URL address; To the described data access request of described the 2nd URL server forwards, so that described the 2nd URL server is carried out corresponding read-write operation according to described data access request to described resource.
The embodiment of the invention also provides a kind of URL server, comprising:
Receiver module is used to receive the data access request that the user sends, and carries the URL address in the described data access request;
Detection module is used for judging whether the described URL address resource pointed that described access request that described receiver module receives is carried is stored in the URL server;
Operational module is used for according to described data access request described resource being carried out corresponding read-write operation when described detection module judges that described URL address resource pointed is stored in a URL server;
Enquiry module is used for inquiring about the 2nd URL server at resource place pointed, described URL address when described detection module judges that described URL address resource pointed is not stored in a URL server;
Forwarding module is used for the described data access request of described the 2nd URL server forwards that inquires to described enquiry module, so that described the 2nd URL server is carried out corresponding read-write operation according to described data access request to described resource.
As can be seen from the above technical solutions, the embodiment of the invention has the following advantages:
In the embodiment of the invention, the one URL server can receive the data access request that the user sends, if the data that definite user need visit are in this locality, then carry out and carry out data processing in this locality, if the data that definite user need visit are at the 2nd URL server, then a URL server can be sent to data access request the 2nd URL server and handles, all preserve separately independently data and metadata in each URL server, metadata in each URL server all only is associated with data in this URL server, and can not be associated with the data in the 2nd URL server, therefore, can not make whole NFS paralyse even some URL servers break down yet, thereby can improve the reliability of NFS;
Secondly, for each URL server, if the data that definite user need visit are not in this locality, then the URL server that data access request can be forwarded to other is handled, promptly in NFS, there is not a server that is specifically designed to deal with data access request and data, therefore there is not bottleneck, thereby can improves system effectiveness, improve the reliability of NFS simultaneously;
Once more, the data that each URL server is stored are relatively independent, data access request also can be transmitted between different URL servers according to concrete needs, promptly in NFS, there is not a server that is specifically designed to the data in each URL server of management, so when needing bigger data capacity, can directly increase new URL server, only needing to revise the corresponding relation of being preserved in each URL server gets final product, therefore the new URL server of increase that in theory can be unlimited, thus the extensibility of NFS improved greatly.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do one to the accompanying drawing of required use in embodiment or the description of the Prior Art below introduces simply, apparently, accompanying drawing in describing below is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is a schematic network structure in the embodiment of the invention;
Fig. 2 is embodiment schematic diagram of data access method in the embodiment of the invention;
Fig. 3 is another embodiment schematic diagram of data access method in the embodiment of the invention;
Fig. 4 is a URL server implementation illustration intention in the embodiment of the invention;
Fig. 5 is a communication system embodiment schematic diagram in the embodiment of the invention.
Embodiment
The embodiment of the invention provides a kind of data access method and URL server, can improve reliability, systematic function and the extensibility of NFS.
For ease of explanation, introduce a specific embodiment of the present invention below.As shown in Figure 1, be the schematic network structure in the embodiment of the invention, this network comprises: subscriber equipment, customer access equipment and a plurality of URL server, wherein, subscriber equipment is used to send user access request, customer access equipment is used for subscriber equipment is linked into network, and the URL server is used for the access request that process user equipment sends.
In the present embodiment, need pre-determine a URL server, be example with a URL server below, and the data access method is described in detail.
As shown in Figure 2, embodiment of data access method comprises in the embodiment of the invention:
201, a URL server receives the data access request that the user sends;
In the present embodiment, when the user asks visit data, can send data access request, carry the URL address of the data that need visit in this data access request by the customer access equipment in the network.
NFS in the present embodiment by several independently the URL server form, a URL server wherein can receive the data access request that this user sends from customer access equipment.
202, a URL server judges whether this URL address resource pointed is stored in the URL server, if then execution in step 203, if not, then execution in step 204;
After a URL server parses obtains URL address in the data access request, can judge then whether this URL address resource pointed is stored in the URL server.
The resource that the URL address is pointed to can be Webpage, data resource etc., and for example: during the HTTP visit, URL points to a Webpage; During the FTP visit, URL points to a data resource.
203, according to data access request resource is carried out corresponding read-write operation;
If URL address resource pointed is stored in the URL server, then a URL server can carry out corresponding read-write operation to this resource according to data access request, for example according to data access request resource is made amendment, add, or deletion etc.
This flow process finishes.
204, inquire about the 2nd URL server at resource place pointed, URL address;
If URL address resource pointed is not stored in the URL server, then a URL server is according to the 2nd URL server of this URL address lookup correspondence.
205, to the 2nd URL server forwards data access request.
After inquiring the 2nd corresponding URL server, a URL server can be to the 2nd URL server forwards data access request, so that the 2nd URL server is carried out corresponding read-write operation according to data access request to resource.
This flow process finishes.
In the present embodiment, the one URL server can receive the data access request that the user sends, if the data that definite user need visit are in this locality, then carry out and carry out data processing in this locality, if the data that definite user need visit are at the 2nd URL server, then a URL server can be sent to data access request the 2nd URL server and handles, all preserve separately independently data and metadata in each URL server, metadata in each URL server all only is associated with data in this URL server, and can not be associated with the data in the 2nd URL server, therefore, can not make whole NFS paralyse even some URL servers break down yet, thereby can improve the reliability of NFS;
Secondly, for each URL server, if the data that definite user need visit are not in this locality, then the URL server that data access request can be forwarded to other is handled, promptly in NFS, there is not a server that is specifically designed to deal with data access request and data, therefore there is not bottleneck, thereby can improves system effectiveness, improve the reliability of NFS simultaneously;
Once more, the data that each URL server is stored are relatively independent, data access request also can be transmitted between different URL servers according to concrete needs, promptly in NFS, there is not a server that is specifically designed to the data in each URL server of management, so when needing bigger data capacity, can directly increase new URL server, only needing to revise the corresponding relation of being preserved in each URL server gets final product, therefore the new URL server of increase that in theory can be unlimited, thus the extensibility of NFS improved greatly.
For ease of understanding, with an instantiation data access method in the embodiment of the invention is described in detail below, see also Fig. 3, another embodiment of data access method comprises in the embodiment of the invention:
301, a URL server receives the data access request that the user sends;
In the present embodiment, when the user asks visit data, can send data access request, carry the URL address of the data that need visit in this data access request by the customer access equipment in the network.
In the present embodiment, a URL server can be the information definite URL server of customer access equipment according to each URL server of this locality configuration, and a URL server can have multiple situation in actual applications, for example:
(1), a URL server is the URL server that customer access equipment is selected in each URL server at random.
Under this mode, customer access equipment need not to carry out calculating operation, directly selects a URL server to get final product at random, can effectively reduce the load of customer access equipment like this.
(2), a URL server is the physical location of customer access equipment according to each URL server, selection and the user between a nearest URL server of physical distance.
Under this mode, URL server and the physical distance between the user that customer access equipment is chosen are nearest, thus can faster data access request be sent to the URL server, so that reduce the time of delay of data access.
(3), a URL server is the URL server of customer access equipment according to the load minimum of the current loading condition selection of each URL server.
Under this mode, each URL server needs in real time to report separately loading condition to customer access equipment, and the URL server that customer access equipment is chosen the load minimum comes the effectively load between each URL server of equilibrium of deal with data access request.
Need to prove, the external address that each URL server in the present embodiment is represented is identical, this external address can be Internet protocol (IP, Intemet Protocol) address, it perhaps is the address of non-IP class, for example adopt the address of cable conversion (InfiniBand) mode etc., with the IP address is example, each URL server (being whole NFS) can be 192.168.0.1 to the address that the user embodies, this address can be " www.myweb.com " then during the data of user in this NFS of request visit through domain name change server, and URL address entrained in data access request can be " http://www.myweb.com/html_2/dir22/1.html ".
302, use the URL address in system directory, to mate;
In the present embodiment, in each URL server, all preserve the corresponding relation between device identification and the system directory, be used for representing which device identification corresponding equipment is the resource of which system directory be stored in, for example can be as shown in the table:
Table 1
Device identification Home address The URL file system directories
Equipment 1 ??192.168.0.8 ??http://www.myweb.com/html_2/
Equipment 2 ??192.168.0.9 ??http://www.myweb.com/html_2/dir22/
The one URL server can mate in the corresponding relation shown in the table 1 according to the URL address in the data access request.
303, the longest system directory corresponding equipment sign that matches in inquiry URL address;
After mate in system directory use URL address, can determine the longest system directory that matches in URL address, with the address between the slash in the URL address is a comparative unit, is exactly the longest system directory that matches with having the system directory of identical at most comparative unit between this URL address.For example in the above-mentioned table 1 that " http://www.myweb.com/html_2/dir22/1.html " preserves in a URL server, the comparative unit identical with system directory http://www.myweb.com/html_2/ is two, the comparative unit identical with system directory http://www.myweb.com/html_2/dir22/ is three, therefore, the longest system directory that matches is " http://www.myweb.com/html_2/dir22/ ", afterwards, a URL server can determine that this system directory corresponding equipment is designated " equipment 2 " again.
304, judge whether the device identification that inquires is the device identification of a URL server, if then execution in step 305, if not, then execution in step 306;
In the present embodiment, a URL server lookup can judge whether this device identification that inquires is the device identification of self after device identification, if, illustrate that then the user asks accessed resources to be stored in this locality, if not, illustrate that then the data that the user asks to visit are not stored in this locality.
305, according to data access request resource is carried out corresponding read-write operation;
If the device identification " equipment 2 " that inquires is the device identification of a URL server, then a URL server can carry out corresponding read-write operation to this resource according to data access request, for example resource is made amendment according to data access request, add, or deletion etc., detailed process is those skilled in the art's a common practise, repeats no more herein.
306, inquire about the 2nd URL server of this device identification correspondence;
If the device identification " equipment 2 " that inquires is not the device identification of a URL server, then inquire about the 2nd URL server of this device identification correspondence again, and the address of definite the 2nd URL server, for example can determine that according to table 1 address of the 2nd URL server is " 192.168.0.9 ".
Need to prove, in the present embodiment be with the IP address as home address be example describe be, in actual applications, the home address of URL server can also be the non-IP class address of other types, for example adopt the address of cable conversion (InfiniBand) mode etc., in NFS, the home address of each URL server is all inequality, so that can carry out intercommunication between the different URL servers.
307, to the 2nd URL server forwards data access request.
After the address that inquires the 2nd corresponding URL server, a URL server can be to the 2nd URL server forwards data access request, so that the 2nd URL server is carried out corresponding read-write operation according to data access request to resource.
Need to prove, if the overabundance of data of storing in a certain URL server, or the Data Growth excessive velocities, then can carry out the transfer of resource, for example:
The one URL server judges whether there is the resource to be transferred that satisfies the jump condition that presets in the local stored resource, if exist, then with resource transfers to the three URL servers to be transferred, and upgrade the device identification of preserving in each URL server and the corresponding relation between the system directory.
For ease of understanding, be that example describes below with the practical application: what preserve in the URL server is resource in " http://www.myweb.com/html_2/ ", suppose " .../html_2/ " following first class catalogue in addition " .../html_2/dir33 ", if the data volume of stored resource has reached the threshold value (for example being 10GB) that presets in should " .../dir33 " catalogue, or the growth rate of stored resource has reached and has preset thresholding (for example being 1GB/ days) in should " .../dir33 " catalogue, in order to alleviate the pressure of a URL server, then stored resource in should " .../dir33 " catalogue can be defined as resource to be transferred, stored resource is transferred to the 3rd URL server in should " .../dir33 " catalogue, the 3rd URL server can be the lighter URL server of load in the existing network file system, perhaps can be a server that increases newly.
Be that example describes with the 3rd URL server for newly-increased server in the present embodiment, when a URL server detects resource to be transferred, if the 3rd URL server is reached the standard grade, then a URL server can send the data transfer request to the 3rd URL server, obtain after the feedback of the 3rd URL server, then a URL server sends this resource to be transferred to the 3rd URL server.
Need to prove, the one URL server and the 3rd URL server all can not carry out data read-write operation in the process that data shift, specifically can be with a URL server and the temporary transient off-line of the 3rd URL server, or read-write is set is designated " forbidding ", in the reason of " forbidding ", can also increase " carrying out data shifts ", when the data access request that sends as the user requires to visit data on the URL server just, then a URL server can return the read-write failed message to the user, can carry cause value and be " carrying out data shifts " in this read-write failed message.
After resource transfers is finished, owing to changed system directory, then also need each URL preserved in the whole NFS device identification and the corresponding relation between the system directory are upgraded, concrete renewal operation is since a URL server, device identification after the one URL server is determined to upgrade according to other resources of resource to be transferred and local preservation and the corresponding relation between the system directory, can be as shown in table 2 below:
Table 2
Device identification Home address The URL file system directories
Equipment 1 ??192.168.0.8 ??http://www.myweb.com/html_2/
Equipment 2 ??192.168.0.9 ??http://www.myweb.com/html_2/dir22/
Equipment 3 ??192.168.0.10 ??http://www.myweb.com/html_2/dir33/
After a URL server has been finished the renewal of corresponding relation, corresponding relation after this renewal can be sent to the 2nd URL server (comprising the 3rd URL server), the corresponding relation preserved separately of each URL server update then, when sending corresponding relation, the part that wherein changes can only be sent, for example: the corresponding relation of a transmitting apparatus 3 and URL file system directories.
Need to prove, in the present embodiment, the jump condition that presets only presets thresholding for the data volume of being with transferring resource reaches, or the data volume grow speed of resource to be transferred reaches and presets thresholding, be understandable that, in actual applications, concrete jump condition can also have more situation, and concrete condition does not limit herein.
In the present embodiment, the one URL server can receive the data access request that the user sends, if the data that definite user need visit are in this locality, then carry out and carry out data processing in this locality, if the data that definite user need visit are at the 2nd URL server, then a URL server can be sent to data access request the 2nd URL server and handles, all preserve separately independently data and metadata in each URL server, metadata in each URL server all only the data in this URL server be associated, and can not be associated with the data in the 2nd URL server, therefore, can not make whole NFS paralyse even some URL servers break down yet, thereby can improve the reliability of NFS;
Secondly, for each URL server, if the data that definite user need visit are not in this locality, then the URL server that data access request can be forwarded to other is handled, promptly in NFS, there is not a server that is specifically designed to deal with data access request and data, therefore there is not bottleneck, thereby can improves system effectiveness, improve the reliability of NFS simultaneously;
Once more, when satisfying the jump condition preset, a URL server can be with the URL server of resource transfers to be transferred to other, thereby can reduce the load of a URL server, the performance of balanced each URL server;
Further, the data that each URL server is stored are relatively independent, data access request also can be transmitted between different URL servers according to concrete needs, promptly in NFS, there is not a server that is specifically designed to the data in each URL server of management, so when needing bigger data capacity, can directly increase new URL server, only needing to revise the corresponding relation of being preserved in each URL server gets final product, therefore the new URL server of increase that in theory can be unlimited, thus the extensibility of NFS improved greatly.
Introduce the URL server in the embodiment of the invention below, see also Fig. 4, the URL server in the embodiment of the invention comprises:
Receiver module 401 is used to receive the data access request that the user sends, and carries the URL address in the data access request;
Detection module 402 is used for judging whether the URL address resource pointed that data access request that receiver module 401 receives is carried is stored in the URL server;
Operational module 403 is used for according to data access request URL address resource pointed being carried out corresponding read-write operation when detection module 402 judges that this URL address resource pointed is stored in a URL server;
Enquiry module 404 is used for detection module 402 and judges when this URL address resource pointed is not stored in a URL server, the 2nd URL server at the resource place that inquiry URL address is pointed;
Forwarding module 405 is used for the 2nd URL server forwards data access request that inquires to enquiry module 404, so that the 2nd URL server is carried out corresponding read-write operation according to data access request to resource;
Wherein, detection module 402 comprises:
Matching unit 4021 is used for using this URL address to mate to inquire about this longest system directory that matches in URL address at system directory;
Device identification query unit 4022 is used for the match query unit 4021 the longest system directory corresponding equipment signs that match;
Determining unit 4023, when the device identification that is used for inquiring when device identification query unit 4022 is the device identification of a URL server, determine that this URL address resource pointed is stored in the URL server, when if this device identification is not the device identification of a URL server, determine that then this URL address resource pointed is not stored in the URL server.
Can further include in the URL server in the present embodiment:
Transfer check module 406 is used to judge whether to exist the resource to be transferred that satisfies the jump condition that presets;
Resource transfers module 407 is used for when transfer check module 406 is determined to have the resource to be transferred that satisfies the jump condition that presets, with the URL server of resource transfers to be transferred to other;
Update module 408 is used for upgrading device identification that each URL server preserves and the corresponding relation between the system directory after resource transfers module 407 is finished resource transfers.
Wherein, update module 408 comprises:
Local update unit 4081 is used for according to the local device identification of preserving of other resource updates of resource to be transferred and self storage and the corresponding relation between the system directory;
Upgrade notification unit 4082, be used for device identification and the corresponding relation between the system directory after upgrading are sent to the 2nd URL server, make local device identification of preserving of the 2nd URL server update and the corresponding relation between the system directory.
For ease of understanding, with a concrete application scenarios URL server implementation example in the embodiment of the invention is described below:
In the present embodiment, when the user asks visit data, can send data access request, carry the URL address of the data that need visit in this data access request.
NFS in the present embodiment by several independently the URL server form, the receiver module 401 of a URL server wherein can receive the data access request that this user sends.
In the present embodiment, in each URL server, all preserve the corresponding relation between device identification and the system directory, be used for representing which device identification corresponding equipment is the resource of which system directory be stored in, detection module 402 can use the URL address to mate in system directory, can determine the longest system directory that matches in URL address afterwards, determine this system directory corresponding equipment sign again, thereby judge whether this device identification that inquires is the device identification of self, if, illustrate that then the user asks accessed resources to be stored in this locality, if not, illustrate that then the data that the user asks to visit are not stored in this locality.
If detection module 402 determines that the device identification that inquires is the device identification of a URL server, then operational module 403 can carry out corresponding read-write operation to this resource according to data access request, for example resource is made amendment according to data access request, add, or deletion etc., detailed process is those skilled in the art's a common practise, repeats no more herein.
If detection module 402 determines that the device identification that inquires is not the device identification of a URL server, then enquiry module 404 is inquired about the 2nd URL server of this device identification correspondence again, and determines the address of the 2nd URL server.
After enquiry module 404 inquired the address of the 2nd corresponding URL server, forwarding module 405 can be to the 2nd URL server forwards data access request, so that the 2nd URL server is carried out corresponding read-write operation according to data access request to resource.
Need to prove, if the overabundance of data of storing in a certain URL server, or the Data Growth excessive velocities, then can carry out the transfer of resource, for example:
Transfer check module 406 judges whether there is the resource to be transferred that satisfies the jump condition that presets in the local stored resource, if exist, then resource transfers module 407 is resource transfers to the three URL servers to be transferred, and update module 408 is upgraded the device identification of preserving in each URL server and the corresponding relation between the system directory.
In the present embodiment, receiver module 401 can receive the data access request that the user sends, if the data that detection module 402 definite users need visit are in this locality, then data processing is carried out in operational module 403 execution in this locality, if the data that detection module 402 definite users need visit are at the 2nd URL server, then enquiry module 404 and forwarding module 405 can be sent to the 2nd URL server with data access request and handle, all preserve separately independently data and metadata in each URL server, metadata in each URL server all only the data in this URL server be associated, and can not be associated with the data in the 2nd URL server, therefore, can not make whole NFS paralyse even some URL servers break down yet, thereby can improve the reliability of NFS;
Secondly, for each URL server, if the data that definite user need visit are not in this locality, then the URL server that data access request can be forwarded to other is handled, promptly in NFS, there is not a server that is specifically designed to deal with data access request and data, therefore there is not bottleneck, thereby can improves system effectiveness, improve the reliability of NFS simultaneously;
Once more, when satisfying the jump condition preset, resource transfers module 407 can be with the URL server of resource transfers to be transferred to other, thereby can reduce the load of a URL server, the performance of balanced each URL server;
Further, the data that each URL server is stored are relatively independent, data access request also can be transmitted between different URL servers according to concrete needs, promptly in NFS, there is not a server that is specifically designed to the data in each URL server of management, so when needing bigger data capacity, can directly increase new URL server, only needing to revise the corresponding relation of being preserved in each URL server gets final product, therefore the new URL server of increase that in theory can be unlimited, thus the extensibility of NFS improved greatly.
Introduce the communication system in the embodiment of the invention below, see also Fig. 5, the communication system embodiment in the embodiment of the invention comprises at least two URL servers, is respectively a URL server 501 and the 2nd URL server 502.
Wherein, the URL server 501 in the present embodiment and the concrete structure of the 2nd URL server 502 and function can be identical with aforementioned URL server shown in Figure 4, repeat no more herein.
Be that example describes with two URL servers only in the present embodiment, be understandable that more URL server can also be arranged in actual applications, concrete quantity does not limit herein.
In the present embodiment, the one URL server 501 can receive the data access request that the user sends, if the data that definite user need visit are in this locality, then carry out and carry out data processing in this locality, if the data that definite user need visit are at the 2nd URL server 502, then a URL server 501 can be sent to the 2nd URL server 502 with data access request and handles, all preserve separately independently data and metadata in each URL server, metadata in each URL server all only the data in this URL server be associated, and can not be associated with the data in other URL server, therefore, can not make whole NFS paralyse even some URL servers break down yet, thereby can improve the reliability of NFS;
Secondly, for each URL server, if the data that definite user need visit are not in this locality, then the URL server that data access request can be forwarded to other is handled, promptly in NFS, there is not a server that is specifically designed to deal with data access request and data, therefore there is not bottleneck, thereby can improves system effectiveness, improve the reliability of NFS simultaneously;
Once more, the data that each URL server is stored are relatively independent, data access request also can be transmitted between different URL servers according to concrete needs, promptly in NFS, there is not a server that is specifically designed to the data in each URL server of management, so when needing bigger data capacity, can directly increase new URL server, only needing to revise the corresponding relation of being preserved in each URL server gets final product, therefore the new URL server of increase that in theory can be unlimited, thus the extensibility of NFS improved greatly.
One of ordinary skill in the art will appreciate that all or part of step that realizes in the foregoing description method is to instruct relevant hardware to finish by program, above-mentioned program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium of mentioning can be a read-only memory, disk or CD etc.
More than a kind of data access method provided by the present invention and URL server are described in detail, for one of ordinary skill in the art, thought according to the embodiment of the invention, part in specific embodiments and applications all can change, therefore, this description should not be construed as limitation of the present invention.

Claims (10)

1.一种数据访问方法，其特征在于，包括：1. A data access method, characterized in that, comprising: 第一统一资源定位符URL服务器接收用户发送的数据访问请求，所述数据访问请求中携带有URL地址；The first Uniform Resource Locator URL server receives the data access request sent by the user, and the data access request carries a URL address; 第一URL服务器判断所述URL地址所指向的资源是否存储在第一URL服务器中；The first URL server determines whether the resource pointed to by the URL address is stored in the first URL server; 若第一URL服务器确定所述URL地址所指向的资源存储在第一URL服务器中，则根据所述数据访问请求对所述资源执行相应的读写操作；If the first URL server determines that the resource pointed to by the URL address is stored in the first URL server, perform corresponding read and write operations on the resource according to the data access request; 若第一URL服务器确定所述URL地址所指向的资源不存储在第一URL服务器中，则查询所述URL地址所指向的资源所在的第二URL服务器；向所述第二URL服务器转发所述数据访问请求，以使得所述第二URL服务器根据所述数据访问请求对所述资源执行相应的读写操作。If the first URL server determines that the resource pointed to by the URL address is not stored in the first URL server, then query the second URL server where the resource pointed to by the URL address is located; A data access request, so that the second URL server performs corresponding read and write operations on the resource according to the data access request. 2.根据权利要求1所述的方法，其特征在于，第一URL服务器判断所述URL地址所指向的资源是否存储在第一URL服务器中，包括：2. The method according to claim 1, wherein the first URL server determines whether the resource pointed to by the URL address is stored in the first URL server, comprising: 第一URL服务器使用所述URL地址在系统目录中进行匹配以查询所述URL地址最长匹配到的系统目录；The first URL server uses the URL address to perform matching in the system catalog to query the system catalog that the URL address matches the longest; 查询最长匹配到的系统目录对应的设备标识；Query the device ID corresponding to the longest matching system directory; 若所述设备标识为所述第一URL服务器的设备标识，则确定所述URL地址所指向的资源存储在第一URL服务器中，若所述设备标识不为所述第一URL服务器的设备标识，则确定所述URL地址所指向的资源不存储在第一URL服务器中。If the device identifier is the device identifier of the first URL server, then determine that the resource pointed to by the URL address is stored in the first URL server, if the device identifier is not the device identifier of the first URL server , it is determined that the resource pointed to by the URL address is not stored in the first URL server. 3.根据权利要求1或2所述的方法，其特征在于，所述方法还包括：3. The method according to claim 1 or 2, characterized in that the method further comprises: 第一URL服务器判断本地存储的资源中是否存在满足预置的转移条件的待转移资源，若存在，则将所述待转移资源转移至第三URL服务器；The first URL server judges whether there is a resource to be transferred that satisfies a preset transfer condition among the resources stored locally, and if so, transfers the resource to be transferred to a third URL server; 更新各URL服务器中保存的设备标识与系统目录之间的对应关系。The corresponding relationship between the device identification and the system catalog stored in each URL server is updated. 4.根据权利要求3所述的方法，其特征在于，所述更新各URL服务器中保存的设备标识与系统目录之间的对应关系包括：4. The method according to claim 3, wherein said updating the correspondence between the device identification and the system catalog stored in each URL server comprises: 第一URL服务器根据所述待转移资源以及自身存储的其他资源更新本地保存的设备标识与系统目录之间的对应关系；The first URL server updates the correspondence between the locally stored device identifier and the system catalog according to the resource to be transferred and other resources stored by itself; 第一URL服务器将更新后的设备标识与系统目录之间的对应关系发送至其他URL服务器，使得所述第二URL服务器更新本地保存的设备标识与系统目录之间的对应关系。The first URL server sends the updated correspondence between the device identifier and the system directory to other URL servers, so that the second URL server updates the locally stored correspondence between the device identifier and the system directory. 5.根据权利要求3所述的方法，其特征在于，所述满足预置的转移条件为所述待转移资源的数据量达到预置门限，或所述待转移资源的数据量增长速度达到预置门限。5. The method according to claim 3, wherein the satisfying of the preset transfer condition is that the data volume of the resource to be transferred reaches a preset threshold, or the growth rate of the data volume of the resource to be transferred reaches a preset threshold. set the threshold. 6.根据权利要求1所述的方法，其特征在于，6. The method of claim 1, wherein, 所述第一URL服务器为随机选取的URL服务器；The first URL server is a randomly selected URL server; 或，or, 所述第一URL服务器为与所述用户之间的物理距离最近的URL服务器；The first URL server is the URL server with the closest physical distance to the user; 或，or, 所述第一URL服务器为负载最小的URL服务器。The first URL server is the URL server with the least load. 7.一种URL服务器，其特征在于，包括：7. A URL server, characterized in that, comprising: 接收模块，用于接收用户发送的数据访问请求，所述数据访问请求中携带有URL地址；A receiving module, configured to receive a data access request sent by a user, wherein the data access request carries a URL address; 检测模块，用于判断所述接收模块接收的所述访问请求中携带的所述URL地址所指向的资源是否存储在第一URL服务器中；A detection module, configured to determine whether the resource pointed to by the URL address carried in the access request received by the receiving module is stored in the first URL server; 操作模块，用于当所述检测模块判断所述URL地址所指向的资源存储在第一URL服务器中时，根据所述数据访问请求对所述资源执行相应的读写操作；An operation module, configured to perform corresponding read and write operations on the resource according to the data access request when the detection module judges that the resource pointed to by the URL address is stored in the first URL server; 查询模块，用于当所述检测模块判断所述URL地址所指向的资源不存储在第一URL服务器中时，查询所述URL地址所指向的资源所在的第二URL服务器；A query module, configured to query a second URL server where the resource pointed to by the URL address is located when the detection module judges that the resource pointed to by the URL address is not stored in the first URL server; 转发模块，用于向所述查询模块查询到的所述第二URL服务器转发所述数据访问请求，以使得所述第二URL服务器根据所述数据访问请求对所述资源执行相应的读写操作。A forwarding module, configured to forward the data access request to the second URL server queried by the query module, so that the second URL server performs corresponding read and write operations on the resource according to the data access request . 8.根据权利要求7所述的URL服务器，其特征在于，所述检测模块包括：8. URL server according to claim 7, is characterized in that, described detection module comprises: 匹配单元，用于使用所述URL地址在系统目录中进行匹配以查询所述URL地址最长匹配到的系统目录；A matching unit, configured to use the URL address to perform matching in the system catalog to query the system catalog that the URL address matches the longest; 设备标识查询单元，用于查询所述匹配单元最长匹配到的系统目录对应的设备标识；A device identification query unit, configured to query the device identification corresponding to the system catalog longest matched by the matching unit; 确定单元，用于当所述设备标识查询单元查询到的所述设备标识为所述第一URL服务器的设备标识时，确定所述URL地址所指向的资源存储在第一URL服务器中，若所述设备标识不为所述第一URL服务器的设备标识时，则确定所述URL地址所指向的资源不存储在第一URL服务器中。a determining unit, configured to determine that the resource pointed to by the URL address is stored in the first URL server when the device identifier queried by the device identifier query unit is the device identifier of the first URL server; If the device identifier is not the device identifier of the first URL server, it is determined that the resource pointed to by the URL address is not stored in the first URL server. 9.根据权利要求7或8所述的URL服务器，其特征在于，所述URL服务器还包括：9. The URL server according to claim 7 or 8, wherein the URL server further comprises: 转移校验模块，用于判断是否存在满足预置的转移条件的待转移资源；A transfer verification module, configured to determine whether there are resources to be transferred that meet preset transfer conditions; 资源转移模块，用于当存在满足预置的转移条件的待转移资源时，将所述待转移资源转移至其他的URL服务器；A resource transfer module, configured to transfer the resource to be transferred to another URL server when there is a resource to be transferred that satisfies a preset transfer condition; 更新模块，用于更新各URL服务器中保存的设备标识与系统目录之间的对应关系。The update module is used to update the corresponding relationship between the device identification and the system catalog stored in each URL server. 10.根据权利要求9所述的URL服务器，其特征在于，所述更新模块包括：10. URL server according to claim 9, is characterized in that, described updating module comprises: 本地更新单元，用于根据所述待转移资源以及自身存储的其他资源更新本地保存的设备标识与系统目录之间的对应关系；A local update unit, configured to update the correspondence between the locally stored device identifier and the system catalog according to the resource to be transferred and other resources stored by itself; 更新通告单元，用于将更新后的设备标识与系统目录之间的对应关系发送至所述第二URL服务器，使得所述第二URL服务器更新本地保存的设备标识与系统目录之间的对应关系。An update notification unit, configured to send the updated correspondence between the device identification and the system catalog to the second URL server, so that the second URL server updates the correspondence between the locally stored equipment identification and the system catalog .
CN200910252514.5A 2009-12-23 2009-12-23 Data access method and uniform resource locator (URL) server Expired - Fee Related CN101764839B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200910252514.5A CN101764839B (en) 2009-12-23 2009-12-23 Data access method and uniform resource locator (URL) server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200910252514.5A CN101764839B (en) 2009-12-23 2009-12-23 Data access method and uniform resource locator (URL) server

Publications (2)

Publication Number Publication Date
CN101764839A true CN101764839A (en) 2010-06-30
CN101764839B CN101764839B (en) 2013-01-23

Family

ID=42495821

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200910252514.5A Expired - Fee Related CN101764839B (en) 2009-12-23 2009-12-23 Data access method and uniform resource locator (URL) server

Country Status (1)

Country Link
CN (1) CN101764839B (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101917479A (en) * 2010-08-20 2010-12-15 北京新岸线网络技术有限公司 Method and device for improving grouped data service in mobile network
CN102083100A (en) * 2010-12-31 2011-06-01 百度在线网络技术（北京）有限公司 Method and device for detecting states of multiple resource links based on sites
CN102946449A (en) * 2012-11-28 2013-02-27 网神信息技术（北京）股份有限公司 Uniform resource locator (URL) matching method, device and gateway
CN103560937A (en) * 2013-11-01 2014-02-05 北京蓝汛通信技术有限责任公司 Data accessing method and entry server
CN104519088A (en) * 2013-09-27 2015-04-15 方正宽带网络服务股份有限公司 Buffer memory system realization method and buffer memory system
CN104618430A (en) * 2014-12-25 2015-05-13 华为技术有限公司 Method and system for achieving returning of internet cache system resource
CN104702634A (en) * 2013-12-04 2015-06-10 腾讯科技（深圳）有限公司 Method, device and system for processing data operation request
CN104935668A (en) * 2015-06-26 2015-09-23 四川长虹电器股份有限公司 Distributed file system and data synchronization method therefor
CN105741031A (en) * 2016-01-28 2016-07-06 北京恒华伟业科技股份有限公司 Project design plan processing method and device
CN105915621A (en) * 2016-05-11 2016-08-31 深圳市永兴元科技有限公司 Data access method and pretreatment server
CN106817381A (en) * 2015-11-27 2017-06-09 阿里巴巴集团控股有限公司 Data processing method and device
CN107172102A (en) * 2017-07-13 2017-09-15 上海联影医疗科技有限公司 Data access method, system and storage medium
WO2018032788A1 (en) * 2016-08-16 2018-02-22 中兴通讯股份有限公司 Resource sharing method and device
WO2018050055A1 (en) * 2016-09-13 2018-03-22 腾讯科技（深圳）有限公司 Data request processing method and system, access device, and storage device therefor
CN107835256A (en) * 2017-12-08 2018-03-23 福建润哲网络科技有限公司 A kind of double stack cache resources sharing methods of IPv4 IPv6 based on http protocol and device
CN107835089A (en) * 2017-09-28 2018-03-23 华为技术有限公司 The method and apparatus for managing resource
CN109542895A (en) * 2018-10-25 2019-03-29 北京开普云信息科技有限公司 A kind of method for managing resource and system based on the customized extension of metadata
CN111314414A (en) * 2019-12-17 2020-06-19 聚好看科技股份有限公司 Data transmission method, device and system
CN115619339A (en) * 2022-09-29 2023-01-17 中国建设银行股份有限公司 Data processing method, system, device, medium and computer program product
CN116938964A (en) * 2022-04-11 2023-10-24 中国移动通信集团辽宁有限公司 Method, device, equipment and storage medium for determining resource position

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108241648A (en) * 2016-12-23 2018-07-03 中兴通讯股份有限公司 A kind of data processing method and device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101459571A (en) * 2008-12-16 2009-06-17 北京大学 Method, system and apparatus for website mirroring

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100490380C (en) * 2005-12-26 2009-05-20 北大方正集团有限公司 Light distributed file storage system file uploading method
CN100349423C (en) * 2005-12-31 2007-11-14 杭州华三通信技术有限公司 Access method of document in pile system
CN101090401B (en) * 2007-05-25 2011-05-18 金蝶软件（中国）有限公司 Data buffer store method and system at duster environment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101459571A (en) * 2008-12-16 2009-06-17 北京大学 Method, system and apparatus for website mirroring

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101917479A (en) * 2010-08-20 2010-12-15 北京新岸线网络技术有限公司 Method and device for improving grouped data service in mobile network
CN102083100A (en) * 2010-12-31 2011-06-01 百度在线网络技术（北京）有限公司 Method and device for detecting states of multiple resource links based on sites
CN102083100B (en) * 2010-12-31 2014-11-26 百度在线网络技术（北京）有限公司 Method and device for detecting states of multiple resource links based on sites
CN102946449A (en) * 2012-11-28 2013-02-27 网神信息技术（北京）股份有限公司 Uniform resource locator (URL) matching method, device and gateway
CN104519088A (en) * 2013-09-27 2015-04-15 方正宽带网络服务股份有限公司 Buffer memory system realization method and buffer memory system
CN103560937B (en) * 2013-11-01 2017-03-15 北京蓝汛通信技术有限责任公司 Data access method and portal server
CN103560937A (en) * 2013-11-01 2014-02-05 北京蓝汛通信技术有限责任公司 Data accessing method and entry server
CN104702634A (en) * 2013-12-04 2015-06-10 腾讯科技（深圳）有限公司 Method, device and system for processing data operation request
CN104702634B (en) * 2013-12-04 2018-10-02 腾讯科技（深圳）有限公司 Data operation request treatment method, apparatus and system
CN104618430A (en) * 2014-12-25 2015-05-13 华为技术有限公司 Method and system for achieving returning of internet cache system resource
CN104935668A (en) * 2015-06-26 2015-09-23 四川长虹电器股份有限公司 Distributed file system and data synchronization method therefor
CN106817381A (en) * 2015-11-27 2017-06-09 阿里巴巴集团控股有限公司 Data processing method and device
CN105741031A (en) * 2016-01-28 2016-07-06 北京恒华伟业科技股份有限公司 Project design plan processing method and device
CN105915621A (en) * 2016-05-11 2016-08-31 深圳市永兴元科技有限公司 Data access method and pretreatment server
WO2018032788A1 (en) * 2016-08-16 2018-02-22 中兴通讯股份有限公司 Resource sharing method and device
CN107770209B (en) * 2016-08-16 2021-04-16 中兴通讯股份有限公司 Resource sharing method and device
CN107770209A (en) * 2016-08-16 2018-03-06 中兴通讯股份有限公司 Resource share method and device
WO2018050055A1 (en) * 2016-09-13 2018-03-22 腾讯科技（深圳）有限公司 Data request processing method and system, access device, and storage device therefor
US11128622B2 (en) 2016-09-13 2021-09-21 Tencent Technology (Shenzhen) Company Limited Method for processing data request and system therefor, access device, and storage device
CN107172102A (en) * 2017-07-13 2017-09-15 上海联影医疗科技有限公司 Data access method, system and storage medium
CN107835089A (en) * 2017-09-28 2018-03-23 华为技术有限公司 The method and apparatus for managing resource
CN107835089B (en) * 2017-09-28 2020-06-02 华为技术有限公司 Method and device for managing resources
CN107835256A (en) * 2017-12-08 2018-03-23 福建润哲网络科技有限公司 A kind of double stack cache resources sharing methods of IPv4 IPv6 based on http protocol and device
CN109542895B (en) * 2018-10-25 2019-12-06 北京开普云信息科技有限公司 Resource management method and system based on metadata custom extension
CN109542895A (en) * 2018-10-25 2019-03-29 北京开普云信息科技有限公司 A kind of method for managing resource and system based on the customized extension of metadata
CN111314414A (en) * 2019-12-17 2020-06-19 聚好看科技股份有限公司 Data transmission method, device and system
CN111314414B (en) * 2019-12-17 2021-09-28 聚好看科技股份有限公司 Data transmission method, device and system
CN116938964A (en) * 2022-04-11 2023-10-24 中国移动通信集团辽宁有限公司 Method, device, equipment and storage medium for determining resource position
CN115619339A (en) * 2022-09-29 2023-01-17 中国建设银行股份有限公司 Data processing method, system, device, medium and computer program product

Also Published As

Publication number Publication date
CN101764839B (en) 2013-01-23

Similar Documents

Publication Publication Date Title
CN101764839B (en) Data access method and uniform resource locator (URL) server
US11194719B2 (en) Cache optimization
US8495013B2 (en) Distributed storage system and method for storing objects based on locations
US9219705B2 (en) Scaling network services using DNS
CN102164160B (en) Method, device and system for supporting large quantity of concurrent downloading
US8250171B2 (en) Content delivery apparatus, content delivery method, and content delivery program
CN101854378B (en) Data operating method and data operating equipment
CN108319468A (en) Gray scale dissemination method, device, system and electronic equipment
WO2013170715A1 (en) Method and system for loading file in webgame
CN103024053A (en) Cloud storage method, resource scheduling system and cloud storage node and system
CN101316226A (en) A method, device and system for acquiring resources
CN106407011A (en) A routing table-based search system cluster service management method and system
CN101471845A (en) Method for adjusting data block counterpart number and metadata server node
CN108881066A (en) A kind of method of route requests, access server and storage equipment
US9137331B2 (en) Adaptive replication
CN103095587A (en) Method of registration service and network ethnic group central control node and system
EP1565839A2 (en) Index server support to file sharing applications
CN101090371A (en) Method and system for user information management in at-once communication system
CN101170442A (en) Software online upgrade method and system
CN114268631B (en) Low-delay network system, communication connection method thereof and readable storage medium
CN101141482A (en) Network resource management system and method
JP2016099969A (en) Information processing apparatus, data storage system, and data storage method
CN101668029B (en) Network equipment and network communication method
US20170286490A1 (en) Implicit subscriptions in the connection protocol of a network switch
CN103731400A (en) Resource sharing system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C56 Change in the name or address of the patentee

Owner name: HUAWEI DIGITAL TECHNOLOGY (CHENGDU) CO., LTD.

Free format text: FORMER NAME: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES CO., LTD.

CP01 Change in the name or title of a patent holder

Address after: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River

Patentee after: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd.

Address before: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River

Patentee before: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220907

Address after: No. 1899 Xiyuan Avenue, high tech Zone (West District), Chengdu, Sichuan 610041

Patentee after: Chengdu Huawei Technologies Co.,Ltd.

Address before: 611731 Qingshui River District, Chengdu hi tech Zone, Sichuan, China

Patentee before: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130123