CN107222567A - Method, device and the service cluster of processing data request - Google Patents

Abstract

The present application relates to a method, device and service cluster for processing data requests. The method includes: HTTP and a reverse proxy server receive an HTTP access request from a client, obtain access information according to the HTTP access request, and send a message containing the access information to the service cluster. Data request; the service cluster is used to obtain a data request containing access information, and determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch, and if downgrade is required, obtain the request result from the pocket cache, If downgrading is not required, real-time data is obtained according to the data request. The technical solution of the present application can realize dynamic degradation of background services, and can be flexibly configured according to traffic and server conditions.

Description

Method, device and service cluster for processing data requests

technical field

The present application relates to the field of computer application technology, in particular, to a method, device and service cluster for processing data requests.

Background technique

With the gradual development of the Internet, the cost and threshold of accessing the Internet have become lower and lower, and the traffic of the website has increased rapidly. The server of the website often encounters a situation where the traffic suddenly increases at a certain time of the day. For example, in Just before the seckill starts, the sudden increase in traffic will cause the background server to not process in time, and some requesting users will timeout or fail. Failure to successfully obtain data will cause a blank page to appear on the page, which seriously affects the user experience. If the pressure on the server is not reduced in time, it may even cause the entire interface to hang up and all user requests to fail in a serious accident.

A related technique is to increase the background processing capacity by increasing the number of server machines. However, traffic peaks usually occur at specific times and in specific scenarios. If servers are configured according to the maximum traffic standard, a large number of servers will be idle at ordinary times.

There is also a related technology that usually caches a piece of data in the background, and then stores it in redis (an open source, log-type, Key-Value database written in ANSI C language, supports the network, can be based on memory or can be persisted), etc. Set a switch in the cache, and the server will obtain the switch every once in a while. Once the administrator finds that the traffic exceeds the threshold, he will turn on the downgrade switch. All user requests will directly return the bottom data, and no background logic processing will be performed, reducing the pressure on the server. . However, this solution is to put the downgrade switch in the cache and get the cache every once in a while, so it takes a while to take effect after the switch is marked on. Secondly, once the switch is marked on, all users can only You can get the bottom-line data, but it cannot be flexibly configured according to traffic and server conditions. In addition, if the background service is down, the user may still not be able to obtain data, and a blank page may appear, so the downgrade is not real-time, not flexible enough, and not reliable.

Contents of the invention

This application discloses a method for processing data requests, which can realize dynamic degradation of background services and can be flexibly configured according to traffic and server conditions.

Other features and advantages of the invention will become apparent from the following detailed description, or in part, be learned by practice of the invention.

According to a second aspect of the present invention, there is provided a method of processing a data request, comprising:

The HTTP and reverse proxy server receives the HTTP access request of the client, obtains access information according to the HTTP access request, and sends a data request comprising the access information to the service cluster;

The service cluster is used to obtain a data request containing access information, and determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch. If it is downgraded, real-time data is obtained according to the data request.

According to some embodiments, the HTTP and reverse proxy server obtaining access information according to the HTTP access request includes:

The HTTP and reverse proxy server acquires user identification information of the HTTP access request, and acquires a time stamp of receiving the HTTP access request.

According to some embodiments, the method also includes:

Informing the server to monitor whether the redis cache for storing the downgrading ratio switch has been modified, and if the redis cache is detected to be modified, send a notification message to the service cluster;

When the service set receives the notification message, it reads the downgrading ratio switch from the redis cache, and stores the downgrading ratio switch in the local cache of the service cluster.

According to some embodiments, the method further includes: the HTTP and reverse proxy server obtains a static bottom switch according to the configuration information, and if the static bottom switch is an off flag, then obtains the request result according to the static bottom data pre-configured by the administrator;

If the static bottom switch is an on flag, obtain access information according to the HTTP access request, send a data request containing the access information to the service cluster, and store the request result returned by the service cluster in the static In the pocket data.

According to some embodiments, the method further includes, if the client fails to request the HTTP access request to the HTTP and reverse proxy server, obtaining the request result according to the local cache; The server requests that the HTTP access request succeeds, and stores the obtained request result in the local cache.

According to some embodiments, the HTTP and reverse proxy server is an nginx cluster.

According to a second aspect of the present invention, there is provided a method of processing a data request, comprising:

Get data requests that include access information;

determining whether the data request needs to be downgraded according to the access information and the downgrade ratio switch;

If downgrade is required, the request result is obtained from the pocket cache; if downgrade is not required, real-time data is obtained according to the data request.

According to some embodiments, the downgrading ratio switch includes an array whose elements are on flags or off flags.

According to some embodiments, determining whether to downgrade the data request according to the access information and the downgrade ratio switch includes:

performing a hash operation according to the access information to obtain a hash value;

Obtain the corresponding element from the array by using the hash value as an index;

If the acquired element is an open flag, it is determined that the data request does not need to be downgraded, and if the acquired element is an off flag, it is determined that the data request needs to be downgraded.

According to some embodiments, the access information includes user identification information and/or access timestamps.

According to some embodiments:

Send a notification message when the notification server detects that the redis cache for storing the downgrading ratio switch has been modified;

When receiving the notification message sent by the notification server, read the downgrade ratio switch from the redis cache, and store the downgrade ratio switch in a local cache.

According to some embodiments, receiving the notification message sent by the notification server includes: receiving the notification message sent by the notification server through zookeeper.

According to some embodiments, the HTTP and reverse proxy server is used to obtain the access information according to the HTTP access request of the client;

Obtaining the data request including the access information includes: receiving the data request including the access information from the HTTP and reverse proxy server.

According to some embodiments, the HTTP and reverse proxy server is also used to obtain the static bottom switch according to the configuration information. If the static bottom switch is an off flag, the request result is obtained according to the static bottom data pre-configured by the administrator, and no information is sent to the service. The cluster sends the data request including the access information.

According to some embodiments, the HTTP and reverse proxy server is an nginx cluster.

It should be noted that after the nginx cluster accepts the client's request, it can use the real-time data of the server cluster or the static pocket data pre-configured by the administrator.

According to some embodiments, the client is configured to: if requesting the HTTP access request to the HTTP and reverse proxy server fails, obtain the request result according to the local cache; if requesting the HTTP and reverse proxy server for the requested If the HTTP access request is successful, the obtained request result is stored in the local cache.

According to a third aspect of the present invention, there is provided an apparatus for processing data requests, which includes:

a request obtaining unit, configured to obtain a data request including access information;

A downgrade determination unit, configured to determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch;

The request processing unit is configured to obtain the request result from the bottom cache if downgrading is required, and obtain real-time data according to the data request if downgrading is not required.

According to some embodiments, the downgrading ratio switch includes an array whose elements are on flags or off flags.

According to some embodiments, the degradation determination unit is used for:

performing a hash operation according to the access information to obtain a hash value;

Obtain the corresponding element from the array by using the hash value as an index;

If the acquired element is an open flag, it is determined that the data request does not need to be downgraded, and if the acquired element is an off flag, it is determined that the data request needs to be downgraded.

According to some embodiments, the access information includes user identification information and/or access timestamps.

According to some embodiments:

Send a notification message when the notification server detects that the redis cache for storing the downgrading ratio switch has been modified;

The device further includes a switch update unit, configured to read the downgrade ratio switch from the redis cache and store the downgrade ratio switch in a local cache when receiving the notification message sent by the notification server.

According to some embodiments, the switch updating unit is configured to: receive a notification message sent by the notification server through zookeeper.

According to some embodiments, the HTTP and reverse proxy server is used to obtain the access information according to the HTTP access request of the client;

The request acquiring unit is configured to: receive a data request including the access information from the HTTP and reverse proxy server.

According to some embodiments, the HTTP and reverse proxy server is also used to obtain the static bottom switch according to the configuration information. If the static bottom switch is an off flag, the request result is obtained according to the static bottom data pre-configured by the administrator, and no information is sent to the service. The cluster sends the data request including the access information.

According to some embodiments, the HTTP and reverse proxy server is an nginx cluster.

According to some embodiments, the client is configured to: if requesting the HTTP access request to the HTTP and reverse proxy server fails, obtain the request result according to the local cache; if requesting the HTTP and reverse proxy server for the requested If the HTTP access request is successful, the obtained request result is stored in the local cache.

According to a fourth aspect of the present invention, a system for processing data requests is provided, including HTTP and reverse proxy servers, and service clusters, characterized in that:

The HTTP and reverse proxy server are used to receive an HTTP access request, obtain access information according to the HTTP access request, and send a data request including the access information to the service cluster;

The service cluster is used to obtain a data request containing access information, and determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch. If it is downgraded, real-time data is obtained according to the data request.

According to some embodiments, the HTTP and reverse proxy server obtaining access information according to the HTTP access request includes:

The HTTP and reverse proxy server acquires user identification information of the HTTP access request, and acquires a time stamp of receiving the HTTP access request.

According to some embodiments, the system also includes a notification server;

The notification server is used to: monitor whether the redis cache for storing the downgrading ratio switch has been modified, and send a notification message to the service cluster if it detects that the redis cache has been modified;

The service cluster is configured to: read the downgrade ratio switch from the redis cache when receiving the notification message, and store the downgrade ratio switch in a local cache of the service cluster.

According to some embodiments, the HTTP and reverse proxy server are also used to obtain a static bottom switch according to the configuration information, and if the static bottom switch is an off flag, the request result is obtained according to the static bottom data pre-configured by the administrator;

If the static bottom switch is an on flag, obtain access information according to the HTTP access request, send a data request containing the access information to the service cluster, and store the request result returned by the service cluster in the static In the pocket data.

According to some embodiments, the system further includes a client, and the client is configured to, if requesting the HTTP access request to the HTTP and reverse proxy server fails, obtain the request result according to the local cache; The HTTP and reverse proxy server requests that the HTTP access request succeeds, and stores the acquired request result in the local cache.

According to some embodiments, the HTTP and reverse proxy server is an nginx cluster.

According to a fifth aspect of the present invention, there is provided a service cluster, including: a processor; and a memory storing instructions for the processor to control the operations described in any one of the first party.

According to a sixth aspect of the present invention, there is provided a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the operation steps as described in any one of the first party are implemented.

The technical solutions provided by the embodiments of the present application may include the following beneficial effects:

The technical solutions provided by the embodiments of the present application can realize dynamic degradation of background services, and can be flexibly configured according to traffic and server conditions. It is to be understood that both the foregoing general description and the following detailed description are exemplary only and are not restrictive of the invention.

Description of drawings

The above and other features and advantages of the present invention will become more apparent by describing in detail example embodiments thereof with reference to the accompanying drawings.

Fig. 1 shows a method for processing a data request according to an embodiment of the present invention;

Fig. 2 shows a method for processing a data request according to an embodiment of the present invention;

FIG. 3 shows a method for processing a data request according to another embodiment of the present invention;

Fig. 4 shows a schematic diagram of a system for processing data requests according to another embodiment of the present invention;

FIG. 5 shows a logical flowchart of client processing in a system for processing data requests according to an embodiment of the present invention;

Fig. 6 shows HTTP and reverse proxy server processing logic flow chart in the system for processing data requests according to an embodiment of the present invention;

Fig. 7 shows a logical flowchart of notification server processing in the system for processing data requests according to an embodiment of the present invention;

Fig. 8 shows a logical flowchart of service cluster processing in the system for processing data requests according to an embodiment of the present invention;

FIG. 9 shows a schematic diagram of a hash operation process performed by a service cluster in a system for processing data requests according to an embodiment of the present invention;

Fig. 10 shows a block diagram of an apparatus for processing data requests according to an embodiment of the present invention;

Fig. 11 shows a block diagram of an apparatus for processing data requests according to another embodiment of the present invention;

Fig. 12 shows a service cluster according to an embodiment of the present invention.

detailed description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus their repeated descriptions will be omitted.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced without one or more of the specific details, or other methods, components, means, steps, etc. may be employed. In other instances, well-known methods, apparatus, implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the invention.

The block diagrams shown in the drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices entity.

The flow charts shown in the drawings are only exemplary illustrations, and do not necessarily include all contents and operations/steps, nor must they be performed in the order described. For example, some operations/steps can be decomposed, and some operations/steps can be combined or partly combined, so the actual order of execution may be changed according to the actual situation.

FIG. 1 shows a method for processing a data request according to an embodiment of the present invention. As shown in FIG. 1 , the method for processing a data request in this embodiment includes:

In step S110, the HTTP and reverse proxy server receives the HTTP access request from the client, obtains access information according to the HTTP access request, and sends a data request containing the access information to the service cluster.

Wherein, the HTTP and reverse proxy server include but not limited to nginx cluster.

In step S120, the service cluster is used to obtain a data request containing access information, and determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch, and if downgrade is required, obtain the request from the pocket cache As a result, real-time data is obtained according to the data request if no downgrade is required.

Wherein, the HTTP and reverse proxy server obtaining access information according to the HTTP access request may include: the HTTP and reverse proxy server obtaining the user identification information of the HTTP access request, and obtaining the user ID of the HTTP access request timestamp.

The notification server can also monitor whether the redis cache for storing the downgrading ratio switch has been modified, and if it detects that the redis cache has been modified, send a notification message to the service cluster; the service set receives the notification When sending a message, read the downgrading ratio switch from the redis cache, and store the downgrading ratio switch in the local cache of the service cluster.

In addition, the HTTP and reverse proxy server obtains the static bottom switch according to the configuration information, if the static bottom switch is an off flag, then obtains the request result according to the static bottom data preconfigured by the administrator, if the static bottom switch is an open flag Obtain access information according to the HTTP access request, send a data request containing the access information to the service cluster, and store the request result returned by the service cluster in the static pocket data.

It should be noted that if the client fails to request the HTTP access request to the HTTP and reverse proxy server, the request result can also be obtained according to the local cache; if the HTTP access request is requested to the HTTP and reverse proxy server If the request is successful, the obtained request result may be stored in the local cache.

FIG. 2 shows a method for processing data requests according to an embodiment of the present invention. This embodiment is applicable to the situation where the service cluster processes HTTP and client HTTP requests forwarded by the reverse proxy server. The execution subject of the method is the service cluster. As shown in Figure 2, the method for processing data requests described in this embodiment includes:

In step S210, a data request including access information is acquired.

For example, the access information is user identification information, or access time stamp, or user identification information and access time stamp.

In step S220, it is determined whether the data request needs to be downgraded according to the access information and the downgrade ratio switch.

The downgrading ratio switch is a switch set by the administrator, which can be used to control the ratio of real-time data obtained when the current user is allowed to access.

In order to deal with situations such as the sudden increase in traffic at special times such as flash sales promotions that cause the background server to hang up, the request is not processed in time, or the skylight is opened when returning to the page, the related technology uses the administrator to set the traffic threshold switch. Once the administrator finds that the traffic exceeds the threshold Turn on the downgrade switch, and all user requests will directly return the pocket data.

However, compared with the above-mentioned related technologies, the technical solution of this embodiment is different in switch settings and degradation processing. In this embodiment, the downgrade ratio of the background service is dynamically and flexibly controlled through a downgrade ratio switch.

The downgrading ratio switch needs to meet the requirement of the administrator to flexibly set the downgrading ratio according to the expected traffic, and its specific form is not limited in this embodiment. For example, the element is an array of on or off flags. For example, set the downgrade ratio switch to an array whose elements are 0 or 1. Define 0 as the off flag to indicate that downgrade is required, and define 1 as the on flag to indicate that downgrade is not required.

For example, a hash value is obtained by performing a hash operation according to the access information, and the hash value is compared with the downgrade ratio switch to determine whether the data request needs to be downgraded.

In step S230, if downgrade is required, the request result is obtained from the bottom cache, and if downgrade is not required, real-time data is obtained according to the data request.

In this embodiment, after the service cluster side obtains the data request, it is determined whether the data request needs to be downgraded according to the access information and the downgrade ratio switch, so as to choose to obtain the request result from the pocket cache or obtain real-time data according to the data request , which can realize dynamic downgrading of background services, and can be flexibly configured according to traffic and server conditions.

Figure 3 shows a method for processing data requests according to another embodiment of the present invention. This embodiment is applicable to the situation where the service cluster processes HTTP and the client HTTP request forwarded by the reverse proxy server. The execution subject of the method is the service cluster . As shown in Figure 3, the method for processing a data request described in this embodiment includes:

In step S310, when the notification message sent by the notification server is received, the downgrade ratio switch is read from the redis cache, and the downgrade ratio switch is stored in the local cache.

In this embodiment, a notification server is set to perform notification processing, and a notification message is sent when the notification server detects that the redis cache for storing the downgrading ratio switch has been modified.

Therefore, when the service cluster receives the notification message sent by the notification server, it reads the downgrade ratio switch from the redis cache, and stores the downgrade ratio switch in a local cache.

It should be noted that, the notification server may specifically send the notification message to the service cluster through zookeeper.

In step S320, a data request including access information is acquired.

For large-scale e-commerce websites, HTTP and reverse proxy servers, such as nginx cluster, Apache, or haproxy, are generally set up between the service cluster and the client.

Therefore, usually the HTTP and reverse proxy server receives the HTTP access request sent by the client, obtains access information according to the HTTP access request, and sends a data request containing the access information to the service cluster.

In step S330, the downgrading ratio switch is read from the local cache.

It should be noted that, because in step S210, once the downgrading ratio switch is modified, the service cluster can update the latest downgrading ratio switch to the local cache in time, so the downgrading ratio switches in the local cache of the service cluster are all the latest downgrading ratio switches proportional switch.

In step S340, it is determined whether the data request needs to be downgraded according to the access information and the downgrade ratio switch.

In step S350, if downgrade is required, the request result is obtained from the bottom cache, and if downgrade is not required, real-time data is obtained according to the data request.

Further, in order to avoid the situation where the client returns a result and a blank page occurs when the service cluster goes on strike, the HTTP and reverse proxy server can also obtain a static bottom switch according to the configuration information, and if the static bottom switch is an off flag, then according to the management The result of obtaining the request for static pocket data pre-configured by the member, and not sending the data request containing the access information to the service cluster.

Furthermore, in order to prevent the client from requesting the HTTP and reverse proxy server to fail and display a blank page, the client can also be used to: if requesting the HTTP access request to the HTTP and reverse proxy server If it fails, the request result is obtained according to the local cache; if the HTTP access request is successfully requested to the HTTP and reverse proxy server, the obtained request result is stored in the local cache.

On the basis of the foregoing embodiments, this embodiment further adopts a notification method. Once the administrator modifies the class ratio switch, the server is notified to read the downgrade ratio switch from the redis cache, which can ensure the real-time performance of downgrade processing.

Fig. 4 shows a schematic diagram of a system for processing data requests according to another embodiment of the present invention. As shown in Fig. 4, for background systems, the system for processing data requests includes HTTP and reverse proxy servers (such as nginx cluster 410 , taking the nginx cluster as an example in FIG. 4 ), the service cluster 420, and the notification server 430.

The nginx cluster 410 is used to receive an HTTP access request, obtain access information according to the HTTP access request (for example, obtain the user identification information of the HTTP access request, and obtain the time stamp of receiving the HTTP access request), and send the HTTP access request to the The service cluster 420 sends a data request including the access information;

The service cluster 420 is used to obtain a data request containing access information, and determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch. If downgrade is required, the request result is obtained from the pocket cache. If degradation is required, real-time data is obtained according to the data request.

The notification server 430 is configured to: monitor whether the redis cache for storing the downgrade ratio switch has been modified, and send a notification message to the service cluster 420 if it detects that the redis cache has been modified.

The service cluster 420 is further configured to: read the downgrade ratio switch from the redis cache when receiving the notification message, and store the downgrade ratio switch in a local cache of the service cluster 420 .

Further, further, in order to avoid the situation that the client 440 returns a result and a blank page occurs when the service cluster 420 goes on strike, the Nginx cluster 410 is also used to obtain a static bottom switch according to the configuration information, if the static bottom switch is an off flag The request result is obtained according to the static pocket data pre-configured by the administrator.

If the static bottom switch is an open flag, access information is obtained according to the HTTP access request, a data request including the access information is sent to the service cluster 420, and the request result returned by the service cluster 420 is stored in the In the above static pocket data.

Further, in order to avoid the situation that the client 440 fails to request the HTTP and reverse proxy server and presents a blank page, the client 440 can be further improved, for example, if the HTTP access request is requested to the nginx cluster 410 If it fails, the request result is obtained according to the local cache; if the HTTP access request is successfully requested to the nginx cluster 410, the obtained request result is stored in the local cache.

This page describes the processing logic of each module in the system through a logic flow chart.

Fig. 5 shows a flow chart of the client processing logic in the system for processing data requests according to an embodiment of the present invention. As shown in Fig. 5, the client processing logic described in this embodiment includes:

In step S510, the client requests data from the background.

In step S520, it is judged whether the request data is successful, if so, execute step S540, otherwise execute step S530.

That is, if the request is successful, the request result is cached locally, and if the request fails, the local cache of the last successful request is used.

In step S530, step S550 is executed using the last cached result.

In step S540, the result of the successful request is cached locally, and step S550 is executed.

In step S550, the presentation is performed and the process ends.

Fig. 6 shows the flow chart of HTTP and reverse proxy server processing logic in the system for processing data requests according to an embodiment of the present invention. As shown in Fig. 6, the HTTP and reverse proxy server processing logic described in this embodiment Editions include:

In step S610, it is judged whether to use the static cover, if so, execute step S630, otherwise execute step S620.

Read the nginx configuration to determine whether to use static pocket data. If the static pocket switch is turned on, read the static pocket data directly. The static pocket data is the data pre-configured by the administrator. Once the service cluster is unavailable, use the static pocket data , otherwise request data from the service cluster and return the result

In step S620, the service cluster is requested, and step S640 is executed.

In step S630, use the static background data, and execute step S640.

In step S640, the result is returned.

Fig. 7 shows a flow chart of the notification server processing logic in the system for processing data requests according to an embodiment of the present invention. As shown in Fig. 7, the notification server processing logic described in this embodiment includes:

In step S710, the downgrade ratio switch is written into redis.

That is, after the administrator modifies the downgrade ratio switch, write the downgrade ratio switch into redis.

In step S720, monitor whether the switch is changed, if yes, execute step S630, otherwise, repeat this step S720.

The notification center monitors the change of the downgrade ratio switch, and the notification center notifies the service cluster to update the downgrade ratio switch through zookeeper.

In step S730, the service cluster is notified of the change of the downgrade ratio switch.

In step S740, the service cluster reads the degradation ratio switch from redis and stores it in a local cache.

When the service cluster receives the update from the notification center, it reads the downgrade ratio switch from redis and puts it into the local cache of the server.

FIG. 8 shows a flow chart of the service cluster processing logic in the system for processing data requests according to an embodiment of the present invention. As shown in FIG. 8 , the processing logic at the service cluster in this embodiment includes:

In step S810, a client request is received.

In step S820, hash operation is performed on the user UUID and the time stamp.

For example, each client has a unique identifier UUID, which is hashed by combining the UUID and the current system time, and the hash value ranges from 0 to 100.

In step S830, a matching operation is performed on the hash operation result and the downgrading ratio switch.

For example, compare the value calculated by the hash with the information in the local cache of the system to determine whether downgrade is required. If downgrade is required, the data in the bottom cache will be obtained; if no downgrade is required, the service computing module will be requested to obtain real-time data and will succeed The acquired data is put into the pocket cache as the latest dynamic pocket data.

In step S840, it is determined whether a downgrade is required, if so, perform step S770, otherwise, repeat this step S850.

In step S850, real-time data is acquired.

In step S860, put the real-time data into the pocket cache.

In step S870, the bottom cache data is acquired.

In step S880, the result is returned.

Figure 9 shows a schematic diagram of the hash operation process of the service cluster in the system for processing data requests. Each request of the user will carry a UUID. UUID is the unique identifier of the user. Each user has a unique identifier. ttime indicates the server Combine the two together to get the hash value, and compare the obtained hash value with the downgrade ratio switch. The downgrade ratio switch is an array with subscripts from 0 to 99. The values of the array are 0 and 1, and 0 means Obtain real-time data, 1 means use dynamic pocket data. For example, 0b0a2e7e152410eae7a09276211bdde3e141df5d represents the UUID of the user, and 1488857570 represents the Unix timestamp of the current server. The value obtained by adding the two and hashing is 2, and the value with subscript 2 is obtained from the switch array. If it is 1, it means that the bottom data needs to be used.

The example of the technical solution of the foregoing embodiment has the following characteristics:

First, a three-level technical solution is adopted: background dynamic downgrade, background static downgrade, and client cache downgrade. Each level is less friendly to user experience, higher in reliability, and lower in downgrade priority.

The front-end adopts a local caching bottom-up method, and the backend adopts a combination of dynamic bottom-up and static bottom-up. The three-level bottom-up ensures high availability of services and avoids blank pages for users.

Secondly, by combining the user UUID with the timestamp and mapping it to a range from 0 to 99 with a hash function, the degradation ratio of background services can be dynamically and flexibly controlled. The dynamic degradation of background services is realized, and administrators can flexibly control the degradation ratio of services, which ensures user experience while reducing server pressure.

In addition, the zookeeper notification method is used. Once the user modifies the downgrade ratio switch, the server is notified to read the downgrade ratio switch from the redis cache, which ensures the real-time and uniformity of the bottom switch.

Fig. 10 shows a block diagram of a device for processing data requests according to an embodiment of the present invention. As shown in Fig. processing unit 1030 .

The request obtaining unit 1010 is configured to obtain a data request including access information;

The downgrade determination unit 1020 is configured to determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch;

The request processing unit 1030 is configured to obtain the request result from the pocket cache if downgrade is required, and obtain real-time data according to the data request if downgrade is not required.

According to some embodiments, the downgrading ratio switch includes an array whose elements are on flags or off flags.

According to some embodiments, the downgrade determination unit 1020 is configured to:

performing a hash operation according to the access information to obtain a hash value;

Obtain the corresponding element from the array by using the hash value as an index;

If the acquired element is an open flag, it is determined that the data request does not need to be downgraded, and if the acquired element is an off flag, it is determined that the data request needs to be downgraded.

According to some embodiments, the access information includes user identification information and/or access timestamps.

Regarding the apparatus in the above embodiments, the specific manner in which each unit performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

The device for processing data requests provided in this embodiment can execute the method for processing data requests provided in the method embodiments of the present invention, and has corresponding functional modules and beneficial effects for executing the method.

Fig. 11 shows a block diagram of a device for processing data requests according to another embodiment of the present invention. As shown in Fig. 11 , the device for processing data requests in this embodiment includes: a request obtaining unit 1110, a switch updating unit 1120, A downgrade determination unit 1130 and a request processing unit 1140 .

The request obtaining unit 1110 is configured to obtain a data request including access information.

The switch update unit 1120 is configured to read the downgrade ratio switch from the redis cache and store the downgrade ratio switch in a local cache when receiving the notification message sent by the notification server.

The downgrade determination unit 1130 is configured to determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch.

The request processing unit 1140 is configured to obtain the request result from the bottom cache if downgrading is required, and obtain real-time data according to the data request if downgrading is not required.

It should be noted that a notification message is sent when the notification server detects that the redis cache for storing the downgrading ratio switch has been modified.

According to some embodiments, the downgrading ratio switch includes an array whose elements are on flags or off flags.

According to some embodiments, the downgrade determination unit 1130 is configured to:

performing a hash operation according to the access information to obtain a hash value;

Obtain the corresponding element from the array by using the hash value as an index;

If the acquired element is an open flag, it is determined that the data request does not need to be downgraded, and if the acquired element is an off flag, it is determined that the data request needs to be downgraded.

According to some embodiments, the access information includes user identification information and/or access timestamps.

According to some embodiments, the switch updating unit 1120 is configured to: receive a notification message sent by the notification server through zookeeper.

According to some embodiments, the HTTP and reverse proxy server is used to obtain the access information according to the HTTP access request of the client;

The request acquiring unit 1110 is configured to: receive a data request including the access information from the HTTP and reverse proxy server.

According to some embodiments, the HTTP and reverse proxy server is also used to obtain the static bottom switch according to the configuration information. If the static bottom switch is an off flag, the request result is obtained according to the static bottom data pre-configured by the administrator, and no information is sent to the service. The cluster sends the data request including the access information.

According to some embodiments, the HTTP and reverse proxy server is an nginx cluster.

According to some embodiments, the client is configured to: if requesting the HTTP access request to the HTTP and reverse proxy server fails, obtain the request result according to the local cache; if requesting the HTTP and reverse proxy server for the requested If the HTTP access request is successful, the obtained request result is stored in the local cache.

The device for processing data requests provided in this embodiment can execute the method for processing data requests provided in the method embodiments of the present invention, and has corresponding functional modules and beneficial effects for executing the method.

FIG. 12 shows a service cluster according to an embodiment of the present invention. As shown in FIG. 12 , the service cluster 1200 may include a processor 1210 , a memory 1220 , a transmitter 1230 and a receiver 1240 .

The memory 1220 may store instructions for the processor 1210 to control operation processing. Memory 1220 may include volatile or nonvolatile memory such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable Program read only memory (PROM), read only memory (ROM), etc., the present invention is not limited thereto.

The processor 1210 can call instructions stored in the memory 1220 to control related operations. According to one embodiment, the memory 1220 stores instructions for the processor 1210 to control the following operations:

Get data requests that include access information;

determining whether the data request needs to be downgraded according to the access information and the downgrade ratio switch;

If downgrade is required, the request result is obtained from the pocket cache; if downgrade is not required, real-time data is obtained according to the data request.

It is easy to understand that the memory 1220 may also store instructions for the processor 1210 to control other operations according to the embodiment of the present invention, which will not be repeated here.

The processor 1210 may also control the transmitter 1230 and the receiver 1240 to perform signal transceiving and the like.

Through the above detailed description, those skilled in the art can easily understand that the system and method according to the embodiments of the present invention have one or more of the following advantages.

According to an embodiment of the present invention, the downgrading ratio switch includes an array whose elements are on flags or off flags.

According to some embodiments of the present invention, determining whether to downgrade the data request according to the access information and the downgrade ratio switch includes:

performing a hash operation according to the access information to obtain a hash value;

Obtain the corresponding element from the array by using the hash value as an index;

If the acquired element is an open flag, it is determined that the data request does not need to be downgraded, and if the acquired element is an off flag, it is determined that the data request needs to be downgraded.

According to some embodiments of the present invention, a notification message is sent when the notification server detects that the redis cache for storing the downgrading ratio switch has been modified;

When receiving the notification message sent by the notification server, read the downgrade ratio switch from the redis cache, and store the downgrade ratio switch in a local cache.

According to some embodiments, the present invention also provides a non-transitory computer-readable storage medium, such as a memory including instructions, which can be executed by a processor of a device to implement the above method. For example, the non-transitory computer readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. When the instructions in the storage medium are executed by the processor of the terminal, the terminal can execute the following method: obtain a data request including access information; determine whether the data request needs to be downgraded according to the access information and a downgrade ratio switch;

If downgrade is required, the request result is obtained from the pocket cache; if downgrade is not required, real-time data is obtained according to the data request.

Those skilled in the art can understand that the drawings are only schematic diagrams of exemplary embodiments, and the modules or processes in the drawings are not necessarily necessary for implementing the present invention, and thus cannot be used to limit the protection scope of the present invention.

Those skilled in the art can understand that the above-mentioned modules can be distributed in the device according to the description of the embodiment, and corresponding changes can also be made in one or more devices that are only different from the embodiment. The modules in the above embodiments can be combined into one module, and can also be further split into multiple sub-modules.

Exemplary embodiments of the present invention have been specifically shown and described above. It should be understood that the invention is not limited to the disclosed embodiments, but on the contrary, the invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (23)

1. A method for processing data requests, comprising: The HTTP and reverse proxy server receives the HTTP access request of the client, obtains access information according to the HTTP access request, and sends a data request comprising the access information to the service cluster; The service cluster is used to obtain a data request containing access information, and determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch. If it is downgraded, real-time data is obtained according to the data request. 2. the method for processing data request as claimed in claim 1, is characterized in that, described HTTP and reverse proxy server obtain access information according to described HTTP access request and comprise: The HTTP and reverse proxy server acquires user identification information of the HTTP access request, and acquires a time stamp of receiving the HTTP access request. 3. The method for processing data requests as claimed in claim 1, further comprising: Informing the server to monitor whether the redis cache for storing the downgrading ratio switch has been modified, and if the redis cache is detected to be modified, send a notification message to the service cluster; When the service set receives the notification message, it reads the downgrading ratio switch from the redis cache, and stores the downgrading ratio switch in the local cache of the service cluster. 4. the method for processing data request as claimed in claim 1, is characterized in that, described method also comprises: described HTTP and reverse proxy server obtain static bottom switch according to configuration information, if described static bottom switch is off mark The request result is obtained according to the static pocket data pre-configured by the administrator; If the static bottom switch is an on flag, obtain access information according to the HTTP access request, send a data request containing the access information to the service cluster, and store the request result returned by the service cluster in the static In the pocket data. 5. the method for processing data request as claimed in claim 1, is characterized in that, described method also comprises, if described client requests described HTTP access request to described HTTP and reverse proxy server failure, then according to local Cache the result of obtaining the request; if the request to the HTTP and reverse proxy server for the HTTP access request succeeds, store the obtained request result in the local cache. 6. the method for processing data request as claimed in claim 1, is characterized in that, described HTTP and reverse proxy server are nginx clusters. 7. A method for processing data requests, comprising: Get data requests that include access information; determining whether the data request needs to be downgraded according to the access information and the downgrade ratio switch; If downgrade is required, the request result is obtained from the pocket cache; if downgrade is not required, real-time data is obtained according to the data request. 8 . The method according to claim 7 , wherein the downgrading ratio switch comprises an array whose elements are on flags or off flags. 9. The method according to claim 8, wherein determining whether the data request needs to be downgraded according to the access information and the downgrade ratio switch comprises: performing a hash operation according to the access information to obtain a hash value; Obtain the corresponding element from the array by using the hash value as an index; If the acquired element is an open flag, it is determined that the data request does not need to be downgraded, and if the acquired element is an off flag, it is determined that the data request needs to be downgraded. 10. The method according to claim 7, wherein the access information includes user identification information and/or access time stamp. 11. The method of claim 7, wherein: Send a notification message when the notification server detects that the redis cache for storing the downgrading ratio switch has been modified; When receiving the notification message sent by the notification server, read the downgrade ratio switch from the redis cache, and store the downgrade ratio switch in a local cache. 12. The method according to claim 7, wherein HTTP and a reverse proxy server are used to obtain the access information according to the HTTP access request of the client; Obtaining the data request including the access information includes: receiving the data request including the access information from the HTTP and reverse proxy server. 13. A device for processing data requests, comprising: a request obtaining unit, configured to obtain a data request including access information; A downgrade determination unit, configured to determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch; The request processing unit is configured to obtain the request result from the bottom cache if downgrading is required, and obtain real-time data according to the data request if downgrading is not required. 14 . The device according to claim 13 , wherein the derating proportional switch comprises an array whose elements are on flags or off flags. 15. The device according to claim 14, wherein the downgrading determination unit is configured to: performing a hash operation according to the access information to obtain a hash value; Obtain the corresponding element from the array by using the hash value as an index; If the acquired element is an open flag, it is determined that the data request does not need to be downgraded, and if the acquired element is an off flag, it is determined that the data request needs to be downgraded. 16. A system for processing data requests, including HTTP and reverse proxy server, and service cluster, is characterized in that: The HTTP and reverse proxy server are used to receive an HTTP access request, obtain access information according to the HTTP access request, and send a data request including the access information to the service cluster; The service cluster is used to obtain a data request containing access information, and determine whether the data request needs to be downgraded according to the access information and the downgrade ratio switch. If it is downgraded, real-time data is obtained according to the data request. 17. the system processing data request as claimed in claim 16, is characterized in that, described HTTP and reverse proxy server obtain access information according to described HTTP access request and comprise: The HTTP and reverse proxy server acquires user identification information of the HTTP access request, and acquires a time stamp of receiving the HTTP access request. 18. The system for processing data requests as claimed in claim 16, further comprising a notification server; The notification server is used to: monitor whether the redis cache for storing the downgrading ratio switch has been modified, and send a notification message to the service cluster if it detects that the redis cache has been modified; The service cluster is configured to: read the downgrade ratio switch from the redis cache when receiving the notification message, and store the downgrade ratio switch in a local cache of the service cluster. 19. The system for processing data requests as claimed in claim 16, wherein the HTTP and reverse proxy server are also used to obtain a static bottom switch according to configuration information, and if the static bottom switch is an off flag, then according to the management Obtain the request result from the static pocket data pre-configured by the staff; If the static bottom switch is an on flag, obtain access information according to the HTTP access request, send a data request containing the access information to the service cluster, and store the request result returned by the service cluster in the static In the pocket data. 20. The system for processing data requests as claimed in claim 16, wherein the system also includes a client, and the client is used to request the HTTP access request to the HTTP and reverse proxy server If it fails, the request result is obtained according to the local cache; if the HTTP access request is successfully requested to the HTTP and reverse proxy server, the obtained request result is stored in the local cache. 21. The system for processing data requests as claimed in claim 16, wherein said HTTP and reverse proxy server are nginx clusters. 22. A service cluster, comprising: a processor; and a memory storing instructions for the processor to control the operation according to any one of claims 1-12. 23. A computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the operation steps of any one of claims 1-12 are realized.