CN110377416A - Distributed subregion method for scheduling task and device - Google Patents
Distributed subregion method for scheduling task and device Download PDFInfo
- Publication number
- CN110377416A CN110377416A CN201811472957.0A CN201811472957A CN110377416A CN 110377416 A CN110377416 A CN 110377416A CN 201811472957 A CN201811472957 A CN 201811472957A CN 110377416 A CN110377416 A CN 110377416A
- Authority
- CN
- China
- Prior art keywords
- server
- zone configuration
- data
- list
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses distributed subregion method for scheduling task and devices, are related to field of computer technology.One specific embodiment of this method includes: to obtain server registration table using partition management thread, determines the zone configuration of current server, according to the identification information of current server and server registration table to create the multidomain treat-ment thread of current server;Pending data corresponding with the zone configuration of current server in database is handled using multidomain treat-ment thread, to realize distributed subregion task schedule.The embodiment is deployed in application system on multiple servers while running, and the pressure of server is shared by load balancing;Each server only handles the data that subregion is corresponded in database, avoids the Data Concurrent processing problem of multiserver.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of distributed subregion method for scheduling task and device.
Background technique
There are large batch of data to need to handle in the business scenario of application system.The data processing scheme of the prior art are as follows:
It stores data into database.Start a main thread first to execute per minute once, state of inquiring from database is " not
The state of data, is then successively updated to " in processing " and is synchronized in database by the data of processing ", updates and synchronous
Successful data are stored in list List.Finally start multiple sub threads and parallel processing, data are carried out to the data in List
State is updated to " processing is completed " after handling successfully and is synchronized in database.
In realizing process of the present invention, at least there are the following problems in the prior art for inventor's discovery:
(1) only an application server is supported to handle data, the processing of other business of application system can not be accomplished
Load balancing;
(2) if there is more application servers are simultaneously handled data, the thread of every application server obtains simultaneously
When getting same batch of data, the concurrent processing of data will cause.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of distributed subregion method for scheduling task and device, application system can
To be deployed on multiple servers while run, the pressure of server is shared by load balancing;Each server only handles number
According to the data for corresponding to subregion in library, the Data Concurrent processing problem of multiserver is avoided.
To achieve the above object, according to an aspect of an embodiment of the present invention, a kind of distributed subregion task tune is provided
Degree method.
It is according to an embodiment of the present invention distribution subregion method for scheduling task include:
Server registration table is obtained using partition management thread, according to the identification information and server registration of current server
Table determines the zone configuration of current server, to create the multidomain treat-ment thread of current server;
Pending data corresponding with the zone configuration of current server in database is carried out using multidomain treat-ment thread
Processing, to realize distributed subregion task schedule.
Optionally, server registration table includes: registered server list and zone configuration list;According to current server
Identification information and server registration table determine the zone configuration of current server, comprising:
Judge that the identification information of current server whether there is in registered server list;
If it does not exist, then by the update of identification information of current server to registered server list;If it exists, then from interior
Deposit obtain current server the first zone configuration, from server registration table obtain current server the second subregion match
It sets;Registered server list is updated according to the first zone configuration and the second zone configuration;
Determine the number of servers in updated registered server list;According to number of servers and point to be allocated
Area's quantity determines the zone configuration of each server in registered server list, then updates in current server memory
First zone configuration and zone configuration list.
Optionally, registered server list is updated according to the first zone configuration and the second zone configuration, comprising:
Judge whether the first zone configuration is identical as the second zone configuration;
If not identical, the first zone configuration is updated to the second zone configuration;If they are the same, then registered server is traversed
Each server in list deletes the server for being unsatisfactory for default survival condition from registered server list.
Optionally, survival condition is preset are as follows: the time interval between the survival renewal time of server and current time is not
Less than the first preset duration.
Optionally, the multidomain treat-ment thread of current server is created, comprising: determine according to the zone configuration of current server
The corresponding partitions of database quantity of current server;The multidomain treat-ment thread of current server is determined according to partitions of database quantity
Quantity;It is created the division according to the multidomain treat-ment number of threads of current server and handles thread.
Optionally, it is created the division according to the multidomain treat-ment number of threads of current server after handling thread, further includes: will
The partition identification of the corresponding partitions of database of each multidomain treat-ment thread is initialised in thread attribute;
Pending data corresponding with the zone configuration of current server in database is carried out using multidomain treat-ment thread
Processing, comprising:
For each multidomain treat-ment thread of current server:
Using the partition identification in thread attribute as querying condition, inquire and corresponding with the partition identification in lock database
Partitions of database in state be data to be processed;List to be processed is added in the data of locking, number will be corresponded in database
According to state be updated to it is locked;Data in list to be processed are handled, it is corresponding in more new database after the completion of processing
The state of data.
Optionally, the state of corresponding data in more new database after the completion is handled, comprising:
Judge whether data processing succeeds;
If success, the state of corresponding data in database is updated to processing after processing is completed and is completed;If unsuccessful,
The state of corresponding data in database is then updated to number of processes to be processed, and updating the data after processing is completed.
Optionally, after the number of processes for updating the data, further includes: if number of processes is greater than or equal to preset times threshold
Value, then issue abnormity prompt information.
Optionally, after the completion of multidomain treat-ment thread is to a data processing in list to be processed, when interval second is default
Length handles next data in list to be processed.
Optionally, server registration table is stored in Redis database.
Another aspect according to an embodiment of the present invention provides a kind of distributed subregion task scheduling apparatus.
It is according to an embodiment of the present invention distribution subregion task scheduling apparatus include:
Management module obtains server registration table using partition management thread, according to the identification information of current server and
Server registration table determines the zone configuration of current server, to create the multidomain treat-ment thread of current server;
Processing module, using multidomain treat-ment thread to corresponding with the zone configuration of current server to be processed in database
Data are handled, to realize distributed subregion task schedule.
Optionally, server registration table includes: registered server list and zone configuration list;Management module is according to working as
The identification information and server registration table of preceding server determine the zone configuration of current server, comprising:
Judge that the identification information of current server whether there is in registered server list;
If it does not exist, then by the update of identification information of current server to registered server list;If it exists, then from interior
Deposit obtain current server the first zone configuration, from server registration table obtain current server the second subregion match
It sets;Registered server list is updated according to the first zone configuration and the second zone configuration;
Determine the number of servers in updated registered server list;According to number of servers and point to be allocated
Area's quantity determines the zone configuration of each server in registered server list, then updates in current server memory
First zone configuration and zone configuration list.
Optionally, management module updates registered server list, packet according to the first zone configuration and the second zone configuration
It includes:
Judge whether the first zone configuration is identical as the second zone configuration;
If not identical, the first zone configuration is updated to the second zone configuration;If they are the same, then registered server is traversed
Each server in list deletes the server for being unsatisfactory for default survival condition from registered server list.
Optionally, survival condition is preset are as follows: the time interval between the survival renewal time of server and current time is not
Less than the first preset duration.
Optionally, the multidomain treat-ment thread of management module creation current server, comprising: according to the subregion of current server
It configures and determines the corresponding partitions of database quantity of current server;The subregion of current server is determined according to partitions of database quantity
Handle number of threads;It is created the division according to the multidomain treat-ment number of threads of current server and handles thread.
Optionally, management module is also used to: being created the division according to the multidomain treat-ment number of threads of current server and is handled line
After journey, the partition identification of the corresponding partitions of database of each multidomain treat-ment thread is initialised in thread attribute;
Processing module is using multidomain treat-ment thread to corresponding with the zone configuration of current server to be processed in database
Data are handled, comprising:
For each multidomain treat-ment thread of current server:
Using the partition identification in thread attribute as querying condition, inquire and corresponding with the partition identification in lock database
Partitions of database in state be data to be processed;List to be processed is added in the data of locking, number will be corresponded in database
According to state be updated to it is locked;Data in list to be processed are handled, it is corresponding in more new database after the completion of processing
The state of data.
Optionally, processing module handles the state of corresponding data in more new database after the completion, comprising:
Judge whether data processing succeeds;
If success, the state of corresponding data in database is updated to processing after processing is completed and is completed;If unsuccessful,
The state of corresponding data in database is then updated to number of processes to be processed, and updating the data after processing is completed.
Optionally, processing module is also used to: after the number of processes for updating the data, if number of processes is greater than or equal to
Preset times threshold value then issues abnormity prompt information.
Optionally, processing module using multidomain treat-ment thread to a data processing in list to be processed after the completion of,
Next data in list to be processed are handled every the second preset duration.
Optionally, distributed subregion task scheduling apparatus further include: Redis database is used for storage server registration table.
Other side according to an embodiment of the present invention provides a kind of distributed subregion task schedule electronic equipment.
It is according to an embodiment of the present invention distribution subregion task schedule electronic equipment include:
One or more processors;
Storage device, for storing one or more programs,
When the one or more program is executed by the one or more processors, so that the one or more processors are realized
The distributed subregion method for scheduling task that first aspect of the embodiment of the present invention provides.
Still another aspect according to an embodiment of the present invention provides a kind of computer-readable medium.
Computer-readable medium according to an embodiment of the present invention, is stored thereon with computer program, and the program is by processor
The distributed subregion method for scheduling task that first aspect of the embodiment of the present invention provides is realized when execution.
One embodiment in foregoing invention has the following advantages that or the utility model has the advantages that by the way that application system is deployed in more
It is run simultaneously on server, the pressure of server can be shared by load balancing;Each server only handles right in database
The data for answering subregion can be avoided the Data Concurrent processing problem of multiserver.
Further effect possessed by above-mentioned non-usual optional way adds hereinafter in conjunction with specific embodiment
With explanation.
Detailed description of the invention
Attached drawing for a better understanding of the present invention, does not constitute an undue limitation on the present invention.Wherein:
Fig. 1 is the schematic diagram of the main flow of the distributed subregion method for scheduling task of the embodiment of the present invention;
Fig. 2 is the schematic illustration of distributed subregion method for scheduling task in the embodiment of the present invention;
Fig. 3 is the master that the zone configuration of each server in registered server list is determined in alternative embodiment of the present invention
Want the schematic diagram of process;
Fig. 4 is to update registered server according to the first zone configuration and the second zone configuration in alternative embodiment of the present invention
The schematic diagram of the main flow of list;
Fig. 5 is the schematic diagram of the primary operational in alternative embodiment of the present invention after the completion of data processing;
Fig. 6 is the schematic diagram of the main modular of distributed subregion task scheduling apparatus according to an embodiment of the present invention;
Fig. 7 is that the embodiment of the present invention can be applied to exemplary system architecture figure therein;
Fig. 8 is adapted for the structural representation of the computer system for the terminal device or server of realizing the embodiment of the present invention
Figure.
Specific embodiment
Below in conjunction with attached drawing, an exemplary embodiment of the present invention will be described, including the various of the embodiment of the present invention
Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize
It arrives, it can be with various changes and modifications are made to the embodiments described herein, without departing from scope and spirit of the present invention.Together
Sample, for clarity and conciseness, descriptions of well-known functions and structures are omitted from the following description.
Only a server is supported to handle data in the prior art, the processing of other business of application system can not be done
To load balancing, on the one hand cause server stress high, on the other hand, leads to this when network or other exceptions occurs
When platform application server can not access, can not load balancing, all business of this application system can not all access, and seriously affect existing
Field production.Application system is deployed on multiple servers while being run by the embodiment of the present invention, can be shared by load balancing
The pressure of server is avoided since application system is deployed only on caused various deficiencies on a server.
In the prior art if there is multiple servers are simultaneously handled data, the thread of every application server is simultaneously
When getting same batch of data, the concurrent processing of data will cause.The embodiment of the present invention passes through server registration table Centralized Monitoring
Registered server list is managed, and determines that the subregion of each registered server is matched according to registered server list equilibrium
It sets, each server only handles the data that subregion is corresponded in database, can be avoided the Data Concurrent processing problem of multiserver
According to an aspect of an embodiment of the present invention, a kind of distributed subregion method for scheduling task is provided.
Fig. 1 is the schematic diagram of the main flow of the distributed subregion method for scheduling task of the embodiment of the present invention, such as Fig. 1 institute
Show, distribution subregion method for scheduling task according to an embodiment of the present invention includes:
Step S101, server registration table is obtained using partition management thread, according to the identification information of current server and
Server registration table determines the zone configuration of current server, to create the multidomain treat-ment thread of current server;
Step S102, using multidomain treat-ment thread to corresponding with the zone configuration of current server to be processed in database
Data are handled, to realize distributed subregion task schedule.
Application system is deployed on multiple servers while being run, the pressure of server can be shared by load balancing
Power;Each server only handles the data that subregion is corresponded in database, can be avoided the Data Concurrent processing problem of multiserver.
Server registration table can be pre-stored in the memory of each server, can also be stored in some database
In.For example, server registration table is stored in Redis database.When needing to obtain server registration table, from the Redis
It inquires and obtains in database.Redis is the data structure server of open source (BSD license) memory storage, can be with counting
It is acted on behalf of according to library, cache and message queue.Using Redis centralized database management server registration table, it is convenient for monitoring management
Survival server, so as to according to survival server equilibrium assignment zone configuration.
Fig. 2 is the schematic illustration of distributed subregion method for scheduling task in alternative embodiment of the present invention.As shown in Fig. 2,
Application system is deployed on server 1, server 2 and server 3, and the business datum of application system stores in the database, respectively
The server registration table of a server is stored in Redis.It will start Partition when the application system starting of every server
Manages Thread (partition management thread), the effect of this thread are the server registration tables obtained in Redis database.Clothes
Have recorded the relevant informations of all registered servers in business device registration table, for example, server identification information (such as IP), deposit
Work renewal time, zone configuration etc. are carried out according to survival condition and zone configuration of the information of server registration table to server
The survival monitoring and data processing distribution of multiserver are realized in management.Each server passes through according to zone configuration
(ScheduledExecutorService is the timed task based on thread pool design to ScheduledExecutorService
Class, the thread that each scheduler task can be assigned in thread pool go to execute, that is to say, that task is concurrently to execute, mutually
Do not influence) creating the division is handled thread (PartitionProcessingThread), and each multidomain treat-ment thread is matched by subregion
It sets and realizes subregion scheduling, solve the problems, such as the Data Concurrent of multiserver.
Optionally, server registration table includes: registered server list and zone configuration list.Registered server column
Table refers to that the list comprising each registered server, zone configuration list refer to that the subregion comprising each registered server is matched
The list set.The zone configuration of current server is determined according to the identification information of current server and server registration table, comprising:
Judge that the identification information of current server whether there is in registered server list;
If it does not exist, then by the update of identification information of current server to registered server list;If it exists, then from interior
Deposit obtain current server the first zone configuration, from server registration table obtain current server the second subregion match
It sets;Registered server list is updated according to the first zone configuration and the second zone configuration;
Determine the number of servers in updated registered server list;According to number of servers and point to be allocated
Area's quantity determines the zone configuration of each server in registered server list, then updates in current server memory
First zone configuration and zone configuration list.
It should be noted that being determined according to number of servers and number of partitions to be allocated every in registered server list
When the zone configuration of a server, equilibrium assignment can be carried out using equilibrium assignment algorithm, i.e., make each server corresponding as far as possible
Number of partitions it is equal.Assuming that there is 10 subregions, corresponding partition identification is respectively 1 to 10, according to the clothes in current registration table
Device quantity of being engaged in carries out equilibrium assignment using equilibrium assignment algorithm, if there is two-server, then the subregion of First server is
1,3,5,7,9, the subregion of second server is 2,4,6,8,10;If there is three servers, then point of First server
Area is 1,4,7,10, and the subregion of second server is 2,5,8, and the subregion of third platform server is 3,6,9, referring to fig. 2.
It is of course also possible to be allocated according to the operation of each server and configuring condition using other methods.Assuming that having 9
A subregion, corresponding partition identification are respectively 1 to 9, for example, by application system A be deployed to three servers a1, a2, a3 it is upper it
Afterwards, if the other application system disposed on server a1 is more, the subregion of each server can be determined as follows
Configuration: the subregion of server a1 is 1, and the subregion of server a2 is 2,4,6,8, and the subregion of server a3 is 3,5,7,9.
Fig. 3 is the master that the zone configuration of each server in registered server list is determined in alternative embodiment of the present invention
It wants the schematic diagram of process, using IP as the identification information of server in figure, determines each server in registered server list
The main flow of zone configuration include:
Step S301, judge whether the IP of current server is registered, if the IP of current server is present in registered clothes
It is engaged in device list, shows that current server is registered, otherwise, current server is unregistered;If it is not, the S302 that gos to step;It is no
Then, go to step S303;
Step S302, the IP of current server is updated to registered server list, then go to step S305;
Step S303, from memory obtain current server the first zone configuration, obtain and work as from server registration table
Second zone configuration of preceding server, then go to step S304;
Step S304, registered server list is updated according to the first zone configuration and the second zone configuration, then jumped
To step S305;
Step S305, it determines the number of servers in updated registered server list, then gos to step
S306;
Step S306, it according to number of servers and number of partitions to be allocated, determines each in registered server list
The zone configuration of server, then go to step S307;
Step S307, the first zone configuration and zone configuration list in current server memory are updated
Optionally, registered server list is updated according to the first zone configuration and the second zone configuration, comprising:
Judge whether the first zone configuration is identical as the second zone configuration;
If not identical, illustrate to have the server for newly increasing or deleting in registered server list and redistributed subregion
Configuration, then update the zone configuration in this server memory, i.e., the first zone configuration be updated to the second zone configuration;If phase
Together, then each server in registered server list is traversed, by the server for being unsatisfactory for default survival condition from having infused
It is deleted in volume server list.
Survival refers to that server can work normally, if some server meets default survival condition, shows the server
It can work normally.By presetting the registered server list of survival condition monitoring management, it can allow entire server cluster can
To know whether every server is working normally, when can not work normally and (do not survive) so as to some server, in time will
The data that the server corresponds to subregion are assigned in other servers and are handled, and improve the promptness rate of data processing.
Optionally, survival condition is preset are as follows: the time interval between the survival renewal time of server and current time is not
Less than the first preset duration.When survival renewal time refers to the last time access of the server recorded in server registration table
Between.Assuming that some data demand must handle completion in 5 minutes, if server 3 minutes without survival more new record,
Its original partition data for being responsible for processing can be assigned to other servers in time and be handled, and can guarantee data 5 in this way
Processing is completed in minute.For example server A last time updates survival renewal time into Redis database for 2018-09-09
09:03, which there is exception, in subsequent server A to work on, and the survival renewal time of server A also can not just continue to update,
Server B finds that the time-to-live of server A is less than current time when 2018-09-09 09:06 carries out partition management
3 minutes, service A will be deleted, then reconfigure subregion.
When the first preset duration is arranged, network, server conventional maintenance some factors such as can be restarted to and taken into account,
And the time defined according to the promptness rate of data processing is voluntarily configured, such as is arranged to 3 minutes, 5 minutes, 10 minutes
Deng.
Fig. 4 is to update registered server according to the first zone configuration and the second zone configuration in alternative embodiment of the present invention
The schematic diagram of the main flow of list.As shown in figure 4, updating registered service according to the first zone configuration and the second zone configuration
The main flow of device list includes:
Step S401, judge whether the first zone configuration is identical as the second zone configuration;If it is not, jumping to step S402;
Otherwise, step S403 is jumped to;
Step S402, the first zone configuration is updated to the second zone configuration, process terminates;
Step S403, i=1 is set, and i represents the serial number of server in registered server list, jumps to step S404;
Step S404, the survival renewal time t for obtaining i-th of server in registered server list, jumps to step
S405;
Step S405, judge whether the survival renewal time t of i-th of server is more than or equal to the first preset duration t0;If
It is to jump to step S407;Otherwise, step S406 is jumped to;
Step S406, i-th of server is deleted from registered server list, jumps to step S407;
Step S407, judge whether i is equal to I, wherein I represents the quantity of Servers-all in registered server list;
If so, process terminates;Otherwise, step S408 is jumped to;
Step S408, i is incremented by, i.e. i=i+1 then branches to step S404.
Optionally, the multidomain treat-ment thread of current server is created, comprising: determine according to the zone configuration of current server
The corresponding partitions of database quantity of current server;The multidomain treat-ment thread of current server is determined according to partitions of database quantity
Quantity;It is created the division according to the multidomain treat-ment number of threads of current server and handles thread.Illustratively, if current server pair
The partitions of database quantity answered is 3, then can create the data that 3 multidomain treat-ment thread parallels handle corresponding subregion.If number
It is divided into 10 areas according to data all in library, that just there are 10 multidomain treat-ment threads simultaneously
(PartitionProcessingThread) in parallel data processing, the speed of data processing is considerably increased.
Optionally, it is created the division according to the multidomain treat-ment number of threads of current server after handling thread, further includes: will
The partition identification of the corresponding partitions of database of each multidomain treat-ment thread is initialised in thread attribute.Using multidomain treat-ment thread
Pending data corresponding with the zone configuration of current server in database is handled, comprising:
For each multidomain treat-ment thread of current server:
Using the partition identification in thread attribute as querying condition, inquire and corresponding with the partition identification in lock database
Partitions of database in state be data to be processed;List to be processed is added in the data of locking, number will be corresponded in database
According to state be updated to it is locked;Data in list to be processed are handled (such as according to the message in queue to be processed
Quantity creation data processing threads DataProcessingThread carries out data processing parallel), more new data after the completion of processing
The state of corresponding data in library.
The major responsibility of multidomain treat-ment thread (PartitionProcessingThread) is the subregion according to current thread
ID is inquired, locked and is handled to the data of corresponding partition id.By zonal control, each
PartitionProcessingThread only handles the data that oneself corresponds to subregion, avoids multiserver while processing causes
Data Concurrent problem.The partition identification of the corresponding partitions of database of each multidomain treat-ment thread is initialised to thread attribute
In, and corresponding pending data is inquired according to thread attribute, convenient for the corresponding subregion of each multidomain treat-ment thread acquisition wait locate
Manage data.
Optionally, the state of corresponding data in more new database after the completion is handled, comprising:
Judge whether data processing succeeds;
If success, the state of corresponding data in database is updated to processing after processing is completed and is completed;If unsuccessful,
The state of corresponding data in database is then updated to number of processes to be processed, and updating the data after processing is completed.Note
The number of processes of data is recorded, convenient for understanding data processing progress and processing result.If number of processes is larger, show that the data can
Can there are problems that system can not automatically process.Therefore, in further alternative embodiment, the number of processes of the data is updated
Later, further includes: if number of processes is greater than or equal to preset times threshold value, issue abnormity prompt information.For example, if processing
Number is greater than 7 times, illustrates that data have processed 7 times all not successfully, it is understood that there may be the problem of system can not automatically process, this number
According to being no longer waiting for next processing, but abnormity prompt information is sent to responsible person by system.
Fig. 5 is the schematic diagram of the primary operational in alternative embodiment of the present invention after the completion of data processing.As shown in figure 5, number
Include: according to the primary operational after the completion of processing
Step S501, judge whether data processing succeeds;If so, the S502 that gos to step;Otherwise, it gos to step
S503;
Step S502, the state of corresponding data in database processing is updated to complete;
Step S503, the state of corresponding data in database is updated to be processed, go to step S504;
Step S504, the number of processes x=x+1 of the data, go to step S505;
Step S505, judge whether the number of processes x of the data is more than or equal to preset times threshold X 0;If so, jumping to
Step S506;Otherwise, go to step S507;
Step S506, abnormity prompt information is issued;
Step S507, it does not handle, waits processing next time.
Optionally, after the completion of multidomain treat-ment thread is to a data processing in list to be processed, when interval second is default
Length handles next data in list to be processed.Second preset duration can carry out selectivity according to the actual situation and match
It sets, for example, 30 seconds, 45 seconds etc..For example, the creation method of multidomain treat-ment thread (PartitionProcessingThread) is
ScheduledExecutorServiceService.scheduleWithFixedDelay(new
PartitionProcessingThread(partitionIndexId),30,30,TimeUnit.SECONDS);, the method wound
The thread built can be executed next time after each execution terminates 30 seconds.Multidomain treat-ment thread completes a data processing
Afterwards, the second preset duration of interval handles next data, can be avoided multidomain treat-ment thread in no data disposition
Under uninterrupted operation, mitigate the pressure of server.
Another aspect according to an embodiment of the present invention provides a kind of distributed subregion task scheduling apparatus.
Fig. 6 is the schematic diagram of the main modular of distributed subregion task scheduling apparatus according to an embodiment of the present invention.Such as Fig. 6
Shown, distribution subregion task scheduling apparatus 600 according to an embodiment of the present invention includes:
Management module 601 obtains server registration table using partition management thread, according to the identification information of current server
Determine the zone configuration of current server, with server registration table to create the multidomain treat-ment thread of current server;
Processing module 602, using multidomain treat-ment thread in database it is corresponding with the zone configuration of current server to
Processing data are handled, to realize distributed subregion task schedule.
Optionally, server registration table includes: registered server list and zone configuration list;Management module is according to working as
The identification information and server registration table of preceding server determine the zone configuration of current server, comprising:
Judge that the identification information of current server whether there is in registered server list;
If it does not exist, then by the update of identification information of current server to registered server list;If it exists, then from interior
Deposit obtain current server the first zone configuration, from server registration table obtain current server the second subregion match
It sets;Registered server list is updated according to the first zone configuration and the second zone configuration;
Determine the number of servers in updated registered server list;According to number of servers and point to be allocated
Area's quantity determines the zone configuration of each server in registered server list, then updates in current server memory
First zone configuration and zone configuration list.
Optionally, management module updates registered server list, packet according to the first zone configuration and the second zone configuration
It includes:
Judge whether the first zone configuration is identical as the second zone configuration;
If not identical, the first zone configuration is updated to the second zone configuration;If they are the same, then registered server is traversed
Each server in list deletes the server for being unsatisfactory for default survival condition from registered server list.
Optionally, survival condition is preset are as follows: the time interval between the survival renewal time of server and current time is not
Less than the first preset duration.
Optionally, the multidomain treat-ment thread of management module creation current server, comprising: according to the subregion of current server
It configures and determines the corresponding partitions of database quantity of current server;The subregion of current server is determined according to partitions of database quantity
Handle number of threads;It is created the division according to the multidomain treat-ment number of threads of current server and handles thread.
Optionally, management module is also used to: being created the division according to the multidomain treat-ment number of threads of current server and is handled line
After journey, the partition identification of the corresponding partitions of database of each multidomain treat-ment thread is initialised in thread attribute;
Processing module is using multidomain treat-ment thread to corresponding with the zone configuration of current server to be processed in database
Data are handled, comprising:
For each multidomain treat-ment thread of current server:
Using the partition identification in thread attribute as querying condition, inquire and corresponding with the partition identification in lock database
Partitions of database in state be data to be processed;List to be processed is added in the data of locking, number will be corresponded in database
According to state be updated to it is locked;Data in list to be processed are handled, it is corresponding in more new database after the completion of processing
The state of data.
Optionally, processing module handles the state of corresponding data in more new database after the completion, comprising:
Judge whether data processing succeeds;
If success, the state of corresponding data in database is updated to processing after processing is completed and is completed;If unsuccessful,
The state of corresponding data in database is then updated to number of processes to be processed, and updating the data after processing is completed.
Optionally, processing module is also used to: after the number of processes for updating the data, if number of processes is greater than or equal to
Preset times threshold value then issues abnormity prompt information.
Optionally, processing module using multidomain treat-ment thread to a data processing in list to be processed after the completion of,
Next data in list to be processed are handled every the second preset duration.
Optionally, distributed subregion task scheduling apparatus further include: Redis database is used for storage server registration table.
Other side according to an embodiment of the present invention provides a kind of distributed subregion task schedule electronic equipment.
It is according to an embodiment of the present invention distribution subregion task schedule electronic equipment include:
One or more processors;
Storage device, for storing one or more programs,
When the one or more program is executed by the one or more processors, so that the one or more processors are realized
The distributed subregion method for scheduling task that first aspect of the embodiment of the present invention provides.
Fig. 7 is shown can be using the distributed subregion method for scheduling task or distribution subregion task of the embodiment of the present invention
The exemplary system architecture 700 of dispatching device.
As shown in fig. 7, system architecture 700 may include terminal device 701,702,703, network 704 and server-side 705.
Network 704 between terminal device 701,702,703 and server 705 to provide the medium of communication link.Network 704 can be with
Including various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be used terminal device 701,702,703 and be interacted by network 704 with server-side 705, to receive or send out
Send message etc..Various telecommunication customer end applications, such as the application of shopping class, net can be installed on terminal device 701,702,703
(merely illustrative) such as the application of page browsing device, searching class application, instant messaging tools, mailbox client, social platform softwares.
Terminal device 701,702,703 can be the various electronic equipments with display screen and supported web page browsing, packet
Include but be not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..
Server-side 705 can be to provide the server of various services, such as utilize terminal device 701,702,703 to user
The shopping class website browsed provides the back-stage management server (merely illustrative) supported.Back-stage management server can be to reception
To the data such as information query request analyze etc. processing, and by processing result (such as target push information, product letter
Breath -- merely illustrative) feed back to terminal device.
It should be noted that distribution subregion method for scheduling task is generally by server-side provided by the embodiment of the present invention
705 execute, and correspondingly, distributed subregion task scheduling apparatus is generally positioned in server-side 705.
It should be understood that the number of terminal device, network and server in Fig. 7 is only schematical.According to realization need
It wants, can have any number of terminal device, network and server.
Below with reference to Fig. 8, it illustrates the computer systems 800 for the terminal device for being suitable for being used to realize the embodiment of the present invention
Structural schematic diagram.Terminal device shown in Fig. 8 is only an example, function to the embodiment of the present invention and should not use model
Shroud carrys out any restrictions.
As shown in figure 8, computer system 800 includes central processing unit (CPU) 801, it can be read-only according to being stored in
Program in memory (ROM) 802 or be loaded into the program in random access storage device (RAM) 803 from storage section 808 and
Execute various movements appropriate and processing.In RAM 803, also it is stored with system 800 and operates required various programs and data.
CPU 801, ROM 802 and RAM 803 are connected with each other by bus 804.Input/output (I/O) interface 805 is also connected to always
Line 804.
I/O interface 805 is connected to lower component: the importation 806 including keyboard, mouse etc.;It is penetrated including such as cathode
The output par, c 807 of spool (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.;Storage section 808 including hard disk etc.;
And the communications portion 809 of the network interface card including LAN card, modem etc..Communications portion 809 via such as because
The network of spy's net executes communication process.Driver 810 is also connected to I/O interface 805 as needed.Detachable media 811, such as
Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 810, in order to read from thereon
Computer program be mounted into storage section 808 as needed.
Particularly, disclosed embodiment, the process described above with reference to flow chart may be implemented as counting according to the present invention
Calculation machine software program.For example, embodiment disclosed by the invention includes a kind of computer program product comprising be carried on computer
Computer program on readable medium, the computer program include the program code for method shown in execution flow chart.?
In such embodiment, which can be downloaded and installed from network by communications portion 809, and/or from can
Medium 811 is dismantled to be mounted.When the computer program is executed by central processing unit (CPU) 801, system of the invention is executed
The above-mentioned function of middle restriction.
It should be noted that computer-readable medium shown in the present invention can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires
Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In the present invention, computer readable storage medium can be it is any include or storage journey
The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this
In invention, computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to: wireless, electric wire, optical cable, RF etc. are above-mentioned
Any appropriate combination.
Flow chart and block diagram in attached drawing are illustrated according to the system of various embodiments of the invention, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
Being described in module involved in the embodiment of the present invention can be realized by way of software, can also be by hard
The mode of part is realized.Described module also can be set in the processor, for example, can be described as: a kind of processor packet
Include: management module obtains server registration table using partition management thread, according to the identification information and server of current server
Registration table determines the zone configuration of current server, to create the multidomain treat-ment thread of current server;Processing module, using point
Area's processing thread handles pending data corresponding with the zone configuration of current server in database, to realize distribution
Formula subregion task schedule.Wherein, the title of these modules does not constitute the restriction to the module itself, example under certain conditions
Such as, management module is also described as " using multidomain treat-ment thread to the zone configuration pair in database with current server
The module that the pending data answered is handled ".
As on the other hand, the present invention also provides a kind of computer-readable medium, which be can be
Included in equipment described in above-described embodiment;It is also possible to individualism, and without in the supplying equipment.Above-mentioned calculating
Machine readable medium carries one or more program, when said one or multiple programs are executed by the equipment, makes
Obtaining the equipment includes: to obtain server registration table using partition management thread, according to the identification information of current server and service
Device registration table determines the zone configuration of current server, to create the multidomain treat-ment thread of current server;Using multidomain treat-ment
Thread handles pending data corresponding with the zone configuration of current server in database, to realize distributed subregion
Task schedule.
Application system is deployed on multiple servers while being run by technical solution according to an embodiment of the present invention, can be with
The pressure of server is shared by load balancing;Each server only handles the data that subregion is corresponded in database, can be avoided
The Data Concurrent of multiserver handles problem.
Above-mentioned specific embodiment, does not constitute a limitation on the scope of protection of the present invention.Those skilled in the art should be bright
It is white, design requirement and other factors are depended on, various modifications, combination, sub-portfolio and substitution can occur.It is any
Made modifications, equivalent substitutions and improvements etc. within the spirit and principles in the present invention, should be included in the scope of the present invention
Within.
Claims (22)
1. a kind of distribution subregion method for scheduling task characterized by comprising
Server registration table is obtained using partition management thread, it is true according to the identification information of current server and server registration table
The zone configuration of current server is determined, to create the multidomain treat-ment thread of current server;
Pending data corresponding with the zone configuration of current server in database is handled using multidomain treat-ment thread,
To realize distributed subregion task schedule.
2. the method as described in claim 1, which is characterized in that the server registration table includes: registered server list
With zone configuration list;Determine that the subregion of current server is matched according to the identification information of current server and server registration table
It sets, comprising:
Judge that the identification information of current server whether there is in the registered server list;
If it does not exist, then by the update of identification information of current server to registered server list;If it exists, then from memory
First zone configuration of acquisition current server, the second subregion that current server is obtained from the server registration table are matched
It sets;Registered server list is updated according to the first zone configuration and the second zone configuration;
Determine the number of servers in updated registered server list;According to number of servers and the number of partitions to be allocated
Amount, determines the zone configuration of each server in registered server list, then updates first in current server memory
Zone configuration and the zone configuration list.
3. method according to claim 2, which is characterized in that infused according to the first zone configuration and the update of the second zone configuration
Volume server list, comprising:
Judge whether the first zone configuration is identical as the second zone configuration;
If not identical, the first zone configuration is updated to the second zone configuration;If they are the same, then registered server list is traversed
In each server, the server for being unsatisfactory for default survival condition is deleted from registered server list.
4. method as claimed in claim 3, which is characterized in that default survival condition are as follows: the survival renewal time of server with
Time interval between current time is not less than the first preset duration.
5. the method as described in claim 1, which is characterized in that create the multidomain treat-ment thread of current server, comprising: according to
The zone configuration of current server determines the corresponding partitions of database quantity of current server;According to the partitions of database quantity
Determine the multidomain treat-ment number of threads of current server;It is created the division processing according to the multidomain treat-ment number of threads of current server
Thread.
6. method as claimed in claim 5, which is characterized in that according to the creation point of the multidomain treat-ment number of threads of current server
Area is handled after thread, further includes: the partition identification of the corresponding partitions of database of each multidomain treat-ment thread is initialised to line
In journey attribute;
Pending data corresponding with the zone configuration of current server in database is handled using multidomain treat-ment thread,
Include:
For each multidomain treat-ment thread of current server:
Using the partition identification in thread attribute as querying condition, inquire and corresponding with the partition identification in lock database
State is data to be processed in partitions of database;List to be processed is added in the data of locking, by corresponding data in database
State be updated to it is locked;Data in the list to be processed are handled, it is right in more new database after the completion of processing
Answer the state of data.
7. method as claimed in claim 6, which is characterized in that the state of corresponding data in more new database after the completion is handled,
Include:
Judge whether data processing succeeds;
If success, the state of corresponding data in database is updated to processing after processing is completed and is completed;If unsuccessful,
The state of corresponding data in database is updated to number of processes to be processed, and updating the data after the completion of processing.
8. the method for claim 7, which is characterized in that after the number of processes for updating the data, further includes: if institute
Number of processes is stated more than or equal to preset times threshold value, then issues abnormity prompt information.
9. method as claimed in claim 6, which is characterized in that multidomain treat-ment thread is to a number in the list to be processed
After the completion of processing, the second preset duration of interval handles next data in the list to be processed.
10. the method as described in claim 1-9 is any, which is characterized in that the server registration table is stored in Redis data
In library.
11. a kind of distribution subregion task scheduling apparatus characterized by comprising
Management module obtains server registration table using partition management thread, according to the identification information of current server and service
Device registration table determines the zone configuration of current server, to create the multidomain treat-ment thread of current server;
Processing module, using multidomain treat-ment thread to pending data corresponding with the zone configuration of current server in database
It is handled, to realize distributed subregion task schedule.
12. device as claimed in claim 11, which is characterized in that the server registration table includes: registered server column
Table and zone configuration list;Management module determines current server according to the identification information and server registration table of current server
Zone configuration, comprising:
Judge that the identification information of current server whether there is in the registered server list;
If it does not exist, then by the update of identification information of current server to registered server list;If it exists, then from memory
First zone configuration of acquisition current server, the second subregion that current server is obtained from the server registration table are matched
It sets;Registered server list is updated according to the first zone configuration and the second zone configuration;
Determine the number of servers in updated registered server list;According to number of servers and the number of partitions to be allocated
Amount, determines the zone configuration of each server in registered server list, then updates first in current server memory
Zone configuration and the zone configuration list.
13. device as claimed in claim 12, which is characterized in that management module is matched according to the first zone configuration and the second subregion
It sets and updates registered server list, comprising:
Judge whether the first zone configuration is identical as the second zone configuration;
If not identical, the first zone configuration is updated to the second zone configuration;If they are the same, then registered server list is traversed
In each server, the server for being unsatisfactory for default survival condition is deleted from registered server list.
14. device as claimed in claim 13, which is characterized in that default survival condition are as follows: the survival renewal time of server
Time interval between current time is not less than the first preset duration.
15. device as claimed in claim 11, which is characterized in that the multidomain treat-ment line of management module creation current server
Journey, comprising: the corresponding partitions of database quantity of current server is determined according to the zone configuration of current server;According to the number
The multidomain treat-ment number of threads of current server is determined according to library partition quantity;According to the multidomain treat-ment number of threads of current server
It creates the division and handles thread.
16. device as claimed in claim 15, which is characterized in that management module is also used to: according to the subregion of current server
After processing number of threads creates the division and handles thread, by the partition identification of the corresponding partitions of database of each multidomain treat-ment thread
It is initialised in thread attribute;
Processing module is using multidomain treat-ment thread to pending data corresponding with the zone configuration of current server in database
It is handled, comprising:
For each multidomain treat-ment thread of current server:
Using the partition identification in thread attribute as querying condition, inquire and corresponding with the partition identification in lock database
State is data to be processed in partitions of database;List to be processed is added in the data of locking, by corresponding data in database
State be updated to it is locked;Data in the list to be processed are handled, it is right in more new database after the completion of processing
Answer the state of data.
17. device as claimed in claim 16, which is characterized in that correspond to number in more new database after the completion of processing module processing
According to state, comprising:
Judge whether data processing succeeds;
If success, the state of corresponding data in database is updated to processing after processing is completed and is completed;If unsuccessful,
The state of corresponding data in database is updated to number of processes to be processed, and updating the data after the completion of processing.
18. device as claimed in claim 17, which is characterized in that processing module is also used to: updating the processing time of the data
After number, if the number of processes is greater than or equal to preset times threshold value, abnormity prompt information is issued.
19. device as claimed in claim 16, which is characterized in that processing module is using multidomain treat-ment thread to described to be processed
After the completion of a data processing in list, the second preset duration of interval carries out next data in the list to be processed
Processing.
20. the device as described in claim 11-19 is any, which is characterized in that further include: Redis database, for storing
State server registration table.
21. a kind of distribution subregion task schedule electronic equipment characterized by comprising
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
The now method as described in any in claim 1-10.
22. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that described program is held by processor
The method as described in any in claim 1-10 is realized when row.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811472957.0A CN110377416A (en) | 2018-12-04 | 2018-12-04 | Distributed subregion method for scheduling task and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811472957.0A CN110377416A (en) | 2018-12-04 | 2018-12-04 | Distributed subregion method for scheduling task and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110377416A true CN110377416A (en) | 2019-10-25 |
Family
ID=68243171
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811472957.0A Pending CN110377416A (en) | 2018-12-04 | 2018-12-04 | Distributed subregion method for scheduling task and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110377416A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851483A (en) * | 2019-11-07 | 2020-02-28 | 京东数字科技控股有限公司 | Method, apparatus, electronic device, and medium for screening objects |
| CN111290846A (en) * | 2020-02-26 | 2020-06-16 | 杭州涂鸦信息技术有限公司 | Distributed task scheduling method and system |
| CN111427706A (en) * | 2020-03-20 | 2020-07-17 | 中国联合网络通信集团有限公司 | Data processing method, multi-server system, database, electronic device, and storage medium |
| CN112860505A (en) * | 2019-11-27 | 2021-05-28 | 北京沃东天骏信息技术有限公司 | Method and device for regulating and controlling distributed clusters |
| CN113297304A (en) * | 2020-06-30 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Data import system and method |
| CN113760319A (en) * | 2020-11-27 | 2021-12-07 | 北京京东振世信息技术有限公司 | Method and system for updating application |
| CN115309757A (en) * | 2022-06-23 | 2022-11-08 | 新华三技术有限公司 | Database multithreading processing method, device and equipment and storage medium |
| CN115544075A (en) * | 2022-11-03 | 2022-12-30 | 华夏基金管理有限公司 | A data processing method and device |
| CN116820786A (en) * | 2023-08-31 | 2023-09-29 | 本原数据(北京)信息技术有限公司 | Data access method and device of database, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040194093A1 (en) * | 2003-03-24 | 2004-09-30 | Sun Microsystems, Inc. | Thread level application partitioning |
| CN104238999A (en) * | 2013-06-09 | 2014-12-24 | 阿里巴巴集团控股有限公司 | Task scheduling method and device based on horizontal partitioning type distributed database |
| CN106708620A (en) * | 2015-11-13 | 2017-05-24 | 苏宁云商集团股份有限公司 | Data processing method and system |
| CN108132837A (en) * | 2018-01-02 | 2018-06-08 | 中国工商银行股份有限公司 | A kind of distributed type assemblies dispatch system and method |
| CN108347455A (en) * | 2017-01-24 | 2018-07-31 | 阿里巴巴集团控股有限公司 | Metadata interaction method and system |
-
2018
- 2018-12-04 CN CN201811472957.0A patent/CN110377416A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040194093A1 (en) * | 2003-03-24 | 2004-09-30 | Sun Microsystems, Inc. | Thread level application partitioning |
| CN104238999A (en) * | 2013-06-09 | 2014-12-24 | 阿里巴巴集团控股有限公司 | Task scheduling method and device based on horizontal partitioning type distributed database |
| CN106708620A (en) * | 2015-11-13 | 2017-05-24 | 苏宁云商集团股份有限公司 | Data processing method and system |
| CN108347455A (en) * | 2017-01-24 | 2018-07-31 | 阿里巴巴集团控股有限公司 | Metadata interaction method and system |
| CN108132837A (en) * | 2018-01-02 | 2018-06-08 | 中国工商银行股份有限公司 | A kind of distributed type assemblies dispatch system and method |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851483A (en) * | 2019-11-07 | 2020-02-28 | 京东数字科技控股有限公司 | Method, apparatus, electronic device, and medium for screening objects |
| CN110851483B (en) * | 2019-11-07 | 2021-03-05 | 京东数字科技控股有限公司 | Method, apparatus, electronic device, and medium for screening objects |
| CN112860505A (en) * | 2019-11-27 | 2021-05-28 | 北京沃东天骏信息技术有限公司 | Method and device for regulating and controlling distributed clusters |
| CN111290846A (en) * | 2020-02-26 | 2020-06-16 | 杭州涂鸦信息技术有限公司 | Distributed task scheduling method and system |
| CN111290846B (en) * | 2020-02-26 | 2023-08-18 | 杭州涂鸦信息技术有限公司 | Distributed task scheduling method and system |
| CN111427706B (en) * | 2020-03-20 | 2023-06-20 | 中国联合网络通信集团有限公司 | Data processing method, multi-server system, database, electronic device and storage medium |
| CN111427706A (en) * | 2020-03-20 | 2020-07-17 | 中国联合网络通信集团有限公司 | Data processing method, multi-server system, database, electronic device, and storage medium |
| CN113297304A (en) * | 2020-06-30 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Data import system and method |
| CN113297304B (en) * | 2020-06-30 | 2024-03-08 | 阿里巴巴集团控股有限公司 | Data import system and method |
| CN113760319A (en) * | 2020-11-27 | 2021-12-07 | 北京京东振世信息技术有限公司 | Method and system for updating application |
| CN113760319B (en) * | 2020-11-27 | 2024-05-17 | 北京京东振世信息技术有限公司 | Method and system for updating application |
| CN115309757A (en) * | 2022-06-23 | 2022-11-08 | 新华三技术有限公司 | Database multithreading processing method, device and equipment and storage medium |
| CN115544075A (en) * | 2022-11-03 | 2022-12-30 | 华夏基金管理有限公司 | A data processing method and device |
| CN116820786A (en) * | 2023-08-31 | 2023-09-29 | 本原数据(北京)信息技术有限公司 | Data access method and device of database, electronic equipment and storage medium |
| CN116820786B (en) * | 2023-08-31 | 2023-12-19 | 本原数据(北京)信息技术有限公司 | Data access method and device of database, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110377416A (en) | Distributed subregion method for scheduling task and device | |
| CN108182111A (en) | Task scheduling system, method and apparatus | |
| CN104580284B (en) | Traffic assignments device and method for distributing business | |
| CN109413127A (en) | A kind of method of data synchronization and device | |
| CN109640319A (en) | Dispatching method, device and electronic equipment based on access information | |
| CN109905286A (en) | A kind of method and system of monitoring device operating status | |
| CN109697075A (en) | File updating method, system and device | |
| CN108733476A (en) | A kind of method and apparatus executing multitask | |
| CN109408205A (en) | Method for scheduling task and device based on hadoop cluster | |
| CN109388626A (en) | Method and apparatus for being numbered to traffic assignments | |
| CN109241033A (en) | The method and apparatus for creating real-time data warehouse | |
| CN109257320A (en) | Message storage method and device | |
| CN109408286A (en) | Data processing method, device, system, computer readable storage medium | |
| CN108921712A (en) | Data processing method, device, medium and electronic equipment | |
| CN110427415A (en) | Knowledge share method, device, system media and electronic equipment | |
| CN109879126A (en) | A kind of method and system of elevator reservation | |
| CN108932157A (en) | Method, system, electronic equipment and the readable medium of distributed treatment task | |
| CN113076186B (en) | Task processing method, device, electronic equipment and storage medium | |
| CN108733399A (en) | The method and apparatus that dynamic updates configuration data | |
| CN109684059A (en) | Method and device for monitoring data | |
| CN113760488A (en) | Method, device, equipment and computer readable medium for scheduling task | |
| CN108985673A (en) | It makes an inventory single generation method and device | |
| CN108399046A (en) | File operation requests treating method and apparatus | |
| CN109685358A (en) | Generation method, device, medium and the electronic equipment for task of keeping a public place clean | |
| CN113283742A (en) | Task allocation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200601 Address after: Room A1905, 19th floor, No. 2 Building, 18 Kechuang 11th Street, Beijing Daxing District, Beijing Applicant after: Beijing Jingdong Qianshi Technology Co.,Ltd. Address before: 300 457 days Tianjin Binhai New Area, Tianjin Economic and Technological Development Zone, No. 10 Fourth Avenue, Phase 2, First Floor Applicant before: Tianjin Jingdong Shentuo Robot Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right |