CN115907010A - Knowledge base deployment method, device, electronic equipment and medium based on data sharding - Google Patents

Abstract

The present invention relates to the field of data sharding, and discloses a knowledge base deployment method, device, electronic equipment, and medium based on data sharding. The method includes: acquiring a knowledge base, querying the knowledge data and knowledge structure of the knowledge base, and constructing The structure file of the knowledge structure; performing data fragmentation on the knowledge data to obtain fragment knowledge, performing periodic storage on the fragment knowledge to obtain periodic storage knowledge, constructing the knowledge data according to the periodic storage knowledge The upgrade verification file; use the structure file to deploy the structure in the pre-built user private service to obtain the structure deployment service, use the upgrade verification file to deploy and upgrade the knowledge data in the structure deployment service , to obtain the deployment result of the knowledge base. The present invention can improve the deployment efficiency of the knowledge base.

Description

Knowledge base deployment method, device, electronic equipment and medium based on data sharding

technical field

The present invention relates to the field of data sharding, in particular to a knowledge base deployment method, device, electronic device and medium based on data sharding.

Background technique

Knowledge base deployment based on data sharding refers to the process of deploying data in different locations of the server after sharding the data in the knowledge base.

At present, when open source detection tools are deployed privately, the existing knowledge base deployment is to package the entire knowledge base data to the user server for deployment. This method has the problem that the entire package data is extremely large and the deployment is slow, and users often only need to One or part of the development language components in the knowledge base, the vulnerabilities associated with the components, and the license data associated with the components (hereinafter replaced with development language data), do not require the full amount of development language data. Therefore, since the entire knowledge base data is packaged to the user server for deployment as a whole, the efficiency of knowledge base deployment is low.

Contents of the invention

In order to solve the above problems, the present invention provides a knowledge base deployment method, device, electronic equipment and media based on data sharding. deployment efficiency.

In order to achieve the above object, the present invention provides a knowledge base deployment method based on data sharding, including: acquiring the knowledge base, querying the knowledge data and knowledge structure of the knowledge base, and constructing the structure file of the knowledge structure; Perform data fragmentation on the knowledge data to obtain fragmentation knowledge, periodically store the fragmentation knowledge to obtain periodic storage knowledge, construct an upgrade verification file of the knowledge data according to the periodic storage knowledge; use the structure The file is structurally deployed in the pre-built user private service to obtain the structural deployment service, and the upgrade verification file is used to deploy and upgrade the knowledge data in the structural deployment service to obtain the deployment result of the knowledge base.

In order to solve the above problems, the present invention provides a knowledge base deployment device based on data sharding, the device includes: a structure building module, used to obtain the knowledge base, query the knowledge data and knowledge structure of the knowledge base, and construct the The structure file of the knowledge structure; the verification building module, which is used to perform data fragmentation on the knowledge data to obtain the fragmentation knowledge, periodically store the fragmentation knowledge, obtain the periodic storage knowledge, and store the knowledge according to the periodicity Constructing the upgrade verification file of the knowledge data; the data upgrade module is used to use the structure file to perform structure deployment in the pre-built user private service to obtain the structure deployment service, and use the upgrade verification file in the The knowledge data is deployed and upgraded in the structure deployment service to obtain the deployment result of the knowledge base.

In order to solve the above problems, the present invention provides an electronic device, comprising:

at least one processor; and a memory communicatively coupled to the at least one processor;

Wherein, the memory stores a computer program executable by the at least one processor, so that the at least one processor can execute the knowledge base deployment based on data sharding as described in any one of the above first aspects method.

In order to solve the above problems, the present invention provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the knowledge base based on data sharding as described in any one of the above-mentioned first aspects is realized. deployment method.

Compared with the existing technology, the technical principle and beneficial effect of this scheme are:

In the embodiment of the present invention, firstly, the knowledge base is acquired to store the data in the knowledge base in slices. Further, the embodiment of the present invention queries the knowledge data and knowledge structure of the knowledge base for subsequent deployment When using a fragmented knowledge base, data can be quickly deployed through a predetermined structure. Further, the embodiment of the present invention constructs the structure file of the knowledge structure, which can be used in the subsequent deployment of the fragmented knowledge base according to The structure of the knowledge base before fragmentation is deployed in an orderly manner. On the one hand, the knowledge base is deployed in batches to facilitate management and control. slices, which are used to deploy the knowledge base in batches and separate development languages, which is convenient for management and control, and the development language data of the knowledge base is controllable, reducing server costs. Further, the embodiment of the present invention performs Periodic storage is used to store the shard knowledge in time intervals, which reduces the pressure of storing too much content at one time. Further, the embodiment of the present invention constructs an upgrade of the knowledge data by storing knowledge according to the period Verification file, used to use the upgrade verification file to record all the information packaged in the cycle, so as to ensure that when the packaged data is upgraded in the future, it can follow the packaging information recorded in the upgrade verification file and its packaging The cycle time of the data package is sequentially upgraded. Further, the embodiment of the present invention uses the structure file to deploy the structure in the pre-built user private service, so as to be used for subsequent knowledge base data in the user private service. Prepare for deployment. Further, the embodiment of the present invention deploys and upgrades the knowledge data in the structure deployment service by using the upgrade verification file, so as to upgrade the data of the knowledge base under the premise of deploying the structure. It is deployed in the user's private service and upgraded to the latest version to ensure that when the user obtains the data packet, the data packet closest to the current time will be automatically obtained. Therefore, a knowledge base deployment method, device, electronic device, and medium based on data sharding proposed by the embodiments of the present invention can deploy the knowledge base of development language data required by users for screening, and improve the efficiency of knowledge base deployment.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings without paying creative labor.

Fig. 1 is a schematic flow diagram of a knowledge base deployment method based on data fragmentation provided by an embodiment of the present invention;

FIG. 2 is a schematic diagram of the storage content of the upgrade verification file in a knowledge base deployment method based on data fragmentation provided in FIG. 1 in an embodiment of the present invention;

Fig. 3 is a schematic module diagram of a knowledge base deployment device based on data sharding provided by an embodiment of the present invention;

FIG. 4 is a schematic diagram of an internal structure of an electronic device implementing a knowledge base deployment method based on data sharding according to an embodiment of the present invention.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the present invention, and are not intended to limit the present invention.

The embodiment of the present invention provides a knowledge base deployment method based on data sharding. The execution subject of the knowledge base deployment method based on data sharding includes but is not limited to a server, a terminal, etc., which can be configured to execute the method provided by the embodiment of the present invention. At least one of the electronic devices of the method. In other words, the knowledge base deployment method based on data sharding can be executed by software or hardware installed on terminal devices or server devices, and the software can be a blockchain platform. The server includes but is not limited to: single server, server cluster, cloud server or cloud server cluster, etc. The server can be an independent server, or it can provide cloud services, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, content delivery network (Content Delivery Network, CDN), and cloud servers for basic cloud computing services such as big data and artificial intelligence platforms.

Referring to FIG. 1 , it is a schematic flowchart of a knowledge base deployment method based on data sharding provided by an embodiment of the present invention. Among them, the knowledge base deployment method based on data sharding described in Figure 1 includes:

S1. Obtain the knowledge base, query the knowledge data and knowledge structure of the knowledge base, and construct the structure file of the knowledge structure.

In the embodiment of the present invention, the knowledge base is acquired to store the data in the knowledge base in slices. Among them, the knowledge base refers to a special database used for knowledge management. It generally adopts the concept-fact-rule knowledge representation system. The concept gives the most basic content of knowledge, which is at the bottom of knowledge; Composition, which establishes the connection between concepts; rules are composed of facts, which establishes the connection between facts.

Further, in the embodiment of the present invention, by querying the knowledge data and knowledge structure of the knowledge base, it can be used for the subsequent deployment of the fragmented knowledge base, and the data can be rapidly deployed through a predetermined structure. Among them, the knowledge data refers to the knowledge in the knowledge base, and the knowledge structure refers to the structural structure of the knowledge in the knowledge base, including the creation of tables, indexes, views, stored procedures, and triggers in the database, as well as the definition of knowledge data, such as knowledge Data type, name, definition of integer, etc.

In an embodiment of the present invention, querying the knowledge data and knowledge structure of the knowledge base includes: obtaining knowledge in the knowledge base and using the knowledge as knowledge data; querying the data association between data in the knowledge data and the storage location of the knowledge data ; According to data association and storage location, determine the knowledge structure of the knowledge base.

Among them, data association refers to the relationship between data. For example, the relationship between each column of data in the table is that the number of columns and the name of the column are consistent, the data in table B belongs to data a in table A, and the front, back, left, and right between data relationship etc. Exemplarily, according to the data association and storage location, determining the knowledge structure of the knowledge base can be as follows: According to the association between data and the storage location of the data, the data in a certain storage location can be stored through a table structure, through an index structure, etc. wait.

Further, the embodiment of the present invention constructs the structure file of the knowledge structure, so that when the fragmented knowledge base is deployed in the future, it can be deployed in an orderly manner according to the structure of the knowledge base before the fragmentation. On the one hand, the knowledge base is divided into Batch deployment is convenient for management and control, and on the other hand, it improves the deployment speed. Among them, the structure file refers to the file that declares the structure in the knowledge base, such as the ddl of mysql and the index mapping of elasticsearch, etc., where the ddl of mysql is used for creating, deleting, modifying and other operations on objects inside the database; elasticsearch The index mapping is used to define the name of the field in the index and define the data type of the field, etc. The function of mapping is to execute a series of instructions to convert the input data into searchable index items.

In an embodiment of the present invention, constructing the structure file of the knowledge structure includes: determining the description method of the knowledge structure in the pre-built initial file; and constructing the structure file of the knowledge structure by using the description method.

Among them, the pre-built initial file includes the initial blank mysql ddl file and the index mapping file of elasticsearch. The description method refers to the method of expressing the knowledge structure in the file, such as the expression method of the context of the knowledge structure, and the attachment of tables and tables. The expression method of the relationship, the expression method of the structure of the addition, deletion, modification and query of knowledge in the knowledge base.

S2. Perform data fragmentation on the knowledge data to obtain the fragmented knowledge, periodically store the fragmented knowledge to obtain the periodic storage knowledge, and construct an upgrade verification file of the knowledge data according to the periodic storage knowledge.

In the embodiments of the present invention, data fragmentation is performed on the knowledge data to deploy the knowledge base in batches and development languages, which facilitates management and control, and the development language data of the knowledge base is controllable, reducing server costs.

In one embodiment of the present invention, performing data fragmentation on knowledge data to obtain fragmentation knowledge includes: identifying the horizontal features of the knowledge data; determining the fragmentation rules of the knowledge data based on the horizontal features; Perform horizontal sharding to obtain sharding knowledge.

Exemplarily, the process of data sharding for knowledge data refers to the process of splitting tables into different databases according to business dimensions, a process dedicated to special databases, such as an order table, and the order-related information in it is placed in the table of the order library. The product information inside is placed in the table of the commodity library, and the address information inside is placed in the user information library. The horizontal feature refers to the information type of each row in each table. For example, each row represents the information corresponding to each order number, then According to the horizontal feature, that is, the order number, the sharding rule is determined according to the single and double order number. Based on the sharding rule, the data in the table is split into a table of single number orders and one Sheet of double number orders.

Further, the embodiment of the present invention periodically stores the slice knowledge for storing the slice knowledge in time intervals, reducing the pressure of too much content stored at one time.

In an embodiment of the present invention, periodic storage of slice knowledge to obtain periodic storage knowledge includes: based on the slice type of slice knowledge, constructing periodic storage subcontracts of slice knowledge; determining the storage period of slice knowledge; According to the storage cycle, the periodic storage sub-package is used to store the slice knowledge periodically, and the periodic storage knowledge is obtained.

Among them, the fragmentation type includes basic information types such as version, vulnerability, and solution, and development language data types such as maven and npm, and the periodic storage subpackage refers to the storage package of data corresponding to each fragmentation type. For example, basic information such as versions, vulnerabilities, and solutions are stored in the basic data package, and development language data such as maven and npm are stored in sub-packages. This packaging process is packaged and stored according to a certain cycle, for example, the basic data package is stored on the first day , Store the maven language package on the second day, store the npm language package on the third day... store the basic data package on the nth day, store the maven language package on the n+1 day... and store it by analogy.

Further, the embodiment of the present invention constructs an upgrade verification file of knowledge data by storing knowledge according to the period, so as to use the upgrade verification file to record all the information packaged in the period, so as to ensure that when the packaged data is upgraded in the future, it can Upgrade the data packages sequentially according to the package information and package cycle time recorded in the upgrade verification file. Among them, the upgrade verification file is used to verify the chronological order of the data packets through the upgrade verification file before upgrading the packaged data package, and the upgrades are performed sequentially. The information in the upgrade verification file, that is, the check file, mainly includes three parts , one part is the split information of the basic package or language pack, such as how many small packages a language pack is split into, the second part is the file hash value of each data package, so as to verify whether the data is safe when the data is upgraded, and finally Part of it is the type and version information of these packages, which facilitates the acquisition and verification of data versions during subsequent upgrades, and provides a version basis for subsequent incremental data upgrades. In short, all knowledge base data is printed one by one in a cycle Each type of single package consists of one check file and multiple data package files. The check file records all the information of the package in this cycle.

Referring to FIG. 2 , it shows a schematic diagram of storage content of an upgrade verification file in a knowledge base deployment method based on data sharding provided in FIG. 1 in an embodiment of the present invention. In Figure 2, the index structure package, basic data package, pip language package, golang language package, other language packages, maven language package, and npm language package indicate that the knowledge base data is cyclically typed into a single package of each type in a cycle, namely The knowledge is stored periodically. The verification information in the figure includes the file hash value of each data package, the type of the package, and the version information. The file hash value of each data package is used to verify whether the data is safe when the data is upgraded. The type and version information facilitate the acquisition and verification of the data version during subsequent upgrades, and provide a version basis for subsequent incremental data upgrades.

In an embodiment of the present invention, according to the periodic storage knowledge, the upgrade verification file of the knowledge data is constructed, including: querying the subpackage hash value, type information and version information of the periodic storage knowledge; according to the subpackage hash value, type information and version information to build verification information for knowledge data; based on periodic storage of knowledge and verification information, build an upgrade verification file for knowledge data.

S3. Use the structure file to deploy the structure in the pre-built user private service to obtain the structure deployment service, use the upgrade verification file to deploy and upgrade the knowledge data in the structure deployment service, and obtain the deployment result of the knowledge base.

In the embodiment of the present invention, structure deployment is performed in the pre-built user private service by using the structure file, so as to prepare for the subsequent deployment of knowledge base data in the user private service. Among them, the pre-built user private service refers to the cloud service built for private users to use alone.

Optionally, use the structure file to deploy the structure in the pre-built user private service. The process of obtaining the structure deployment service can be based on the addition, deletion, modification and query of the data table defined in the structure file, the description of the structural relationship of the data table, and Define the character type and field type of knowledge base data, build an initialized data table, and obtain a cloud service with a well-deployed structure.

Further, the embodiment of the present invention deploys and upgrades the knowledge data in the structure deployment service by using the upgrade verification file, so as to deploy the data of the knowledge base in the user's private service under the premise that the structure is deployed, and upgrade it to The latest version ensures that when users get data packets, they will automatically get the data packets closest to the current time.

In an embodiment of the present invention, the knowledge data is deployed and upgraded in the structure deployment service by using the upgrade verification file, and the deployment result of the knowledge base is obtained, including: using the upgrade verification file to verify the basic data package and language corresponding to the knowledge data Whether the package information is correct; when the basic data package and language pack information are correct, use the upgrade verification file to determine the deployment sequence of the basic data package and language pack; based on the deployment sequence, deploy the knowledge data to obtain the deployment data; Perform data upgrades to obtain the deployment results of the knowledge base.

For example, the basic data package and language package corresponding to the knowledge data are deployed in the user's private service to upgrade the deployment data. When the user obtains the data package, it will automatically obtain the data package closest to the current time. When upgrading the language package, the basic data package needs to be checked. The language pack can only be upgraded on the premise that the basic data package has been upgraded, and before each upgrade, it is necessary to verify whether the check file of the package matches the information of the basic data package and the language pack file, and whether the language version of the package has been upgraded in the system to prevent The data package of the knowledge base has been tampered with to ensure the consistency of the data and version of the knowledge base. Since the data package upgraded by data sharding may be a package n days ago, the knowledge base information such as components, vulnerabilities, and licenses is updated all the time. For release updates, it is necessary to incrementally upgrade the knowledge base version at the time of shard upgrade to the current latest version of the knowledge base version.

It can be seen that the embodiment of the present invention first obtains the knowledge base to store the data in the knowledge base in pieces, and further, the embodiment of the present invention queries the knowledge data and knowledge structure of the knowledge base to use in the When subsequently deploying the fragmented knowledge base, data can be quickly deployed through a predetermined structure. Further, the embodiment of the present invention constructs a structure file of the knowledge structure, which can be used for subsequent deployment of the fragmented knowledge base according to The structure of the knowledge base before fragmentation is deployed in an orderly manner. On the one hand, the knowledge base is deployed in batches to facilitate management and control; It is used to deploy the knowledge base in batches and separate development languages, which is convenient for management and control, and the development language data of the knowledge base is controllable, reducing server costs. Further, the embodiments of the present invention periodically store the fragmented knowledge to It is used to store fragmented knowledge in time intervals, which reduces the pressure of storing too much content at one time. Furthermore, the embodiment of the present invention stores knowledge according to the cycle to construct an upgrade verification file of knowledge data, which is used for using the upgrade verification file. The verification file records all the information packaged in the cycle to ensure that when the packaged data is upgraded in the future, the data packets can be upgraded sequentially according to the packaging information recorded in the upgrade verification file and the cycle time of packaging. Further, this The embodiment of the invention uses the structure file to deploy the structure in the pre-built user private service, so as to prepare for the deployment of the subsequent knowledge base data in the user private service. Further, the embodiment of the present invention uses the upgrade verification The file deploys and upgrades the knowledge data in the structure deployment service, which is used to deploy the data of the knowledge base in the user's private service under the premise of deploying the structure, and upgrades to the latest version to ensure that the user will automatically obtain the data package The most recent packet to the current time. Therefore, a knowledge base deployment method based on data sharding proposed by the embodiment of the present invention can deploy the knowledge base of development language data required for user screening, and improve the efficiency of knowledge base deployment.

As shown in FIG. 3 , it is a functional block diagram of the knowledge base deployment device based on data sharding in the present invention.

The knowledge base deployment device 300 based on data sharding of the present invention can be installed in an electronic device. According to the realized functions, the knowledge base deployment device based on data sharding may include a structure building module 301 , a verification building module 302 and a data upgrading module 303 . The module of the present invention can also be called a unit, which refers to a series of computer program segments that can be executed by the processor of the electronic device and can complete fixed functions, and are stored in the memory of the electronic device.

In the embodiment of the present invention, the functions of each module/unit are as follows:

The structure building module 301 is used to obtain the knowledge base, query the knowledge data and knowledge structure of the knowledge base, and construct the structure file of the knowledge structure;

The verification building module 302 is used to perform data fragmentation on the knowledge data to obtain the fragmentation knowledge, periodically store the fragmentation knowledge to obtain the periodic storage knowledge, and construct an upgrade verification file of the knowledge data according to the periodic storage knowledge;

The data upgrade module 303 is used to use the structure file to deploy the structure in the pre-built user private service to obtain the structure deployment service, and use the upgrade verification file to deploy and upgrade the knowledge data in the structure deployment service to obtain the deployment result of the knowledge base .

In detail, each module in the knowledge base deployment device 300 based on data sharding in the embodiment of the present invention uses the same technical means as the above-mentioned knowledge base deployment method based on data sharding in Figures 1 to 2, And can produce the same technical effect, and will not repeat them here.

As shown in FIG. 4 , it is a schematic structural diagram of an electronic device implementing a knowledge base deployment method based on data sharding in the present invention.

The electronic device may include a processor 40, a memory 41, a communication bus 42, and a communication interface 43, and may also include a computer program stored in the memory 41 and operable on the processor 40, such as a knowledge base deployment program based on data sharding.

Wherein, the processor 40 may be composed of integrated circuits in some embodiments, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits with the same function or different functions, including one or more Central processing unit (Central Processing unit, CPU), microprocessor, digital processing chip, graphics processor and a combination of various control chips, etc. The processor 40 is the control core (Control Unit) of the electronic equipment, and uses various interfaces and lines to connect the various components of the entire electronic equipment, and runs or executes programs or modules stored in the memory 41 (such as executing knowledge based on data fragmentation) library deployment program, etc.), and call the data stored in the memory 41 to execute various functions of the electronic device and process data.

The memory 41 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a mobile hard disk, a multimedia card, a memory card (for example: SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the memory 41 may be an internal storage unit of the electronic device, such as a mobile hard disk of the electronic device. Memory 41 can also be the external storage device of electronic equipment in other embodiments, such as plug-in mobile hard disk equipped on electronic equipment, smart memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card , Flash Card (Flash Card), etc. Further, the memory 41 may also include both an internal storage unit of the electronic device and an external storage device. The memory 41 can not only be used to store application software and various data installed in the electronic device, such as the code of the database configuration connection program, etc., but also can be used to temporarily store the data that has been output or will be output.

The communication bus 42 may be a peripheral component interconnect standard (PCI for short) bus or an extended industry standard architecture (EISA for short) bus or the like. The bus can be divided into address bus, data bus, control bus and so on. The bus is set to realize connection communication between the memory 41 and at least one processor 40 and the like.

The communication interface 43 is used for communication between the electronic device 4 and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), and is generally used to establish a communication connection between the electronic device and other electronic devices. The user interface may be a display (Display) or an input unit (such as a keyboard (Keyboard)). Optionally, the user interface may also be a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, and the like. Wherein, the display may also be properly referred to as a display screen or a display unit, and is used for displaying information processed in the electronic device and for displaying a visualized user interface.

Figure 4 only shows an electronic device with components, and those skilled in the art can understand that the structure shown in Figure 4 does not constitute a limitation on the electronic device, and may include fewer or more components than shown in the figure, or Combining certain parts, or different arrangements of parts.

For example, although not shown, the electronic device may also include a power supply (such as a battery) for supplying power to various components. Preferably, the power supply may be logically connected to at least one processor 40 through a power management device, so as to realize charging management through the power management device, discharge management, and power management functions. The power supply may also include one or more DC or AC power supplies, recharging devices, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components. The electronic device may also include various sensors, bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

It should be understood that the embodiment is only for illustration, and is not limited by the structure in the scope of the patented invention.

The database configuration connection program stored in the memory 41 in the electronic device is a combination of multiple computer programs. When running in the processor 40, it can realize:

Obtain the knowledge base, query the knowledge data and knowledge structure of the knowledge base, and construct the structure file of the knowledge structure;

Carry out data fragmentation on the knowledge data to obtain fragmentation knowledge, periodically store the fragmentation knowledge, obtain periodic storage knowledge, and construct an upgrade verification file of knowledge data according to the periodic storage knowledge;

Use the structure file to deploy the structure in the pre-built user private service to obtain the structure deployment service, use the upgrade verification file to deploy and upgrade the knowledge data in the structure deployment service, and obtain the deployment result of the knowledge base.

Specifically, for a specific implementation method of the above computer program by the processor 40, reference may be made to the description of relevant steps in the embodiment corresponding to FIG. 1 , and details are not repeated here.

Furthermore, if the integrated module/unit of the electronic device is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a non-volatile computer-readable storage medium. Storage media can be either volatile or nonvolatile. For example, a computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, removable hard disk, magnetic disk, optical disk, computer memory, and read-only memory (ROM, Read-Only Memory).

The present invention also provides a storage medium. The readable storage medium stores a computer program. When the computer program is executed by the processor of the electronic device, it can realize:

Obtain the knowledge base, query the knowledge data and knowledge structure of the knowledge base, and construct the structure file of the knowledge structure;

Carry out data fragmentation on the knowledge data to obtain fragmentation knowledge, periodically store the fragmentation knowledge, obtain periodic storage knowledge, and construct an upgrade verification file of knowledge data according to the periodic storage knowledge;

Use the structure file to deploy the structure in the pre-built user private service to obtain the structure deployment service, use the upgrade verification file to deploy and upgrade the knowledge data in the structure deployment service, and obtain the deployment result of the knowledge base.

In the several embodiments provided by the present invention, it should be understood that the disclosed devices, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules is only a logical function division, and there may be other division methods in actual implementation.

A module described as a separate component may or may not be physically separated, and a component shown as a module may or may not be a physical unit, that is, it may be located in one place, or may also be distributed to multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software function modules.

It will be apparent to those skilled in the art that the invention is not limited to the details of the above-described exemplary embodiments, but that the invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention.

Accordingly, the embodiments should be regarded in all points of view as exemplary and not restrictive, the scope of the invention being defined by the appended claims rather than the foregoing description, and it is therefore intended that the scope of the invention be defined by the appended claims rather than by the foregoing description. All changes within the meaning and range of equivalents of the elements are embraced in the present invention. Any reference sign in a claim should not be construed as limiting the claim concerned.

It should be noted that in this article, relative terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these No such actual relationship or order exists between entities or operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

The above are only specific embodiments of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features of the invention herein.

Claims (10)

1. A knowledge base deployment method based on data fragmentation, characterized in that the method comprises: Obtaining a knowledge base, querying the knowledge data and knowledge structure of the knowledge base, and constructing a structure file of the knowledge structure; Performing data fragmentation on the knowledge data to obtain fragmentation knowledge, periodically storing the fragmentation knowledge to obtain periodic storage knowledge, and constructing an upgrade verification file of the knowledge data according to the periodic storage knowledge; Using the structure file to deploy the structure in the pre-built user private service to obtain the structure deployment service, using the upgrade verification file to deploy and upgrade the knowledge data in the structure deployment service to obtain the knowledge base deployment results. 2. The method according to claim 1, wherein the querying the knowledge data and knowledge structure of the knowledge base comprises: acquire knowledge in the knowledge base, and use the knowledge as the knowledge data; Querying the data association between data in the knowledge data and the storage location of the knowledge data; According to the data association and the storage location, the knowledge structure of the knowledge base is determined. 3. The method according to claim 1, characterized in that, said construction of the structure file of said knowledge structure comprises: Determining the description method of the knowledge structure in the pre-built initial file; The structure file of the knowledge structure is constructed by using the description method. 4. The method according to claim 1, wherein said performing data fragmentation on said knowledge data to obtain knowledge of fragmentation comprises: identifying horizontal characteristics of said knowledge data; Determining fragmentation rules for the knowledge data based on the horizontal feature; Based on the sharding rules, the knowledge data is horizontally sharded to obtain the sharded knowledge. 5. The method according to claim 1, wherein the periodic storage of the slice knowledge to obtain the periodic storage knowledge comprises: Based on the sharding type of the sharding knowledge, constructing periodic storage subpackages of the sharding knowledge; Determining the storage period of the shard knowledge; According to the storage period, the periodical storage sub-package is used to periodically store the slice knowledge to obtain the periodical storage knowledge. 6. The method according to claim 1, wherein said constructing an upgrade verification file of said knowledge data according to said periodic stored knowledge comprises: Query the subpackage hash value, type information and version information of the periodic storage knowledge; Construct verification information of the knowledge data according to the subpackage hash value, the type information and the version information; An upgrade verification file of the knowledge data is constructed based on the periodically stored knowledge and the verification information. 7. The method according to claim 1, wherein the deployment and upgrade of the knowledge data in the structure deployment service by using the upgrade verification file to obtain the deployment result of the knowledge base includes : Using the upgrade verification file to verify whether the information of the basic data package and the language package corresponding to the knowledge data is correct; When the basic data package and the language package information are correct, use the upgrade verification file to determine the deployment sequence of the basic data package and the language package; Based on the deployment sequence, perform data deployment on the knowledge data to obtain deployment data; Data upgrade is performed on the deployment data to obtain the deployment result of the knowledge base. 8. A knowledge base deployment device based on data sharding, characterized in that the device comprises: The structure building module is used to obtain the knowledge base, query the knowledge data and knowledge structure of the knowledge base, and construct the structure file of the knowledge structure; The verification building module is used for performing data fragmentation on the knowledge data to obtain fragmentation knowledge, performing periodic storage on the fragmentation knowledge to obtain periodic storage knowledge, and constructing the knowledge data according to the periodic storage knowledge Upgrade verification file; The data upgrade module is used to use the structure file to perform structure deployment in the pre-built user private service to obtain the structure deployment service, and use the upgrade verification file to deploy and upgrade the knowledge data in the structure deployment service , to obtain the deployment result of the knowledge base. 9. An electronic device, characterized in that the electronic device comprises: at least one processor; and, a memory communicatively coupled to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, the computer program is executed by the at least one processor, so that the at least one processor can perform any one of claims 1 to 7 The knowledge base deployment method based on data sharding described in the item. 10. A computer-readable storage medium, storing a computer program, characterized in that, when the computer program is executed by a processor, the knowledge base deployment based on data sharding according to any one of claims 1 to 7 is implemented method.

Images