METHOD FOR PARALLEL EXECUTION OF THE JOIN OPERATION WHILE PROCESSING LARGE STRUCTURED HIGHLY ACTIVE DATA Russian patent published in 2021 - IPC G06F16/2455 

FIELD: data processing.

SUBSTANCE: invention relates to a method for parallel execution of the JOIN operation while processing large structured highly active data. In the method, in a computer-implemented data manipulation system using the SQL language, after the host processor receives both operand tables and the row selection conditions in the operation, the rows of the operand tables are distributed among a set of processing modules in the form of fragment tables, followed by parallel execution of the SQL JOIN operation in the processing modules over said fragments of operand tables while simultaneously combining the results, wherein the distribution of the rows of fragment tables among the set of processing modules is preceded by the host processor forming an index table for each operand table, wherein each row comprises the value of the key of the SQL JOIN operation and the value of the amount of rows in said operand table, corresponding to the key, the operation of intersection of the formed index tables is executed while calculating the product of the use frequencies of the keys of the SQL JOIN operation in the operand tables, the obtained summary metadata table is sorted in the descending order of the values of the product of the use frequencies of the keys, the rows of operand tables are selected for the fragment tables according to the values of the keys corresponding to the rows of the summary metadata table so that each pair of fragment tables in one processing module only comprises the rows of the operand tables with the same key value.

EFFECT: increasing productivity of data processing.

1 cl, 5 dwg