METHOD AND SYSTEM FOR AUTOMATED GENERATION AND FILLING OF DATA MARTS USING DECLARATION DESCRIPTION Russian patent published in 2023 - IPC G06F16/28 G06F16/27 

FIELD: automated generation and filling of data marts using a declarative description.

SUBSTANCE: method and system for automated generation and filling of data marts using a declarative description. Method contains the following steps: first, the core of the framework is deployed on the cluster; preparing rules for generating data marts, containing a set of data transformation parameters that allow to automatically determine the types of data in the generated tables of the generated data mart; data orchestration rules containing a declarative description are prepared: parameters for calculating target tables and executing queries within calculations; parameters of data accumulation in the context of the history for each table, lists of key fields, lists of fields for comparison and hashing; execution context parameters; the rules prepared in the previous steps are loaded into the repository; on the basis of the rules loaded into the repository, the data mart distribution package is automatically generated and stored in the repository; the generated and saved data mart distribution kit carries out the following on the basis of the declarative description: data transformation; calls procedures for accumulating data in the context of history; performs a backup; performs the procedure for restoring the data transformation process after a failure.

EFFECT: increase of speed and fault tolerance of generating and filling data marts.

6 cl, 2 dwg