Data processing can be understood as table conversion. After a table is filtered, sorted, grouped, producted, merged, etc., it is converted to another table, and complex data processing logic is built through continuous table conversion.
By defining simple query conditions for the processed table data, defining how to display the data in the form of histograms, line graphs, etc., setting data penetration conditions, etc., data users can use the data more conveniently.
Manual data processing is performed through the operation table. These operations can also be set as background tasks and executed at a specified time or frequency. The data in the external database can be incrementally crawled every night, and complex calculation tasks can be calculated in advance, and the report query can be very fast.