Skip to content

[Optimization][Catalogue] Optimize getCatalogueTreeData API performance for large amount of catalogue records #4583

Description

@hayden520

Search before asking

  • I had searched in the issues and found no similar optimization requirement.

Description

Image

Optimization Description

The /api/catalogue/getCatalogueTreeData interface loads very slowly when there are a large number of catalogue and job records.
In our actual production scenario, we have about 1500 jobs and dozens of directories, with a maximum directory depth of 3 levels. Currently, the tree loading response time takes more than 28 seconds, which seriously affects user experience.

Current Problem

The catalogue tree uses full data loading. All directory and job data is queried and parsed at once, resulting in excessive interface response time when the data volume increases.

Expected Optimization

Optimize the catalogue tree loading logic. Support lazy loading of tree nodes or optimize database query efficiency to reduce interface response time.

Environment

  • Dinky version: 1.2.3/1.2.4/1.2.5
  • Database: MySQL

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions