refactor: add query_profile and query_details persistent log tables

[dqhl76]

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

This PR included:

1. Added persistent log tables query_profile and query_details
2. Refactored code to simplify the process of adding new tables to the persistent_system
3. Implemented schema migration support (by renaming and recreation)

We will have three tables (if enable in config):

select * from persistent_system.query_log;
select * from persistent_system.query_profile;
select * from persistent_system.query_details;

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe):

---

This change is 

[Copilot]

Copilot reviewed 5 out of 6 changed files in this pull request and generated no comments.

Files not reviewed (1)

• tests/logging/check_logs_table.sh: Language not supported

Comments suppressed due to low confidence (3)

src/query/service/src/persistent_log/global_persistent_log.rs:242

• [nitpick] Consider quoting the table_name with backticks for consistency with the rename_target formatting to prevent potential SQL parsing issues.

let rename = format!("ALTER TABLE persistent_system.{} RENAME TO {}", table_name, rename_target);

src/common/tracing/src/init.rs:386

• The removal of the cfg.profile.dir.is_empty() check may enable profile logging even when no profile directory is configured; please verify that this change is intentional.

if cfg.profile.on {

src/common/tracing/src/init.rs:393

• Similarly, the removal of the cfg.query.dir.is_empty() check could enable query logging without a proper directory setting; ensure that this behavior is expected.

if cfg.query.on {

[github-actions]

Docker Image for PR

• tag: pr-17702-592ba19-1744685528

note: this image tag is only available for internal use.

[github-actions]

ClickBench Report

• hits: https://benchmark.databend.com/clickbench/pr/17702/14459878992/hits.html
• load: https://benchmark.databend.com/clickbench/pr/17702/14459878992/load.html
• tpch: https://benchmark.databend.com/clickbench/pr/17702/14459878992/tpch.html