Skip to content

[core] Add compaction duration log#8273

Merged
JingsongLi merged 8 commits into
apache:masterfrom
atlassian-forks:dwang/add-compaction-duration-log
Jul 3, 2026
Merged

[core] Add compaction duration log#8273
JingsongLi merged 8 commits into
apache:masterfrom
atlassian-forks:dwang/add-compaction-duration-log

Conversation

@dwangatt

Copy link
Copy Markdown
Contributor

Purpose

  • Add logs to trace the duration for compaction writer, so that in job log, we can analyse slow compaction task, bucket size distribution, slow partitions etc.
  • Log real partition info instead of BinaryRow object address when Paimon detects inconsistent bucket setup during committing data to tables.

Tests

No change to code logic, so existing UT/IT should cover the change from this PR.

@dwangatt dwangatt changed the title Dwang/add compaction duration log [core] Add compaction duration log Jun 18, 2026
}

/** Set partition and bucket info for logging purposes. */
public void setPartitionBucketInfo(@Nullable String partitionString, int bucket) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just set a log info? setLogInfo(String logInfo)

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @JingsongLi I updated PR to simplify the logging.

@JingsongLi JingsongLi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit 992f0b5 into apache:master Jul 3, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants