[python] Batch mixed Java write tests#8405
Merged
Merged
Conversation
leaves12138
approved these changes
Jul 1, 2026
leaves12138
left a comment
Contributor
There was a problem hiding this comment.
LGTM. I reviewed the batching control flow for the mixed Java/Python script.
The default path now runs the Java write methods in per-module batches before the existing Python validation flow, and the later Java-write phases are skipped only after the batched phase succeeds. The MIXED_TESTS_BATCH_JAVA_WRITES=false opt-out still preserves the original one-by-one Maven flow.
Local verification:
bash -n paimon-python/dev/run_mixed_tests.shgit diff origin/master..HEAD --check- Mocked full-script dry run with fake
mvn/python: default batch path reduced Maven calls from 31 to 14 while keeping the Java read phases, and the opt-out path kept the original 31 Maven invocations. - Mocked failed batched Java write path: the script exits before entering Python validation.
I did not run the full mixed Java/Python E2E suite locally.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Batch the Java write side of
run_mixed_tests.shby module before the existing Python validation flow. This reduces repeated Maven invocations while preserving an opt-out path for the original one-by-one execution.Changes
MIXED_TESTS_BATCH_JAVA_WRITES=falsefor isolating failures with the previous flow.Testing
bash -n paimon-python/dev/run_mixed_tests.shgit diff --checkNotes
I attempted a small Maven multi-method selection smoke test, but it produced no output for over two minutes and was interrupted to avoid leaving a long-running local verification.