Skip to content

examples: Add vdk-lineage usage example#3481

Open
AdI-70 wants to merge 1 commit into
vmware:mainfrom
AdI-70:add-vdk-lineage-example
Open

examples: Add vdk-lineage usage example#3481
AdI-70 wants to merge 1 commit into
vmware:mainfrom
AdI-70:add-vdk-lineage-example

Conversation

@AdI-70

@AdI-70 AdI-70 commented Jul 8, 2026

Copy link
Copy Markdown

Summary

  • Added a new examples/vdk-lineage-example data job.
  • Documented how to install and configure vdk-lineage.
  • Added a simple SQLite SQL job that creates sample input data and transforms it into an output table.
  • Documented how to send OpenLineage events to Marquez and inspect lineage.
  • Added a debugging scenario for a failed SQL transformation.
  • Linked the new example from examples/README.md and projects/vdk-plugins/vdk-lineage/README.md.

Testing

@AdI-70 AdI-70 closed this Jul 8, 2026
@AdI-70 AdI-70 reopened this Jul 8, 2026
@AdI-70 AdI-70 changed the title Add vdk-lineage usage example examples: Add vdk-lineage usage example Jul 8, 2026
@AdI-70 AdI-70 force-pushed the add-vdk-lineage-example branch from 9cb0c60 to 63500b9 Compare July 8, 2026 15:07
@AdI-70

AdI-70 commented Jul 8, 2026

Copy link
Copy Markdown
Author

The example-specific pre-commit issue has been fixed: examples/vdk-lineage-example/requirements.txt is now sorted, and DCO is passing.

The remaining pre-commit.ci failure appears unrelated to this PR. It is caused by:

  • pyupgrade crashing internally under Python 3.14 with TypeError: cannot use a bytes pattern on a string-like object
  • insert-license attempting to modify unrelated Java files under projects/control-service/...

This PR only changes the new examples/vdk-lineage-example files plus README links, so I have not modified unrelated control-service files.

Signed-off-by: Aditya Shukla <136245654+AdI-70@users.noreply.github.com>
@AdI-70 AdI-70 force-pushed the add-vdk-lineage-example branch from 63500b9 to 802883d Compare July 8, 2026 15:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Provide an example scenario how to use vdk-lineage

1 participant