Skip to content

Add AGP usage visibility for Gradle projects#11869

Draft
daniel-mohedano wants to merge 2 commits into
daniel.mohedano/android-robolectricfrom
daniel.mohedano/agp-visibility
Draft

Add AGP usage visibility for Gradle projects#11869
daniel-mohedano wants to merge 2 commits into
daniel.mohedano/android-robolectricfrom
daniel.mohedano/agp-visibility

Conversation

@daniel-mohedano

@daniel-mohedano daniel-mohedano commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

  • Implements additional visibility for session and module spans in Gradle projects making use of the Android Gradle Plugin. Our Gradle instrumentation will consider "Android Projects" those containing the com.android.base plugin in their used plugins.
    • New test.is_android tag is added to module spans and propagated to session spans with an OR operation.
    • New is_android boolean field on the event_finished telemetry metric.

Motivation

Together with #11852, the changes aim to provide better visibility for Android users using Test Optimization. In this case, it provides visibility on the overall Android user base, even if they don't use Robolectric emulation for unit tests.

Contributor Checklist

  • Format the title according to the contribution guidelines
  • Assign the type: and (comp: or inst:) labels in addition to any other useful labels
  • Avoid using close, fix, or any linking keywords when referencing an issue
    Use solves instead, and assign the PR milestone to the issue
  • Update the CODEOWNERS file on source file addition, migration, or deletion
  • Update public documentation with any new configuration flags or behaviors
  • Add your completed PR to the merge queue by commenting /merge. You can also:
    • Customize the commit message associated with the merge with /merge --commit-message "..."
    • Remove your PR from the merge queue with /merge -c
    • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level (note: the PR still needs to be mergeable, this will only skip the pre-merge build)
    • Get more information in this doc

Jira ticket: SDTEST-3887

@daniel-mohedano daniel-mohedano added type: feature Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Jul 6, 2026
@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - sbt-scalatest

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 53.78 55.43 $\color{green}{\blacktriangledown}$ -1.65 54.33 $\color{green}{\blacktriangledown}$ -0.55 54/210
agentEvpProxy 53.40 n/a n/a n/a n/a -

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@datadog-datadog-us1-prod

This comment has been minimized.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - pass4s

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 13.50 10.54 $\color{red}{\blacktriangle}$ +2.96 10.33 $\color{red}{\blacktriangle}$ +3.17 28/103
agentless 10.68 9.73 $\color{red}{\blacktriangle}$ +0.95 9.92 $\color{red}{\blacktriangle}$ +0.76 28/104
agentlessCodeCoverage 14.10 18.08 $\color{green}{\blacktriangledown}$ -3.98 17.73 $\color{green}{\blacktriangledown}$ -3.63 27/101

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - nebula-release-plugin

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 37.84 36.42 $\color{red}{\blacktriangle}$ +1.42 36.42 $\color{red}{\blacktriangle}$ +1.42 30/104
agentless 35.88 36.42 $\color{green}{\blacktriangledown}$ -0.54 35.70 $\color{red}{\blacktriangle}$ +0.18 30/104
agentlessCodeCoverage 44.37 44.48 $\color{green}{\blacktriangledown}$ -0.11 44.48 $\color{green}{\blacktriangledown}$ -0.11 30/104
agentlessLineCoverage 74.23 74.82 $\color{green}{\blacktriangledown}$ -0.59 74.82 $\color{green}{\blacktriangledown}$ -0.59 29/103

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - reactive-streams-jvm

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 22.23 22.09 $\color{red}{\blacktriangle}$ +0.14 21.65 $\color{red}{\blacktriangle}$ +0.58 29/130
agentless 18.27 18.82 $\color{green}{\blacktriangledown}$ -0.55 18.82 $\color{green}{\blacktriangledown}$ -0.55 29/128
agentlessCodeCoverage 20.46 19.99 $\color{red}{\blacktriangle}$ +0.47 19.99 $\color{red}{\blacktriangle}$ +0.47 28/127
agentlessLineCoverage 30.69 30.42 $\color{red}{\blacktriangle}$ +0.27 29.82 $\color{red}{\blacktriangle}$ +0.87 28/127

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - netflix-zuul

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 88.61 87.80 $\color{red}{\blacktriangle}$ +0.81 86.07 $\color{red}{\blacktriangle}$ +2.54 30/132
agentless 82.98 81.05 $\color{red}{\blacktriangle}$ +1.93 81.05 $\color{red}{\blacktriangle}$ +1.93 32/133
agentlessCodeCoverage 98.26 95.12 $\color{red}{\blacktriangle}$ +3.14 95.12 $\color{red}{\blacktriangle}$ +3.14 30/129
agentlessLineCoverage 113.91 111.62 $\color{red}{\blacktriangle}$ +2.29 111.62 $\color{red}{\blacktriangle}$ +2.29 29/128

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@daniel-mohedano daniel-mohedano force-pushed the daniel.mohedano/agp-visibility branch from bec0bb1 to 2d4c049 Compare July 6, 2026 14:10
@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - sonar-kotlin

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 11.94 13.13 $\color{green}{\blacktriangledown}$ -1.19 13.13 $\color{green}{\blacktriangledown}$ -1.19 30/107
agentless 11.60 12.37 $\color{green}{\blacktriangledown}$ -0.77 12.12 $\color{green}{\blacktriangledown}$ -0.52 30/106
agentlessCodeCoverage 15.03 15.11 $\color{green}{\blacktriangledown}$ -0.08 15.11 $\color{green}{\blacktriangledown}$ -0.08 30/106
agentlessLineCoverage 18.31 19.59 $\color{green}{\blacktriangledown}$ -1.28 19.20 $\color{green}{\blacktriangledown}$ -0.89 29/106

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - jolokia

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 95.79 93.23 $\color{red}{\blacktriangle}$ +2.56 93.23 $\color{red}{\blacktriangle}$ +2.56 31/109
agentless 90.81 89.58 $\color{red}{\blacktriangle}$ +1.23 89.58 $\color{red}{\blacktriangle}$ +1.23 29/107
agentlessCodeCoverage 101.50 99.00 $\color{red}{\blacktriangle}$ +2.50 99.00 $\color{red}{\blacktriangle}$ +2.50 30/106
agentlessLineCoverage 101.43 99.00 $\color{red}{\blacktriangle}$ +2.43 99.00 $\color{red}{\blacktriangle}$ +2.43 28/104

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@dd-octo-sts

dd-octo-sts Bot commented Jul 6, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 13.98 s 13.90 s [-0.1%; +1.2%] (no difference)
startup:insecure-bank:tracing:Agent 12.89 s 13.00 s [-1.7%; +0.1%] (no difference)
startup:petclinic:appsec:Agent 16.89 s 16.89 s [-0.9%; +0.9%] (no difference)
startup:petclinic:iast:Agent 16.93 s 16.97 s [-1.1%; +0.7%] (no difference)
startup:petclinic:profiling:Agent 16.54 s 16.83 s [-2.6%; -0.7%] (maybe better)
startup:petclinic:sca:Agent 16.96 s 16.83 s [-0.3%; +1.8%] (no difference)
startup:petclinic:tracing:Agent 16.22 s 16.07 s [-0.1%; +1.9%] (no difference)

Commit: 0919bcc8 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - okhttp

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 19.26 19.20 $\color{red}{\blacktriangle}$ +0.06 19.20 $\color{red}{\blacktriangle}$ +0.06 31/112
agentless 19.70 18.82 $\color{red}{\blacktriangle}$ +0.88 19.20 $\color{red}{\blacktriangle}$ +0.50 29/110
agentlessCodeCoverage 23.54 22.09 $\color{red}{\blacktriangle}$ +1.45 22.09 $\color{red}{\blacktriangle}$ +1.45 30/109
agentlessLineCoverage 44.82 44.48 $\color{red}{\blacktriangle}$ +0.34 44.48 $\color{red}{\blacktriangle}$ +0.34 31/115

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - spring_boot

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 15.75 16.04 $\color{green}{\blacktriangledown}$ -0.29 16.04 $\color{green}{\blacktriangledown}$ -0.29 28/100
agentless 9.54 9.73 $\color{green}{\blacktriangledown}$ -0.19 9.73 $\color{green}{\blacktriangledown}$ -0.19 29/101
agentlessCodeCoverage 13.16 13.13 $\color{red}{\blacktriangle}$ +0.03 13.13 $\color{red}{\blacktriangle}$ +0.03 28/99
agentlessLineCoverage 32.17 32.95 $\color{green}{\blacktriangledown}$ -0.78 32.30 $\color{green}{\blacktriangledown}$ -0.13 27/99

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - sonar-java

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 9.19 17.73 $\color{green}{\blacktriangledown}$ -8.54 15.72 $\color{green}{\blacktriangledown}$ -6.53 29/108
agentless 17.48 24.41 $\color{green}{\blacktriangledown}$ -6.93 19.59 $\color{green}{\blacktriangledown}$ -2.11 29/107
agentlessCodeCoverage 56.42 89.58 $\color{green}{\blacktriangledown}$ -33.16 86.07 $\color{green}{\blacktriangledown}$ -29.65 29/107
agentlessLineCoverage 125.95 147.69 $\color{green}{\blacktriangledown}$ -21.74 141.90 $\color{green}{\blacktriangledown}$ -15.95 29/107

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

@cit-pr-commenter-54b7da

cit-pr-commenter-54b7da Bot commented Jul 6, 2026

Copy link
Copy Markdown

Test Environment - heliboard

Job Status: 🟢 success

Scenario This PR (%) 7d median Δ 7d 30d median Δ 30d runs (7d/30d)
agent 9.56 9.16 $\color{red}{\blacktriangle}$ +0.40 9.16 $\color{red}{\blacktriangle}$ +0.40 4/4

Baseline: median of @test.tracer_overhead on main (gitlab) over the last 7/30 days, per OSS project & scenario. Δ = this PR − baseline median; red ▲ = more overhead, green ▽ = less overhead than baseline.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: ci visibility Continuous Integration Visibility type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant