Skip to content

[demo] missing_docs drift-watch: resolve oz CLI drift (GA docs + gated deferral)#279

Merged
hongyi-chen merged 2 commits into
oz/missing-docs-skill-overhaulfrom
oz/missing-docs-drift-demo
Jun 30, 2026
Merged

[demo] missing_docs drift-watch: resolve oz CLI drift (GA docs + gated deferral)#279
hongyi-chen merged 2 commits into
oz/missing-docs-skill-overhaulfrom
oz/missing-docs-drift-demo

Conversation

@hongyi-chen

Copy link
Copy Markdown
Collaborator

What this is

A live drift-detection demo for the missing_docs skill (stacked on #201). It runs the skill's drift-watch loop on real, current drift in the oz CLI and resolves every finding according to each command's GA rollout status — including the new gated:<Flag> deferral mechanism from #201.

This is the "actual drift-detection test" requested: the audit found 15 undocumented CLI subcommands, and this PR closes all of them.

The drift the audit detected

python3 .agents/skills/missing_docs/scripts/audit_docs.py --category cli flagged 15 undocumented oz subcommands across three command groups:

  • oz agent get / create / update / delete / skills
  • oz run conversation / conversation get / message (+ watch / send / list / read / mark-delivered)
  • oz provider setup / list

How each group was resolved (by rollout status)

The skill defers non-GA surfaces and documents GA ones. Statuses were confirmed via the audit's own compute_flag_statuses against crates/warp_features:

  • NamedAgents = ga → documented the oz agent named-agent management group in the CLI reference, drafted flag-by-flag from crates/warp_cli/src/agent.rs. Also fixed an existing bug: the old oz agent list entry incorrectly described listing skills with --repo (that behavior is actually oz agent skills).
  • ConversationApi = ga → documented oz run conversation get and the oz run message inbox commands, drafted from crates/warp_cli/src/task.rs.
  • ProviderCommand = dogfood (non-GA) → deferred the whole oz provider group via gated:ProviderCommand in the surface map. It is intentionally undocumented while non-GA and will auto-surface as a finding once ProviderCommand goes GA. This is the core demonstration of the gated mechanism on real drift.

Validation

  • audit_docs.py --category cli0 gaps (was 15).
  • Full audit accounting: cli_commands.finding: 0, gated_non_ga: 14 (11 Agent Memory + 3 oz provider), map_hygiene: 0, unaccounted: {}.
  • Skill test suite: 27 passed.
  • Reviewer routing (suggest_reviewers.py) for the documented sources (crates/warp_cli/*) → @bnavetta, @ianhodge.

The remaining gaps in the full audit (18 API spec gaps, 29 LOW terminology) are pre-existing and unrelated to this change.

Files changed

  • src/content/docs/reference/cli/index.mdx — GA command docs + oz agent list bug fix.
  • .agents/skills/missing_docs/references/feature_surface_map.mdoz provider group deferred via gated:ProviderCommand.

Conversation: https://staging.warp.dev/conversation/c5ce6a1a-81a4-4a04-92d9-8d587693be12
Run: https://oz.staging.warp.dev/runs/019f19e2-f981-725b-b383-bc7ea01adb6a
Plans:

This PR was generated with Oz.

…, oz provider)

Demonstrates the missing_docs drift-watch loop end to end on real drift.
The audit flagged 15 undocumented `oz` subcommands; this resolves all of
them according to each command's GA rollout status:

- GA (NamedAgents): document the `oz agent` named-agent management group
  (list/get/create/update/delete + `oz agent skills`) and fix the existing
  `oz agent list` entry, which incorrectly described skill listing.
- GA (ConversationApi): document `oz run conversation get` and the
  `oz run message` inbox commands (list/read/watch/send/mark-delivered).
- Non-GA (ProviderCommand = dogfood): defer the whole `oz provider` group
  via `gated:ProviderCommand` so it auto-surfaces for docs when it goes GA.

All command flags drafted from crates/warp_cli source (agent.rs, task.rs,
provider.rs). CLI audit now reports 0 gaps; cli_commands gated_non_ga = 14.

Co-Authored-By: Oz <oz-agent@warp.dev>
@cla-bot cla-bot Bot added the cla-signed label Jun 30, 2026
@vercel

vercel Bot commented Jun 30, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs Ready Ready Preview, Comment Jun 30, 2026 10:43pm

Request Review

@hongyi-chen hongyi-chen marked this pull request as ready for review June 30, 2026 22:43
@oz-for-oss

oz-for-oss Bot commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

@hongyi-chen

I'm starting a first review of this pull request.

I cancelled the in-progress review run because this pull request was closed.

Powered by Oz

@hongyi-chen hongyi-chen merged commit 738b7b8 into oz/missing-docs-skill-overhaul Jun 30, 2026
4 checks passed
@hongyi-chen hongyi-chen deleted the oz/missing-docs-drift-demo branch June 30, 2026 22:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant