Chore: Run the Minimal Pre-Release Agent-Ready Smoke Test #2931

Activity

1. mihar-22

   added this to the GA milestone on Sep 22, 2026
2. mihar-22

   self-assigned this

   on Sep 22, 2026
3. github-project-automation

   added this to Video.js 10 Roadmapon Sep 22, 2026
4. github-actions

   changed the title [-]Run the Minimal Pre-Release Agent-Ready Smoke Test[/-] [+]Chore: Run the Minimal Pre-Release Agent-Ready Smoke Test[/+] on Sep 22, 2026
5. github-actions

   added

   dx

   test

   on Sep 22, 2026
6. github-actions commented on Sep 22, 2026

   

   github-actionsBot

   on Sep 22, 2026 – with GitHub Actions

   Contributor

   More actions

   The exact primary prompts and expected success criteria are not included here, so please add them (or paste a versioned test matrix) for the Next.js, plain-HTML, and Vue runs. That will make this a repeatable release gate rather than an ad-hoc check.

   Planning: this is a GA release-gate task and should remain under videojs/video.js#9440; P1 is appropriate because a failed smoke should block the coordinated launch stack. Coordinate its execution with the release-ready states of #2848, #2883, and videojs/skills#1. No duplicate identified.
7. mihar-22

   marked this as blocking on Sep 22, 2026

   • Chore: Merge the Agent-Ready Pull Request Stacks in Dependency Order #2932
8. mihar-22

   moved this to Up next in Video.js 10 Roadmapon Sep 22, 2026
9. mihar-22 commented on Sep 25, 2026

   

   mihar-22

   on Sep 25, 2026

   MemberAuthor

   More actions

   Smoke test results: pass, no release blockers

   I ran each installation guide's AI Quickstart prompt in clean apps with two real coding agents, headless, each in an isolated config.

   App	Guide prompt	Claude Code	Codex
   Next.js (create-next-app)	React	✅	✅
   Plain HTML page (no package.json)	HTML	✅ plays, but see finding 1	✅ plays, but see finding 1
   Vite (vanilla TS)	HTML	✅	✅
   Vite + Vue	Vue	✅	✅

   How it ran

   • Session 1: the guide's exact AI Quickstart prompt.
   • Session 2: a fresh session in the same config, asked to "Add a Video.js video player to this app's main page that plays a demo video", mirroring the skill's own "start a new session" follow-up.
   • Pre-release sources: the CLI from pkg.pr.new/@videojs/cli@c40afc2 (main), @videojs/* packages from the same preview, the skill from the feat/videojs-skill branch of feat: add videojs agent skill skills#1, and docs from main.videojs.org. The CDN path used the published 10.0.0-rc.2 CDN, because jsDelivr only serves released versions.
   • Verification: I rebuilt every app (npm run build passes in all 8) and loaded the production builds in a browser. Every player loads the demo video and plays (readyState 4, currentTime advancing) with no errors.

   What worked in every run

   • Each agent ran agents skills, installed the skill with its own client, and said a new session was needed.
   • In session 2 the skill was loaded. For Codex, its session lists videojs:videojs.
   • Agents planned with agents init using explicit flags, and installed the version the plan named.

   Findings (non-blocking follow-ups)

   1. Plain HTML page becomes an npm project. Asked to add a player to a static page, both agents scaffolded Vite into it (package.json, src/) instead of using CDN scripts. Codex used CDN first, then switched when asked again.
      • Cause: agents init defaults to --method packaged. It detects "an index.html with no package.json", but the packaged plan for an existing page needs a bundler, so agents create a new app instead.
      • Suggested fix: when the CLI detects a plain page, default to --method cdn and list it as defaulted with its source.
   2. Codex treats the Quickstart prompt as a build request. "Then use the Video.js skill for this project" led Codex to add a player in session 1, before anyone asked for one. Claude Code only installed the skill.
      • Suggested wording: "…when you work on video or audio in this project."

   Not covered

   The exact released commands (npx @videojs/cli, videojs/skills) can't be exercised until the release is out and videojs/skills#1 merges. A short repeat after release would cover them.
10. mihar-22

    closed this as completedon Sep 25, 2026
11. github-project-automation

    moved this from Up next to Done in Video.js 10 Roadmapon Sep 25, 2026
12. mihar-22

    added a parent issue on Oct 12, 2026

    • Feature: Agent-Ready Launch Week video.js#9440