|
| 1 | +# Production Readiness Checklist |
| 2 | + |
| 3 | +This document tracks production-worthiness of the **chrome-devtools-mcp** server and **overtime-ag-plugin** skills for deployment. |
| 4 | + |
| 5 | +## Chrome DevTools MCP |
| 6 | + |
| 7 | +| Check | Status | Notes | |
| 8 | +|-------|--------|-------| |
| 9 | +| Unit/integration tests | [OK] | `npm run test` - full suite in `tests/` | |
| 10 | +| CI (GitHub Actions) | [OK] | `run-tests.yml` - ubuntu, windows, macos x node 20-24 | |
| 11 | +| Build/bundle | [OK] | `npm run bundle` produces distributable | |
| 12 | +| TypeScript strict | [OK] | `tsc --noEmit` | |
| 13 | +| Lint/format | [OK] | ESLint + Prettier via `check-format` | |
| 14 | +| Documentation | [OK] | `docs/`, `tool-reference.md`, skill in `skills/chrome-devtools/` | |
| 15 | +| Release pipeline | [OK] | release-please, publish-to-npm-on-tag | |
| 16 | + |
| 17 | +**Pre-deploy**: Run `npm run test` and `npm run bundle` from repo root. |
| 18 | + |
| 19 | +--- |
| 20 | + |
| 21 | +## Overtime-ag-plugin |
| 22 | + |
| 23 | +| Check | Status | Notes | |
| 24 | +|-------|--------|-------| |
| 25 | +| Unit tests | [OK] | `uv run pytest tests/` - recording, replay, parse, output, api_normalize, utils | |
| 26 | +| Replay smoke | [OK] | `run_tests.ps1` - replay-only from `data/cbb_recording.json` | |
| 27 | +| E2E (record) | [!!] Manual | Requires headed browser + live site; run setup/record-cbb skill | |
| 28 | +| CI | [OK] | `overtime-ag-tests.yml` on push/PR to plugin paths | |
| 29 | +| Playwright install | [OK] | `uv run playwright install chromium` | |
| 30 | +| .env setup | [OK] | Copy `.env.example` to `.env` for OT_* vars | |
| 31 | + |
| 32 | +**Pre-deploy**: Run `.\run_tests.ps1` from `project/` or `.\scripts\test-production-readiness.ps1` from repo root. |
| 33 | + |
| 34 | +--- |
| 35 | + |
| 36 | +## Skills Coverage |
| 37 | + |
| 38 | +| Skill | Purpose | Tested By | |
| 39 | +|-------|---------|-----------| |
| 40 | +| **chrome-devtools** | MCP reference for browser automation | Chrome DevTools MCP suite | |
| 41 | +| **setup** | Init uv + Playwright, verify advanced-mode | `run_tests.ps1` step 3 | |
| 42 | +| **record-cbb** | Record CBB network calls | E2E manual | |
| 43 | +| **scrape-cbb** | Replay and export to JSON/CSV/Parquet | `run_tests.ps1` replay smoke | |
| 44 | + |
| 45 | +--- |
| 46 | + |
| 47 | +## Unified Test Script |
| 48 | + |
| 49 | +From repo root: |
| 50 | + |
| 51 | +```powershell |
| 52 | +.\scripts\test-production-readiness.ps1 |
| 53 | +``` |
| 54 | + |
| 55 | +Use `-SkipE2E` to avoid E2E instructions (default). The script: |
| 56 | + |
| 57 | +1. Builds and runs Chrome DevTools MCP tests |
| 58 | +2. Runs overtime-ag pytest |
| 59 | +3. Runs replay-only smoke (if `data/cbb_recording.json` exists) |
| 60 | +4. Prints manual E2E instructions |
| 61 | + |
| 62 | +--- |
| 63 | + |
| 64 | +## Gaps / Future Work |
| 65 | + |
| 66 | +- **Overtime-ag CI**: Add `.github/workflows/overtime-ag-tests.yml` to run pytest + replay smoke on push/PR |
| 67 | +- **E2E automation**: Full record+replay in CI would require headed browser or mocked overtime.ag; low priority |
| 68 | +- **Chrome DevTools + overtime integration**: Optional eval using MCP tools to discover overtime.ag APIs (reference in `skills/chrome-devtools/network-for-scraping-discovery.md`) |
0 commit comments