-
Notifications
You must be signed in to change notification settings - Fork 0
feat: 7 - living doc copilot #9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
miroslavpojer
wants to merge
66
commits into
master
Choose a base branch
from
feature/7-living-doc-copilot
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
66 commits
Select commit
Hold shift + click to select a range
677b52d
Implement token-saving skill and related evaluation files; update REA…
miroslavpojer e709f12
Add title parameter to release notes presence check in PR workflow
miroslavpojer f653b27
Update documentation for token-saving skill; add contribution guideli…
miroslavpojer fd9f957
Add token-saving skill documentation with response formatting rules
miroslavpojer b0eb566
Initial design, review of skill.md files not finished.
miroslavpojer dcbfcb5
Update links to living-doc-glossary in various skill documents and ag…
miroslavpojer 15b5cec
Update links to living-doc-glossary in SKILL.md files and remove obso…
miroslavpojer 9aab9d1
Add living doc automation scripts for ID assignment, gap detection, i…
miroslavpojer c172270
feat: add script to scan .feature files for AC link compliance
miroslavpojer ae2fa98
feat: enhance documentation with new skills and update references
miroslavpojer 313385e
feat: remove outdated implementation roadmap from the repository
miroslavpojer 8e33c87
Refactor Gherkin step definitions and Living Doc skills
miroslavpojer c63f2dd
feat: update Gherkin step definitions and enhance living documentatio…
miroslavpojer b983ef6
Add evaluation configurations for Gherkin and PageObject skills
miroslavpojer 21503cd
feat: enhance Gherkin-Living Doc sync skill with improved description…
miroslavpojer ea9b7c8
Refactor living documentation skills for improved clarity and functio…
miroslavpojer d13a22f
feat: add evals and trigger evaluations for living-doc and living-doc…
miroslavpojer 4d94d28
chore: remove roadmap.md as part of project restructuring
miroslavpojer 8ad9e59
tmp
miroslavpojer 6ac9ff3
Remove tmp data.
miroslavpojer 949234b
Updated form Unify project integration.
miroslavpojer 337bcfd
Updated evals and finished round 1 of trigger evals testing.
miroslavpojer e4cef54
Update living documentation agent description and triggers for clarit…
miroslavpojer 9edf2eb
Update .gitignore and enhance living documentation skills with new co…
miroslavpojer 8e7ba76
Enhance evals with improved output formatting and additional queries …
miroslavpojer 17baf4e
Backup from integration
miroslavpojer 3bdc5c2
partial tune status backup
miroslavpojer 3fd7e50
Skill gap reduction.
miroslavpojer b45c00a
Final fix of gaps and issues.
miroslavpojer 4f825bc
Test case review.
miroslavpojer fafcd64
Tested agent and improved testing doc.
miroslavpojer d4462a7
Skill test - round 1.
miroslavpojer c615596
Update SKILL.md files to enhance trigger phrases and improve descript…
miroslavpojer c70f8ca
Worked in changed from weakness review.
miroslavpojer f3c88e3
Testing round 2.
miroslavpojer 2c2d495
Update skills from adoption pilot.
miroslavpojer c78364d
improved evals
miroslavpojer 14f5b6a
Minimize skill text size — preserve information, reduce verbosity
miroslavpojer 46447da
tuned skills according exising evals
miroslavpojer 561c1ba
Merge master into feature/7-living-doc-copilot
miroslavpojer 40a13a4
Merge branch 'master' into feature/7-living-doc-copilot
miroslavpojer 9dd739c
Refactor living documentation and BDD copilot integration; update REA…
miroslavpojer ac52bfe
Update living documentation and BDD copilot integration; enhance READ…
miroslavpojer f9aaaf0
Add living documentation schemas and glossary for BDD framework
miroslavpojer 39c0299
Refactor schema paths in JSON files and update file handling in Pytho…
miroslavpojer 74d7bf2
Update schema paths and enhance manifest description for clarity
miroslavpojer 0dc583c
Enhance regex patterns for AC IDs and feature IDs; update living docu…
miroslavpojer 6a354b9
Enhance regex for AC IDs in coverage report; improve ID extraction lo…
miroslavpojer aa1081a
Update ID format in coverage report; change acceptance criteria ID to…
miroslavpojer 7f9d7c7
Update trigger phrases and documentation for clarity; fix script usag…
miroslavpojer 05b47b0
Refine descriptions for living documentation and BDD automation; stan…
miroslavpojer 976b90d
Normalize acceptance criteria state values and enhance documentation …
miroslavpojer 04cd211
Clarify agent invocation instructions and update documentation for ag…
miroslavpojer ccd9df7
Enhance AC ID handling in coverage report; add canonicalization for n…
miroslavpojer acb2cf9
Refine AC ID format handling in scripts; update regex patterns for co…
miroslavpojer cbbe72f
Enhance token-saving skill and documentation
miroslavpojer 5e9b25b
Refactor Feature ID handling to enforce numeric-only convention
miroslavpojer 30ec29e
Standardize AC state terminology to Title-case across documentation a…
miroslavpojer c8d551b
Refactor AC state handling to use lowercase with underscores across t…
miroslavpojer 397d527
Update references to living-doc schemas and glossary across multiple …
miroslavpojer 8083c10
Update README and schema files for clarity; refine feature ID pattern…
miroslavpojer 555979a
Update feature IDs to numeric-only format across various skills and d…
miroslavpojer 8922aa0
Enhance living_doc_id.py documentation to clarify ID conventions; enf…
miroslavpojer 4b2a288
Refactor file search in dead-code detectors to use recursive globbing…
miroslavpojer df55e38
Update slug-based FEAT ID tests to improve error message clarity and …
miroslavpojer e035326
Final adjustment using local pr-review skill.
miroslavpojer File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Binary file not shown.
Large diffs are not rendered by default.
Oops, something went wrong.
27 changes: 27 additions & 0 deletions
27
.github/agents/evals/living-doc-bdd-copilot/fixture-map.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,27 @@ | ||
| # Fixture Map — living-doc-bdd-copilot agent evals | ||
|
|
||
| ## Eval coverage summary | ||
|
|
||
| | Eval ID | Category | Description | Fixture files | | ||
| |---------|----------|-------------|---------------| | ||
| | 1 | happy-path | Business Seed assembly — seed.yaml structure | — | | ||
| | 2 | happy-path | Create mode: PageObject generation from crawled surface | — | | ||
| | 3 | happy-path | Scenario generation from US ACs | — | | ||
| | 4 | regression | RE-SCAN mode — selector drift detection and repair | — | | ||
| | 5 | regression | HEALING mode — broken step definitions | — | | ||
| | 6 | negative | Unit test request → @sdet-copilot | — | | ||
| | 7 | paraphrase | "fix failing tests" → HEALING mode trigger | — | | ||
| | 8 | regression | REMOVE mode — full feature removal with pre-deletion checklist | — | | ||
| | 9 | regression | Partial state rule: seed.yaml present, manifest.json absent → first run | — | | ||
| | 10 | regression | Credential safety — literal credentials in seed.yaml rejected | — | | ||
| | 11 | edge-case | Source E guided traversal — blocked crawl, unknown field value | — | | ||
| | 12 | output-format | manifest.json entry structure for a scanned route | — | | ||
| | 25 | negative | Unit test request → decline + direct to @sdet-copilot | — | | ||
|
|
||
| ## Trigger eval summary | ||
|
|
||
| | Count | Triggers (should_trigger=true) | Non-triggers (should_trigger=false) | | ||
| |-------|-------------------------------|--------------------------------------| | ||
| | 44 total | 22 true | 22 false | | ||
|
|
||
| > No fixture files — all evals use inline prompt/expected_output; agent behavior is assessed against the agent.md operating rules and skill definitions. |
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| **/__pycache__/* | ||
| **/.DS_Store | ||
| skills-eval-workspace/* | ||
| agents-eval-workspace/* | ||
| .playwright-mcp/* |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.