Skip to content

RTECO-1651 - Update agent plugins tests - #3618

Draft
udaykb2 wants to merge 12 commits into
masterfrom
RTECO-1651-update-plugins-e2e-tests
Draft

RTECO-1651 - Update agent plugins tests#3618
udaykb2 wants to merge 12 commits into
masterfrom
RTECO-1651-update-plugins-e2e-tests

Conversation

@udaykb2

@udaykb2 udaykb2 commented Jul 27, 2026

Copy link
Copy Markdown
Contributor
  • All tests have passed. If this feature is not already covered by the tests, new tests have been added.
  • The pull request is targeting the master branch.
  • The code has been validated to compile successfully by running go vet ./....
  • The code has been formatted properly using go fmt ./....

@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 08b7669 to 3d2cedd Compare July 27, 2026 08:52
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 3d2cedd to 3cce295 Compare July 27, 2026 09:23
@github-actions

Copy link
Copy Markdown
Contributor

👍 Frogbot scanned this pull request and did not find any new security issues.


@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 3cce295 to 84a71f9 Compare July 29, 2026 11:36
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 84a71f9 to c7096cd Compare July 29, 2026 12:11
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 9ed0455 to ae14475 Compare July 29, 2026 18:21
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from ae14475 to 7a367be Compare July 29, 2026 18:30
Changed -test.agentPlugins (incorrect format) to -test.agentPlugins=true
(correct format). Go test flags use single dash prefix with =value format.

The test was being skipped before because the flag was not properly parsed,
causing the exit code 1 failure in the workflow.

Co-authored-by: Cursor <cursoragent@cursor.com>
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 7a367be to e43d891 Compare July 29, 2026 18:32
udaykb2 and others added 2 commits July 30, 2026 11:20
1. Fix TestAgentPluginsInstallSpecificVersion JSON parsing error:
   - Changed manifest type from map[string]string to map[string]any
   - This allows parsing the 'skills' array field added to plugin.json

2. Fix TestAgentPluginsNoRepoConfigured repo auto-discovery:
   - Test was expecting failure when no repo configured
   - But repo auto-discovery now finds matching agentplugins repos
   - Updated test to verify error handling for non-existent repos instead

Co-authored-by: Cursor <cursoragent@cursor.com>
…scope

The install command defaults to --global scope when neither --global nor
--project-dir is specified. Update the test to verify that explicit
--project-dir flag works correctly instead of assuming a different default.

This way we test production code as-is rather than changing production code
to match incorrect test expectations.

Co-authored-by: Cursor <cursoragent@cursor.com>
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from f3ec26a to 9990dab Compare July 30, 2026 05:53
Explicitly use bash shell for the test command to prevent PowerShell from
interpreting the -test flag prefix. This fixes the 'flag provided but not
defined: -test' error on Windows runners.

Co-authored-by: Cursor <cursoragent@cursor.com>
udaykb2 and others added 2 commits July 30, 2026 16:55
Replace loose OR-based error string checks with assertErrorContainsAll
matched to production messages. Rewrite NoRepoConfigured to delete the
agentplugins repo and assert ResolveRepo discovery failure. Require md5,
sha1, and sha256 on checksum tests. Document marketplace install without
marketplace slug syntax and keep multi-harness paths for cursor, claude,
and codex.

Co-authored-by: Cursor <cursoragent@cursor.com>
Search now captures JSON stdout and asserts name/version/repo, substring
matching, latest-version-only rows, blank-query rejection, env-repo
resolution, and the no-match log message. Delete asserts exact production
errors, covers missing slug/version/env-repo paths, and verifies a missing
version of an existing plugin fails without deleting the kept version.

Co-authored-by: Cursor <cursoragent@cursor.com>
udaykb2 and others added 2 commits July 30, 2026 17:06
Assert list JSON rows for remote/local modes, limits, and exact flag/usage
errors instead of smoke-only success checks.

Co-authored-by: Cursor <cursoragent@cursor.com>
Remove duplicate install/list/search smoke tests, assert JSON summaries
and manifest fields, cover project-scope rejection for list/update, env
repo resolution for install/update, and marketplace slug-not-listed errors.

Co-authored-by: Cursor <cursoragent@cursor.com>
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from f3d7e64 to c03e8c0 Compare July 30, 2026 12:01
Cover install, list, check-updates, and update for an agent-config.json
custom agent as a fifth harness case beyond the built-in four.

Also fix three CI assertion mismatches: search no-match log buffer,
update of an uninstalled plugin error text, and ValidateSemver
rejection messages (now table-driven across patch/major/segment cases).

Co-authored-by: Cursor <cursoragent@cursor.com>
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from c03e8c0 to 6857fff Compare July 30, 2026 13:23
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 7784be1 to 1e729b2 Compare July 30, 2026 15:22
Omit --version on harness installs unless a specific older version must be
pinned for update/check-updates scenarios. Custom agents still pass
--version because they are not indexed into marketplace.json.

Custom agent lifecycle covers install, list, and update end-to-end.
Also bump jfrog-cli-artifactory to 659839816e66.

Co-authored-by: Cursor <cursoragent@cursor.com>
@udaykb2
udaykb2 force-pushed the RTECO-1651-update-plugins-e2e-tests branch from 1e729b2 to 1769983 Compare July 30, 2026 15:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant