Skip to content

TestRail

xyva.ai integrates with TestRail to synchronise test cases and map execution results, keeping your test management system in sync with actual test runs.

API Credentials Setup

Navigate to Settings > Integrations > TestRail and configure:

FieldDescription
TestRail URLBase URL, e.g. https://yourorg.testrail.io
EmailAccount email used for API authentication
API KeyGenerated under My Settings > API Keys in TestRail
Project IDNumeric TestRail project identifier

WARNING

TestRail API access must be enabled by an administrator under Administration > Site Settings > API. Without this, all API calls return 403.

Test Case Sync

xyva maps its internal test catalog to TestRail sections and cases:

text
xyva Catalog                    TestRail
─────────────────               ──────────────────
Suite: Login                →   Section: Login
  ├ valid-credentials.spec  →     Case C1001
  ├ invalid-password.spec   →     Case C1002
  └ lockout-after-5.spec    →     Case C1003
  • Import pulls TestRail cases into the xyva catalog as read-only references.
  • Export pushes new xyva test definitions to TestRail as draft cases.
  • Sync performs a bidirectional merge, matching by case title and section path.

INFO

Sync uses the test file name as the primary matching key. Rename detection is not automatic -- if you rename a spec file, re-map it manually in the catalog.

Result Mapping

When a test run completes, xyva can post results to a TestRail run:

xyva ResultTestRail Status
PassedPassed (1)
FailedFailed (5)
SkippedBlocked (2)
Timed OutRetest (4)

Results include elapsed time, error messages, and a link back to the xyva run report.

Automatic Posting

Enable Auto-post results in the integration settings to push results after every Runner execution. xyva creates a new TestRail test run or appends to an existing open run based on the configured strategy:

  • Per execution -- one TestRail run per xyva run
  • Daily roll-up -- all results from the same calendar day in one run

TIP

Use the daily roll-up strategy for nightly regression suites to avoid cluttering TestRail with dozens of individual runs.

  • YouTrack -- issue tracking for failed tests
  • Runner -- test execution engine

Local-first QA orchestration.