How OyaCloud Works

Every CI test run, turned into an answer.

OyaCloud collects the test results your CI already produces and links them across builds, branches, and environments.

One CLI command uploads results from any pipeline. From there you get PR verdicts, branch health, regression trends, flaky test detection, and AI root cause — no migration, no new framework, no infrastructure to manage.

What OyaCloud tells you

PR, post-merge, and regression builds are tracked separately, so each question gets the right comparison.

PR verdicts

Every pull-request run is compared against the last baseline for the same target branch, environment, and suite — so you see exactly which failures the PR introduced.

Post-merge branch health

Track how main changes after each merge, with pass-rate history per suite and environment, before regressions compound.

Regression tracking

Nightly and weekly runs live in their own view with trends over days and weeks — consistently failing versus newly broken, at a glance.

Flaky test detection

Tests that flip between pass and fail across runs are flagged per environment and suite, with thresholds you configure per project.

AI root-cause analysis

Failures are grouped by type and explained in plain language with a suggested fix — not just a stack trace.

Environments hub

Staging, production, dev — each environment gets its own pass-rate trend, build health, and failing and flaky test lists.

Everything Your CI Doesn't Tell You

Historical context, branch comparisons, environment health, flaky test detection, regression insights, and automation stability — all in one place.

Zero setup

Upload from anywhere in one command

Your results files stay where they are. Point the CLI at your output directory — OyaCloud handles classification, deduplication, and storage automatically.

  • ✓Works from CI runners, local machines, or scheduled jobs
  • ✓Playwright, Cypress, JUnit, TestNG, and pytest all supported
  • ✓Build ID returned immediately — results appear in your dashboard in seconds
terminal — CI runner
$ npm install -g oyacloud
added 1 package in 1.2s
$ oyacloud config set-key oya_abc123def456
API key saved.
$ oyacloud upload \
--framework playwright_ts \
--environment staging \
--results-dir test-results
Uploading 127 test results…
✓ Build created [a3f91c24]
View at: app.oyaplus.com/results/a3f91c24
app.oyaplus.com/analytics/dashboard
DashboardGood morning, Alex 👋
Live · Updated just now
0%
overall pass rate this week
0
tests run this week
0
builds this week
0
active projects
🔴 Top Failing Suites2
Auth › Login Flow
staging · main
41%
Checkout › Payment
prod · main
67%
📉 Pass Rate Declining2
Email › Notification
92% → 71%
Search › Filters
88% → 74%
🚫 PRs Not Ready to Merge2
PR #247
feature/oauth → main
2 failures
PR #249
feature/cart → main
1 flaky
💥 Worst Runs This Week2
d2c09fFull Suite
34%
a91cdeSmoke
52%
🌀 Most Flaky Tests3
#TestSuiteFlip RateLast 10 RunsAvg Dur.First Seen
1oauth_redirect_testAuth
34%
1.4s3w ago
2cart_total_update_checkCart
21%
0.8s1w ago
3email_delivery_under_3sNotify
14%
2.1s5d ago
Command center

One dashboard for every signal that matters

Stop checking multiple tools. Failing suites, declining pass rates, blocked PRs, and flaky tests — surfaced in one live view across all your projects.

  • ✓All projects in a single pane with health indicators
  • ✓Live-updating data with no manual refresh
  • ✓Activity feed with full build context on every row
Merge gates

Know if a PR introduced new failures before review

Every PR run gets an automatic verdict against the last baseline on the same branch, environment, and suite. Your team knows immediately — before code review starts.

  • ✓Exact new-failure count, not just "tests failed"
  • ✓New failures vs known flaky clearly distinguished
  • ✓Links directly into error details and AI root cause
app.oyaplus.com/analytics/results
Pull Requests3
#247FAIL
feature/oauth-login
12m ago85%
#246SAFE
feature/search-filters
2h ago100%
#244SAFE
fix/cart-total
1d ago98%
↕ PR #247feat: add OAuth login flow
staging · Auth
CRITICALNEW FAILURES DETECTED•2 failures•85% pass
2 new failures not in main·−6% vs baseline·View AI insights →
Results
AI Insights
Trends
Reports
Filter Tests:
All 14
Passed 12
Failed 2
Skipped 1
auth/login.spec › redirects to /dashboard1.2s
auth/oauth.spec › Google login flow completesNEW3.4s
Expected '.dashboard-header' to be visible
auth/email.spec › reset email delivered within 5sNEW8.1s
Expected delivery within 5000ms, received 8142ms
auth/session.spec › remember me persists tokenFLAKY2.1s
app.oyaplus.com/analytics/builds
Builds
BuildProjectBranchTest SummaryStatusContext InsightTime
b9d12e⇌ Post-Merge
fix: cart quantity update
Mobile Appmain0/50⊗ Failed4 new failures12m ago
a3f91c⇌ Post-Merge
feat: OAuth login flow
Web Appmain0/50⊙ PassedClean1h ago
c7e44a⇌ Post-Merge
refactor: checkout flow
Web Appmain0/50⊙ Passed2 known flaky3h ago
Main branch health

Track what every merge introduced to main

Post-merge runs capture how your main branch test suite changes after each commit. Catch regressions before they compound across the next sprint.

  • ✓Pass-rate history per suite and environment
  • ✓Surface regressions before the next release
  • ✓Compare staging vs production in the same view
Regression tracking

Schedule full test runs and see what slipped

Run nightly or weekly regressions independently from PR and post-merge builds. Get a clear picture of what is consistently failing versus newly broken.

  • ✓Separate tab — never mixed with PR or post-merge data
  • ✓Trend over days and weeks in the same view
  • ✓Drill into any run for the full test-by-test breakdown
app.oyaplus.com/analytics/builds
Builds
BuildProjectEnvironmentTest SummaryStatusContext InsightTime
c7e44a▷ Regression
Web Appstaging0/50⊙ Passed2 known flaky2h ago
d2c09f▷ Regression
Web Appprod0/50⊗ Failed3 failures6h ago
e5a11b▷ Regression
Mobile Appstaging0/50⊙ PassedClean8h ago
app.oyaplus.com/analytics/results
↕ PR #247feat: add OAuth login flow
Results
AI Insights
Trends
Reports
All 14
⏱️ Timeout 2
🟡 Flaky 1
Root Cause AnalysisAWS Bedrock

2 tests in the Auth suite are failing due to a timing issue in the OAuth redirect flow. The dashboard header element is not visible within the expected timeout — likely a race condition introduced in this PR.

Suggested Fix

Add an explicit wait for the redirect to complete before asserting on dashboard state. Consider page.waitForURL or increase the default timeout for this suite.

Failure Pattern
auth/oauth.specTimeout · element visibility3 of last 5
auth/email.specTimeout · async delivery2 of last 5
AI-powered analysis

Root cause analysis, not just stack traces

OyaCloud analyzes failure patterns and error messages to explain what actually went wrong — and where to look first. You get a suggested fix, not just a log.

  • ✓Pattern analysis across multiple failures in one run
  • ✓Suggested fix in plain language, not raw stack output
  • ✓Powered by AWS Bedrock, running on your data
Environment hub

Health visibility across every environment

Staging, production, dev — each environment gets its own pass-rate trend, build health strips, and flaky test list. No more environment-specific blind spots.

  • ✓Per-environment flaky and failing test breakdown
  • ✓PR, Post-Merge, and Regression tracked separately per env
  • ✓Click into any environment for full trend drill-down
app.oyaplus.com/analytics/environments
Environments7 days
0
Total builds (7 days)
0
Active environments
0
Flaky tests (all envs)
Environment Health7 days · click to explore
prod1,440 passed
staging1,290 passed · 12 failed
dev4,590 passed · 810 failed

Works with your existing tests and CI

Point the CLI at the results directory your framework already writes. No code changes needed.

Test frameworks

Playwright (TypeScript/JS)Playwright (Python)TestNG (Java)JUnit (Java)pytest (Python)Cypress

CI/CD platforms

GitHub ActionsGitLab CICircleCIJenkinsAzure DevOpsBitbucket
Get started — setup for every CI →

Built for the whole team

Developers

Know whether your PR broke something — or whether that failure was already there — before review starts.

QA engineers

Drill from any build into test-by-test results, failure history across environments, and AI root cause.

QA leads & engineering managers

One dashboard for pass rates, blocked PRs, flaky counts, and per-environment health across every project.

Start with a 30-day free trial.

No credit card. One command to your first insight.