SemanticOps Test Runner v1.1.39: Release Notes

SemanticOps Test Runner v1.1.39 is out, with browser and device-code sign-in, test stability classification, order-tolerant baselines, virtualized selectors, steadier run behavior, and model-scoped tests that survive migrations.

New in v1.1.39

• Flexible sign-in — choose browser sign-in for local interactive use or device-code sign-in for remote and headless sessions, with clear waiting, cancellation, and conflict states.
• Test stability classification — the dashboard and test list show stable, flaky, degraded, and insufficient-history classifications with retry evidence.
• Order-tolerant baselines — new hash and aggregate baselines ignore incidental engine row ordering while preserving duplicates and selected-column order.

Improvements

• Measure, performance-query, and relationship selectors render only visible rows and load additional measure pages as you scroll.
• Run All now uses your current set of enabled tests; a busy model-bound operation returns a retryable message without clearing prior results.
• Failed capability, test-catalog, or run-history requests retry when the window regains focus, while projections that already loaded remain available.
• Open wizards discard late results from a previous model and require stale model-derived selections to be resolved before saving.

• Tests, baselines, and history are scoped to the connected model; known legacy records migrate to the stable model identity without changing their IDs.
• Save a snapshot test as a draft before its first capture, then choose the returned baseline explicitly.
• Authored test definitions remain visible and exportable when masking is enabled; query results and value-bearing diagnostics stay protected.

Coming soon in SemanticOps MCP 4.0

A DAX measure quality scorecard: correctness, performance, maintainability, and style, scored together with the findings behind them.

Get it

➡️ Download: GitHub Releases — requires SemanticOps Pro

➡️ Website: semanticops.dev/test-runner