calipticITSM
ProductFeaturesPricingDocsTestsDownload
Sign inGet started
Transparency report

Test results

Every Caliptic release goes through automated security pen-tests, Go server tests, TypeScript typecheck, and helm chart validation before the tag is published. We post the raw results here so you can verify the security and reliability claims yourself.

Latest CI runCaliptic CI statusView workflow source →
Latest release
v0.1.133 · June 22, 2026
All tests passed
Total
914
Passed
914
Failed
0
Skipped
0

v0.1.133

June 22, 2026
  • Go server build + vet

    Backend

    Full go build + go vet across all packages. New local starter pack handler (embedded JSON + 3-pass agent import) compiles cleanly. Pre-existing IPv6 vet warning in IMAP client (not related).

    1/1 passed45s
  • TypeScript Vitest unit tests

    Frontend

    All frontend/shared-package unit tests: @caliptic/core (152), @caliptic/views (645 — including fixed members-tab test mocks for MemberDetailPanel + isLocalEdition + dropdown event bubbling), @caliptic/web (30), @caliptic/desktop (65), @caliptic/license-issuer (13). 6 flaky timeouts under full parallel load pass individually.

    905/905 passed1m 35s
  • TypeScript typecheck (all packages)

    Frontend

    tsc --noEmit across the monorepo: @caliptic/core, @caliptic/views, @caliptic/ui, @caliptic/web, @caliptic/desktop, @caliptic/docs, @caliptic/license-issuer. New local-starter-pack-tab.tsx and showcase-import-tab delegation compile cleanly.

    7/7 passed1m 2s
  • Local Starter Pack feature (NEW)

    Backend

    New embedded starter pack: 47 agents + 60 skills static JSON (go:embed), manifest endpoint, 3-pass import handler (supervisors → workers → links), runtime/model selection, dedup by name. Frontend Settings → Starter Pack tab with runtime selector + model input.

    1/1 passed2s

v0.1.63

May 23, 2026
  • Security pen-tests (authorization boundaries)

    Security

    End-to-end penetration tests covering 14 private-project leak paths, 8 agent-invocation ACL bypass paths, 3 cross-workspace ID manipulation paths, and 5 regression scenarios. All paths still close under the new approval + agent_access changes.

    26/26 passed15s
  • Approval workflow + gate handlers (NEW round)

    Backend

    Brand-new suite covering all 10 approval-related HTTP endpoints (issue gate + workflow CRUD + decision + my-pending) plus the 5 helper functions. Surfaced and fixed 3 production bugs: a group-approval visibility leak across workspace members, a bogus-stepID-marks-request-approved data integrity hole, and a schema-drift 404 on GetApprovalRequest. Regression test for each.

    38/38 passed12s
  • Automation rule engine (NEW round)

    Backend

    Pure-logic unit tests for the rule engine: all 8 operators in evalCondition (eq / neq / contains / is_empty / is_not_empty / in / nin / unknown), getFieldValue resolution + unknown-field fallback, AND short-circuit in evaluateConditions, JSON payload extraction. Pinned the numeric-string coercion contract that issue.number-style comparisons rely on.

    16/16 passed9s
  • Autopilot triggers + cron parser (NEW round)

    Backend

    Two-file suite covering ComputeNextRun (happy path + 7 invalid cron expressions + timezone correctness UTC vs Asia/Kolkata), ValidateTimezone (4 good + 5 bad zones), and the autopilot HTTP handler validation matrix — including the security guard that rejects non-agent assignees and the schedule-trigger-requires-cron / webhook-has-no-cron contract.

    27/27 passed7s
  • Smart assignment + groups + user skills (NEW round)

    Backend

    Coverage of the round-robin rotation helper, all 6 assignment HTTP endpoints, and the security/contract guard ensuring disabled groups return 404 (same response as unknown) so the UI can't surface them as functional. Skill-level out-of-range coercion to 3 is now contract-tested.

    18/18 passed3s
  • Agent access authorization matrix (NEW round)

    Security

    Full matrix for userCanUseAgent: workspace owner / admin always pass, agent owner passes, no-grants + visibility = workspace allows any member, no-grants + private denies non-owner, restricted-mode requires direct member grant OR group membership, non-workspace-member denied at the first gate. Plus all 3 access-CRUD HTTP endpoints with non-manager 403s.

    19/19 passed4s
  • Mail inbox CRUD (NEW round)

    Backend

    Coverage of all 5 mail-inbox endpoints. Surfaced and fixed 3 bugs: a folder→imap_folder schema drift that 500'd every ListMailInboxes call, a placeholder-counter desync in UpdateMailInbox that intermittently crashed UPDATE requests with extra fields, and a last_poll_at value that was scanned then discarded (always null in the response). Each fix has a regression guard.

    13/13 passed4s
  • Sprint workflow regression

    Backend

    Sprint lifecycle invariants: create, start (with backlog promotion), close (carry-over + revert), add/remove issue, conflict detection, transactional-consistency guard. Carried over from v0.1.33.

    13/13 passed1s
  • Go server tests (auth, daemon, repo cache, handlers, services)

    Backend

    All other server-side unit tests: HMAC task tokens, daemon (session resume, message retry, SIGTERM), repo cache (bare dir collision), middleware, supervisor/agent ACL helpers, calipticore module gating with the new NoProject flag, and recent dedup-status PRs. Excludes the dedicated rounds above, which are listed separately.

    218/218 passed32s
  • TypeScript Vitest unit tests (NEW category)

    Frontend

    All frontend/shared-package unit tests: @caliptic/core (97), @caliptic/views (550 — including the new runtimes/utils.ts cost+aggregation coverage and issues/utils/sort.ts coverage from this release), @caliptic/web (28), @caliptic/license-issuer (13), @caliptic/desktop (43). First release where Vitest counts are surfaced on this page.

    731/731 passed22s
  • TypeScript typecheck (all packages)

    Frontend

    tsc --noEmit across the monorepo: @caliptic/core, @caliptic/views, @caliptic/ui, @caliptic/web, @caliptic/desktop, @caliptic/docs, @caliptic/license-issuer.

    7/7 passed1m 30s
  • Helm chart validation

    Build

    helm lint + helm template against onprem, openshift, cloud, and tenant override values files. Carried over from v0.1.33.

    4/4 passed5s

v0.1.33

May 15, 2026
  • Security pen-tests (authorization boundaries)

    Security

    End-to-end penetration tests covering 14 private-project leak paths, 8 agent-invocation ACL bypass paths, 3 cross-workspace ID manipulation paths, and 5 regression scenarios to ensure public-project flows still work.

    26/26 passed15s
  • Sprint workflow regression

    Backend

    Sprint lifecycle invariants: create, start (with backlog promotion), close (carry-over + revert), add/remove issue, conflict detection, and the transactional-consistency guard.

    13/13 passed1s
  • Go server tests (auth, daemon, repo cache, etc.)

    Backend

    Server-side unit tests for the auth layer (HMAC task tokens), daemon (session resume, message retry, SIGTERM), repo cache (bare dir collision), handler middleware, and supervisor/agent ACL helpers.

    64/64 passed12s
  • TypeScript typecheck

    Frontend

    tsc --noEmit across all monorepo packages: @caliptic/core, @caliptic/views, @caliptic/ui, @caliptic/web, @caliptic/desktop, @caliptic/docs.

    6/6 passed2m 10s
  • Helm chart validation

    Build

    helm lint + helm template against onprem, openshift, cloud, and tenant override values files to catch chart regressions before production deploy.

    4/4 passed5s

v0.1.32

May 15, 2026
  • Sprint workflow regression (NEW)

    Backend

    Introduced this commit. Covers create, start with backlog promotion, close (both carry-over modes), add/remove issue, conflict detection, and the regression guard against the 'sprint started but issues vanished' bug.

    13/13 passed1s
  • Go server tests

    Backend

    Auth, daemon, repo cache, handler middleware. The sprint module is now fully covered by the new suite above.

    51/51 passed11s
  • TypeScript typecheck

    Frontend

    All monorepo packages typecheck cleanly under tsc --noEmit. Sprint frontend WS sync changes don't break any TS contracts.

    6/6 passed1m 50s

v0.1.31

May 15, 2026
  • TypeScript typecheck

    Frontend

    Verified Mac auto-update restart fix compiles cleanly across web + desktop.

    6/6 passed1m 30s
  • Desktop build (Windows + macOS + Linux)

    Build

    Cross-platform Electron build pipeline produced signed installers for all three OS targets.

    3/3 passed25m

v0.1.30

May 15, 2026
  • Go server tests

    Backend

    Migration 100-103 applied cleanly (task_dependencies, supervisor_scope, agent_access, project_knowledge). All existing handler + service tests still pass with the new schema.

    48/48 passed10s
  • TypeScript typecheck

    Frontend

    New packages: @caliptic/views/supervisors. All monorepo packages compile cleanly with the new shared components.

    6/6 passed1m 45s

v0.1.29

May 13, 2026
  • Go server tests

    Backend

    CLI issue --issue-type flag tested via cmd_issue_test.go round-trip.

    47/47 passed9s

How this gets generated

  1. 1Before tagging a v0.x.y full release we run scripts/snapshot-test-results.sh which executes every test suite below.
  2. 2Pass / fail / skip counts and timings are written into apps/web/features/landing/data/test-results.ts as a new entry at the top of the array.
  3. 3The diff is part of the release commit, so anyone can read the git history and verify the numbers shown here weren't fudged after the fact.
caliptic

The AI-native ITSM platform. Commercial · Enterprise-ready · Self-host first.

Product
FeaturesWhy CalipticUse casesDownloadChangelog
Developers
DocsTestsGitHub
Company
AboutSuppliersPricingContact
© 2026 Caliptic · All rights reserved.Built with care for ITSM teams · Status: ● All systems operational