RLTasksby ulam.ai
Sign inAll tasks
Operations & simulationsOPS-0082

OPS-0082

A time-boxed production-operations incident in a deterministic Kubernetes-behavior simulator with continuous traffic. Each episode combines latent fault classes and may require rollback, canary-template repair, multi-resource configuration repair, or an evidence-supported no-write hold. Agents must diagnose safely, preserve four stable plus one canary endpoint, and stay within a two-mutation budget.

Decision makingStateful environmentRLVR
Version4.0.0
Environments1
RewardScalar · 0–1
DeliveryPrivate ZIP
01 Task contract

A real, versioned RL environment.

A time-boxed production-operations incident in a deterministic Kubernetes-behavior simulator with continuous traffic. Each episode combines latent fault classes and may require rollback, canary-template repair, multi-resource configuration repair, or an evidence-supported no-write hold. Agents must diagnose safely, preserve four stable plus one canary endpoint, and stay within a two-mutation budget.

Agent objective

  • Interact with the supplied stateful environment.
  • Produce verifier-checkable actions or artifacts.
  • Maximise scalar reward under the package contract.

Evaluation

  • Private verifier.
  • Reported reward range 0–1.
  • Package-specific public and private checks.

Delivery boundary

  • Private object stored in Cloudflare R2.
  • Authenticated entitlement required.
  • Short-lived signed URL per download.
02 What you will work on

Distinct environments, one demanding research contract.

Enough detail to understand the intellectual terrain; generated instances, hidden mechanisms, and solution paths remain inside the private package.

EnvironmentMathematical or technical frontierAdaptive research problem
Diagnosis and provenanceKubernetes objects, logs, metrics, releasesCorrelate two interacting causes and verify approved images, configuration digests, ABI, init, and evidence coverage.
Business behaviorCanary and shared-Service semanticsValidate quotes, refunds, thresholds, rounding, jurisdictions, coupons, malformed requests, and every backend.
Lifecycle and rolloutProbes, drain, surge, disruptionSeparate startup/readiness/liveness, preserve zero-unavailable rollout, survive restart and node eviction, and verify convergence.
Security and resourcesPod shape and least privilegePreserve non-root, read-only, capability, token, volume, quota, and topology contracts.
Minimal evidence-based changeTwo-mutation safety budgetUse diagnostics and dry runs, alter only justified resources, and submit exact causes, evidence, changes, and decision.
03 Why it is interesting

What the supplied evaluation reveals.

A recorded GPT-5.6 Pro solution finished in 33 of 45 minutes and earned 1.000. It passed all 23 checks, including 37 hidden canary assertions and 185 shared-Service assertions, with one of two allowed mutations and no critical safety violation. Reference calibration reaches 1.0 across 64 seeds while inappropriate blind rollback remains low. This is a simulator, not a live cluster, and hosted scoring is the stronger trust boundary.

We publish aggregate behavior and task structure, while withholding generated instances, hidden labels, exact successful probes, private checks, and solution trajectories.

04 Supplied evaluation

Observed evaluation result.

Shown with its provenance and limitations; it is not a performance guarantee.

i
Methodology matters

Solved in 33 minutes. The report records 37/37 hidden canary assertions and 185/185 hidden service assertions passed.

Evaluated system / policyGPT-5.6 Pro

As identified by the supplied artifact.

Reward1.000

1 reported runs.

Result artifactIncluded

notes.md

Public result record

Machine-readable provenance and the exact displayed metric are available in results.json.

Open result JSON
05 Private delivery

The package stays off the public website.

The paid ZIP will live in a private R2 bucket. Vercel authorizes the buyer and issues a 2–5 minute object URL; R2 serves the bytes directly.

Included with purchase

  • Exact package version 4.0.0
  • Environment and task contracts
  • Verifier or scoring interface
  • Supplied reference/evaluation artifacts
  • Purchase record and licence v1.1
delivery flow
Authenticated buyer + entitlement check
+ private R2 object + 2–5 minute signed URL
= direct, auditable download

Package SHA-256
3d5a45484a48d74ad0228403c6983bc434de6ef88a0ff61fa8c62b4ac7074781
06 Licence v1.1

Commercial use, without exclusivity.

One purchase licenses this identified item to one legal organisation for worldwide, perpetual commercial model training, evaluation, research and development. Redistribution and resale of the package are not permitted.

Read the full licenceYotta Content LTD · business customers only
OPS-0082

Ready to add this environment?

Back to marketplace
Stripe checkout

Business purchase confirmation

Sign in or create an account, then complete secure Stripe Checkout. Access is granted only by the verified payment webhook.