RLTasksby ulam.ai
Sign inAll tasks
Operations & simulationsRedQueen-1

RedQueen-1

Four non-pausing environments for agents whose world worsens while they deliberate. Every action incurs exogenous latency before application, and commitment costs extra. Across evolving circuits, online job queues, volatile repositories, and locally observed navigation, policies must allocate compute, recover from stale plans, gather bounded information, checkpoint reversible progress, and know when further reasoning is no longer worth its delay.

Decision makingStateful environmentRLVR
Version0.3.0
Environments4
RewardScalar · 0–1
DeliveryPrivate ZIP
01 Task contract

A real, versioned RL environment.

Four non-pausing environments for agents whose world worsens while they deliberate. Every action incurs exogenous latency before application, and commitment costs extra. Across evolving circuits, online job queues, volatile repositories, and locally observed navigation, policies must allocate compute, recover from stale plans, gather bounded information, checkpoint reversible progress, and know when further reasoning is no longer worth its delay.

Agent objective

  • Interact with the supplied stateful environment.
  • Produce verifier-checkable actions or artifacts.
  • Maximise scalar reward under the package contract.

Evaluation

  • 4 verifier-backed environments.
  • Reported reward range 0–1.
  • Package-specific public and private checks.

Delivery boundary

  • Private object stored in Cloudflare R2.
  • Authenticated entitlement required.
  • Short-lived signed URL per download.
02 What you will work on

Distinct environments, one demanding research contract.

Enough detail to understand the intellectual terrain; generated instances, hidden mechanisms, and solution paths remain inside the private package.

EnvironmentMathematical or technical frontierAdaptive research problem
CircuitStreamRevision-sensitive modular computationTrack a growing hidden DAG whose inputs and targets can change; decide what to observe and whether to pin or recompute.
QueueWorldOnline scheduling under failuresDispatch rolling jobs as deadlines age, workers fail, dependencies unlock, and quotas deplete relative to a full-information oracle.
VolatileRepoRepository repair under refactorsInspect, patch, test, and rebase while source, interfaces, hidden properties, and CI state continue changing.
SpeedGridPartial-observation navigationPlan short closed-loop routes while patrols, fire, doors, and local forecasts evolve before each movement.
03 Why it is interesting

What the supplied evaluation reveals.

A GPT-5.6-Pro-assisted public development policy scored 41.83 with 39.84% success across 128 standard episodes. It solved all volatile-repository cases but remained much weaker on dynamic circuits, queues, and locally observed navigation. The result is deliberately unsaturated and not an official private score. Public suites are cacheable; official claims require fresh opaque cases, isolated execution, and evaluator-controlled compute accounting.

We publish aggregate behavior and task structure, while withholding generated instances, hidden labels, exact successful probes, private checks, and solution trajectories.

04 Supplied evaluation

Observed evaluation result.

Shown with its provenance and limitations; it is not a performance guarantee.

i
Methodology matters

Public development suite; not an official private score. Success rate was 39.84%.

Evaluated system / policyGPT-5.6 Pro-assisted agent

As identified by the supplied artifact.

Standard score41.8332

128 reported runs.

Result artifactIncluded

redqueen-run-results.zip:results/my-standard-final.json

Public result record

Machine-readable provenance and the exact displayed metric are available in results.json.

Open result JSON
05 Private delivery

The package stays off the public website.

The paid ZIP will live in a private R2 bucket. Vercel authorizes the buyer and issues a 2–5 minute object URL; R2 serves the bytes directly.

Included with purchase

  • Exact package version 0.3.0
  • Environment and task contracts
  • Verifier or scoring interface
  • Supplied reference/evaluation artifacts
  • Purchase record and licence v1.1
delivery flow
Authenticated buyer + entitlement check
+ private R2 object + 2–5 minute signed URL
= direct, auditable download

Package SHA-256
922759c71a90a4d221a469639d3c42a0bfbe4630a560d83d6be85953c7175156
06 Licence v1.1

Commercial use, without exclusivity.

One purchase licenses this identified item to one legal organisation for worldwide, perpetual commercial model training, evaluation, research and development. Redistribution and resale of the package are not permitted.

Read the full licenceYotta Content LTD · business customers only
RedQueen-1

Ready to add this environment?

Back to marketplace
Stripe checkout

Business purchase confirmation

Sign in or create an account, then complete secure Stripe Checkout. Access is granted only by the verified payment webhook.