RLTasksby ulam.ai
Sign inAll tasks
Software engineeringN4-ForthForge

N4-ForthForge

A stateful coding-agent environment for engineering and operating a Forth virtual machine. Its twelve stages progress from arithmetic, stacks, compilation, and control flow through persistent images, migration, forensic recovery, multi-session services, portability, adversarial robustness, namespace transfer, and optimizer discovery, with private procedural families and independent replay discouraging fixture-specific patches.

Coding agentPrivate verifierRL environment
Version2.0.0
Environments12
RewardScalar · 0–1
DeliveryPrivate ZIP
01 Task contract

A real, versioned RL environment.

A stateful coding-agent environment for engineering and operating a Forth virtual machine. Its twelve stages progress from arithmetic, stacks, compilation, and control flow through persistent images, migration, forensic recovery, multi-session services, portability, adversarial robustness, namespace transfer, and optimizer discovery, with private procedural families and independent replay discouraging fixture-specific patches.

Agent objective

  • Interact with the supplied stateful environment.
  • Produce verifier-checkable actions or artifacts.
  • Maximise scalar reward under the package contract.

Evaluation

  • 12 verifier-backed environments.
  • Reported reward range 0–1.
  • Package-specific public and private checks.

Delivery boundary

  • Private object stored in Cloudflare R2.
  • Authenticated entitlement required.
  • Short-lived signed URL per download.
02 What you will work on

Distinct environments, one demanding research contract.

Enough detail to understand the intellectual terrain; generated instances, hidden mechanisms, and solution paths remain inside the private package.

EnvironmentMathematical or technical frontierAdaptive research problem
Stages 0–3VM, definitions, control flow, memory/VFSImplement strict stack semantics, compilation, loops, allocation, virtual files, quotas, confinement, and structured failures.
Stages 4–6Persistent images, migration, forensicsSerialize complete state canonically, migrate older schemas idempotently, and salvage damaged images without false claims.
Stages 7–8Stateful service and architecture changePreserve session isolation, cloning, crash replay, cell-width/endianness portability, segments, and old-image compatibility.
Stages 9–10Adversarial robustness and family transferSurvive exhaustion and parser attacks, then generalize wordlists and search order across unseen namespace structures.
Stage 11Optimizer discoveryImprove constant folding and superinstructions while preserving traces, errors, semantics, image compatibility, and hidden-case gains.
03 Why it is interesting

What the supplied evaluation reveals.

A fresh micro-tier calibration compared the intentionally incomplete starter with the trusted reference across all 12 stages. The starter averaged 0.1717 and passed none; the reference averaged 0.9998 and passed all. The final optimizer stage starts from a working incumbent and still fails the threshold until it delivers a revalidated speed–quality gain, making it genuine algorithm discovery rather than stub completion. Validation matched 332 checksums and passed 36/36 tests.

We publish aggregate behavior and task structure, while withholding generated instances, hidden labels, exact successful probes, private checks, and solution trajectories.

04 Supplied evaluation

Observed evaluation result.

Shown with its provenance and limitations; it is not a performance guarantee.

i
Methodology matters

Reference evaluation across all 12 stages. The untouched starter averaged 0.1717 and passed 0/12.

Evaluated system / policyTrusted reference policy

As identified by the supplied artifact.

Mean reward0.9998

12 reported runs.

Result artifactIncluded

notes.md

Public result record

Machine-readable provenance and the exact displayed metric are available in results.json.

Open result JSON
05 Private delivery

The package stays off the public website.

The paid ZIP will live in a private R2 bucket. Vercel authorizes the buyer and issues a 2–5 minute object URL; R2 serves the bytes directly.

Included with purchase

  • Exact package version 2.0.0
  • Environment and task contracts
  • Verifier or scoring interface
  • Supplied reference/evaluation artifacts
  • Purchase record and licence v1.1
delivery flow
Authenticated buyer + entitlement check
+ private R2 object + 2–5 minute signed URL
= direct, auditable download

Package SHA-256
e3c3f8997eb880be50b25c5a2f24eac59c01ce7e1a574535b631dc9b1abed560
06 Licence v1.1

Commercial use, without exclusivity.

One purchase licenses this identified item to one legal organisation for worldwide, perpetual commercial model training, evaluation, research and development. Redistribution and resale of the package are not permitted.

Read the full licenceYotta Content LTD · business customers only
N4-ForthForge

Ready to add this environment?

Back to marketplace
Stripe checkout

Business purchase confirmation

Sign in or create an account, then complete secure Stripe Checkout. Access is granted only by the verified payment webhook.