ProductcommunityGPT-5.6

MicroDuck Learned Happy Shuffle

Train MicroDuck to perform a stable, rhythmic side-to-side shuffle using reinforcement learning, then deliver the learned policy and evidence of its simulated behavior.

Remix
Reconstructed

How it was made

The publisher’s ingredients and steps. Unlisted details are unknown. Copy this text kit to your agent to adapt it.

Models

  • GPT-5.6 · OpenAI · execution · Codex

Agent

Codex

References

Tools and APIs

  • microduck_rl

    Register and train the Happy Shuffle reinforcement-learning task in the official MicroDuck stack.

  • Hugging Face Jobs

    Run the recorded CUDA smoke, training and evaluation jobs within the original approved compute cap.

  • MuJoCo

    Evaluate nominal and perturbed simulated rollouts; physical-hardware transfer remains untested.

Ordered steps

  1. Register the learned task

    Reconstructed workflow from the published prompt and available result artifacts; this is not a recorded sequence of agent turns. Follow the run report’s phase command, state-based rewards, termination costs and inherited observation contract. Use reinforcement learning rather than scripted joint animation.

  2. Test before training

    Run the local configuration and repository tests, then the 64-environment, five-iteration CUDA smoke gate. Obtain your own compute authorization and credentials before reproducing paid jobs.

  3. Train and export

    The recorded final run used 4,096 environments and 3,500 PPO iterations on A10G, followed by supported ONNX export. Preserve checkpoints without exposing credentials or private repositories.

  4. Evaluate the policy

    Use the supported inference path for a 16-second nominal rollout and 32-environment perturbation battery; compare the published metrics and preview. Stability is demonstrated in simulation; exact phrase identity and physical transfer are not proven.

About

Train MicroDuck to perform a stable, rhythmic side-to-side shuffle using reinforcement learning, then deliver the learned policy and evidence of its simulated behavior.

Result

A fresh Codex agent received the direct prompt in this Outcome and worked from a clean checkout of the official pollen-robotics/microduck_rl repository. It implemented a registered reinforcement-learning task, passed the repository test suite, completed a smoke run, trained a final policy with 4,096 simulated environments, exported ONNX, and evaluated the result under nominal and perturbed conditions.

The final 16-second evaluation remained upright throughout, had no early terminations or self-collisions, and travelled less than 6.3 cm. Total derived Hugging Face compute cost was $2.86.

The motion is a compact alternating step-and-sway rather than an exaggerated dance. It is verified in MuJoCo simulation only; physical-hardware transfer and exact phrase identity are not proven.

Original request

Create and train one genuinely learned MicroDuck behavior called “Happy Shuffle” using the official MicroDuck reinforcement-learning stack.

Exact prompt

Hidden characters, if present, appear as Unicode escapes
Create and train one genuinely learned MicroDuck behavior called “Happy Shuffle” using the official `pollen-robotics/microduck_rl` stack. The finished robot should perform a joyful, stable, rhythmic dance in place that reads clearly as a happy side-to-side shuffle: alternating lateral steps, coherent body motion, and an approximately eight-second phrase that can repeat cleanly. It must remain recognizably balanced and physically plausible rather than looking like random twitching or a scripted animation.

The learned policy should strongly discourage falling, large unintended travel, uncontrolled spinning, foot skating, violent joint motion, self-collision, joint-limit abuse, and other reward-hacking shortcuts. Preserve enough robustness that modest simulation perturbations do not immediately destroy the behavior. Use reinforcement learning in the official repository; do not replace learning with a hard-coded trajectory or animation.

Implement everything needed as a first-class registered task in the repository: task/environment configuration, commands or phase representation, reward terms, termination behavior, agent configuration, and focused tests. Keep changes narrow and consistent with upstream conventions. The task must appear in the official environment listing.

Verification and training:

1. First run the narrow local CPU/configuration tests and the repository’s required smoke configuration. Do not attempt meaningful training on an Apple Silicon GPU.
2. Use Hugging Face Jobs for CUDA training. Load credentials without printing or copying secrets.
3. Use an NVIDIA GPU with at least 24 GB VRAM. Gate the full run on a successful 64-environment, 5-iteration smoke job. Set explicit timeouts and stop failures promptly.
4. Set and obey an explicit compute-spend cap before launching paid work. Do not use other paid services without approval.
5. After the smoke test succeeds, run a serious training attempt within the remaining budget. Preserve checkpoints in a private Hugging Face repository under the authenticated user namespace.
6. Evaluate the resulting checkpoint through the repository’s supported inference/evaluation path. Produce the strongest visual evidence available within the repository and budget, preferably a short rendered MP4 or GIF of the behavior plus concise metrics. Never claim the behavior succeeded merely because training completed.

Deliver:

- the complete source changes;
- focused tests and their results;
- exact job IDs or URLs and actual recorded compute cost if available;
- the checkpoint or repository reference;
- evaluation metrics;
- a shareable preview video or GIF if successful;
- a concise run report that distinguishes what is proven, what failed, and what remains uncertain.

Operate autonomously within these boundaries. If the smoke job fails, diagnose and repair before any full run. If genuine learning cannot be demonstrated within the approved spend cap, stop honestly with the best evidence and do not fabricate success.

What you need

  • A checkout of pollen-robotics/microduck_rl
  • A Hugging Face account with enough Jobs credit for CUDA training
  • An NVIDIA CUDA training job; Apple Silicon can run the local tests but not the official training path
FILES

Download the result

Technical details and provenance
Provider
OpenAI
Model
GPT-5.6
Agent
Codex
Published
Publication
community