MicroDuck Learned Happy Shuffle
Train MicroDuck to perform a stable, rhythmic side-to-side shuffle using reinforcement learning, then deliver the learned policy and evidence of its simulated behavior.
How it was made
The publisher’s ingredients and steps. Unlisted details are unknown. Copy this text kit to your agent to adapt it.
Models
- GPT-5.6 · OpenAI · execution · Codex
Agent
Codex
References
- Published brief and result ↗document
Existing result context and its stated limits.
- Recorded execution prompt ↗document
Original reusable prompt; preserved unchanged.
- metrics.json ↗document
Published evidence used to reconstruct the ordered workflow.
Tools and APIs
- microduck_rl
Register and train the Happy Shuffle reinforcement-learning task in the official MicroDuck stack.
- Hugging Face Jobs
Run the recorded CUDA smoke, training and evaluation jobs within the original approved compute cap.
- MuJoCo
Evaluate nominal and perturbed simulated rollouts; physical-hardware transfer remains untested.
Ordered steps
Register the learned task
Reconstructed workflow from the published prompt and available result artifacts; this is not a recorded sequence of agent turns. Follow the run report’s phase command, state-based rewards, termination costs and inherited observation contract. Use reinforcement learning rather than scripted joint animation.
Test before training
Run the local configuration and repository tests, then the 64-environment, five-iteration CUDA smoke gate. Obtain your own compute authorization and credentials before reproducing paid jobs.
Train and export
The recorded final run used 4,096 environments and 3,500 PPO iterations on A10G, followed by supported ONNX export. Preserve checkpoints without exposing credentials or private repositories.
Evaluate the policy
Use the supported inference path for a 16-second nominal rollout and 32-environment perturbation battery; compare the published metrics and preview. Stability is demonstrated in simulation; exact phrase identity and physical transfer are not proven.
About
Train MicroDuck to perform a stable, rhythmic side-to-side shuffle using reinforcement learning, then deliver the learned policy and evidence of its simulated behavior.
Result
A fresh Codex agent received the direct prompt in this Outcome and worked from a clean checkout of the official pollen-robotics/microduck_rl repository. It implemented a registered reinforcement-learning task, passed the repository test suite, completed a smoke run, trained a final policy with 4,096 simulated environments, exported ONNX, and evaluated the result under nominal and perturbed conditions.
The final 16-second evaluation remained upright throughout, had no early terminations or self-collisions, and travelled less than 6.3 cm. Total derived Hugging Face compute cost was $2.86.
The motion is a compact alternating step-and-sway rather than an exaggerated dance. It is verified in MuJoCo simulation only; physical-hardware transfer and exact phrase identity are not proven.
Original request
Create and train one genuinely learned MicroDuck behavior called “Happy Shuffle” using the official MicroDuck reinforcement-learning stack.
Exact prompt
Hidden characters, if present, appear as Unicode escapesCreate and train one genuinely learned MicroDuck behavior called “Happy Shuffle” using the official `pollen-robotics/microduck_rl` stack. The finished robot should perform a joyful, stable, rhythmic dance in place that reads clearly as a happy side-to-side shuffle: alternating lateral steps, coherent body motion, and an approximately eight-second phrase that can repeat cleanly. It must remain recognizably balanced and physically plausible rather than looking like random twitching or a scripted animation.
The learned policy should strongly discourage falling, large unintended travel, uncontrolled spinning, foot skating, violent joint motion, self-collision, joint-limit abuse, and other reward-hacking shortcuts. Preserve enough robustness that modest simulation perturbations do not immediately destroy the behavior. Use reinforcement learning in the official repository; do not replace learning with a hard-coded trajectory or animation.
Implement everything needed as a first-class registered task in the repository: task/environment configuration, commands or phase representation, reward terms, termination behavior, agent configuration, and focused tests. Keep changes narrow and consistent with upstream conventions. The task must appear in the official environment listing.
Verification and training:
1. First run the narrow local CPU/configuration tests and the repository’s required smoke configuration. Do not attempt meaningful training on an Apple Silicon GPU.
2. Use Hugging Face Jobs for CUDA training. Load credentials without printing or copying secrets.
3. Use an NVIDIA GPU with at least 24 GB VRAM. Gate the full run on a successful 64-environment, 5-iteration smoke job. Set explicit timeouts and stop failures promptly.
4. Set and obey an explicit compute-spend cap before launching paid work. Do not use other paid services without approval.
5. After the smoke test succeeds, run a serious training attempt within the remaining budget. Preserve checkpoints in a private Hugging Face repository under the authenticated user namespace.
6. Evaluate the resulting checkpoint through the repository’s supported inference/evaluation path. Produce the strongest visual evidence available within the repository and budget, preferably a short rendered MP4 or GIF of the behavior plus concise metrics. Never claim the behavior succeeded merely because training completed.
Deliver:
- the complete source changes;
- focused tests and their results;
- exact job IDs or URLs and actual recorded compute cost if available;
- the checkpoint or repository reference;
- evaluation metrics;
- a shareable preview video or GIF if successful;
- a concise run report that distinguishes what is proven, what failed, and what remains uncertain.
Operate autonomously within these boundaries. If the smoke job fails, diagnose and repair before any full run. If genuine learning cannot be demonstrated within the approved spend cap, stop honestly with the best evidence and do not fabricate success.What you need
- A checkout of pollen-robotics/microduck_rl
- A Hugging Face account with enough Jobs credit for CUDA training
- An NVIDIA CUDA training job; Apple Silicon can run the local tests but not the official training path
Download the result
Technical details and provenance
- Provider
- OpenAI
- Model
- GPT-5.6
- Agent
- Codex
- Published
- Publication
- community