anima_closeout v20: the bed now RUNS — frozen 0.110923, frozen_repeat identical (determinism holds), relay_s0_toggled_off bit-identical to frozen (TOGGLE LAW passes). Only the ENABLED relay crashed: attach_aleph_relays casts dtype but does not place on device (the trainer attaches on CPU then DeepSpeed moves the engine), and the bed had already moved the trunk to cuda, so fresh relay params sat on CPU -> 'mat2 is on cpu' at the first relay matmul. Fix: tf.to(DEV) after each attach (idempotent for placed params); verified a fresh attribute-assigned submodule auto-registers and .to() follows it.

colab/anima_closeout.ipynb

@@ -1199,6 +1199,12 @@
     "    mode = arm.get(\"kind\", \"relay\")\n",
     "    attach_aleph_relays(tf, tf.model_channels, relay_path=arm[\"ckpt\"],\n",
     "                        dtype=torch.bfloat16, mode=mode)\n",
+    "    # attach_aleph_relays casts dtype but does NOT place on device (the\n",
+    "    # trainer attaches on CPU, then DeepSpeed moves the whole engine). The\n",
+    "    # trunk is already on cuda, so the freshly-attached relay params are on\n",
+    "    # CPU -> 'mat2 is on cpu' at the first relay matmul. Re-place the trunk;\n",
+    "    # .to() is idempotent for params already on DEV.\n",
+    "    tf.to(DEV)\n",
     "    gates = []\n",
     "    for b in tf.blocks:\n",
     "        g = getattr(b.aleph_relay, \"gate\", None)\n",