38 lines
1.5 KiB
Markdown
38 lines
1.5 KiB
Markdown
# H3 Blackwell Runtime
|
|
|
|
Direct MiniMax H3 Ref2VA runtime research project. ComfyUI is the checkpoint and correctness oracle, not the target runtime.
|
|
|
|
## First Gate
|
|
|
|
Inspect the mounted H3 NVFP4 safetensors headers before designing an importer:
|
|
|
|
```powershell
|
|
python .\tools\inspect_safetensors.py /runpod-volume/ComfyUI/models/diffusion_models/minimax_h3_ref2va_pruned_nvfp4.safetensors
|
|
```
|
|
|
|
Write the output to `artifacts/checkpoints/` on the mounted volume. The result must identify packed weights, scales, and tensor naming before any kernel conversion work begins.
|
|
|
|
## Benchmark Contract
|
|
|
|
`benchmarks/ref2va-960x544-124f.json` is the single-GPU performance contract. Record direct-runner results as JSON and compare them with:
|
|
|
|
```powershell
|
|
python .\tools\compare_benchmark.py --result direct-result.json
|
|
```
|
|
|
|
## DGX Spark
|
|
|
|
`Dockerfile.spark` and `compose.spark.yml` prepare an ARM64 GB10 development image using the existing AEON CUDA 13/SageAttention3 base. The compose target opens a shell only; it does not start inference.
|
|
|
|
### Forgejo Pulls From Spark
|
|
|
|
The Spark checkout uses Forgejo through the host's published local SSH port and a dedicated key:
|
|
|
|
```bash
|
|
cd /home/daniel/aeon-spark-test/h3/h3-blackwell-runtime
|
|
git config core.sshCommand 'ssh -i ~/.ssh/id_ed25519_forgejo_h3 -o IdentitiesOnly=yes'
|
|
git remote set-url origin ssh://git@127.0.0.1:2222/daniel/h3-blackwell-runtime.git
|
|
git pull --ff-only origin master
|
|
```
|
|
|
|
The private key remains on Spark at `~/.ssh/id_ed25519_forgejo_h3`; only its public key is registered in Forgejo.
|