Commit graph

118 commits

Author SHA1 Message Date
Daniel Maddern
8d90cec133 Fix pack profiler imports 2026-08-15 02:57:21 +07:00
Daniel Maddern
ddc0c5a2b7 Add NVFP4 pack geometry profiler 2026-08-15 02:56:19 +07:00
Daniel Maddern
d4c243c9ef Match NVFP4 tie-to-even rounding 2026-08-15 02:48:06 +07:00
Daniel Maddern
11d3c4164e Match NVFP4 midpoint rounding 2026-08-15 02:45:16 +07:00
Daniel Maddern
9c0992350f Match NVFP4 signed zero encoding 2026-08-15 02:43:03 +07:00
Daniel Maddern
ef84a2786c Match H3 NVFP4 row scale swizzle 2026-08-15 02:40:09 +07:00
Daniel Maddern
fbfb3453de Zero initialize native NVFP4 block scales 2026-08-15 02:38:08 +07:00
Daniel Maddern
7f9b1560e4 Add H3 NVFP4 scale column swizzles 2026-08-15 02:34:52 +07:00
Daniel Maddern
1200152d79 Match wide NVFP4 block scale swizzle 2026-08-15 02:30:41 +07:00
Daniel Maddern
b3a2544936 Match NVFP4 block scale swizzle 2026-08-15 02:26:48 +07:00
Daniel Maddern
57b84b8d6b Match NVFP4 block scale padding 2026-08-15 02:24:09 +07:00
Daniel Maddern
0e855b8e55 Prototype Vortex native NVFP4 quantizer 2026-08-15 02:22:37 +07:00
Daniel Maddern
1fec77d2e9 Tune Vortex NVFP4 scale geometry 2026-08-15 02:15:19 +07:00
Daniel Maddern
1cc0ffdd00 Add Vortex NVFP4 scale v1 2026-08-15 02:11:47 +07:00
Daniel Maddern
684b645546 Match Torch NVFP4 scale precision 2026-08-15 01:57:25 +07:00
Daniel Maddern
0fda84502a Add Vortex NVFP4 scale kernel 2026-08-15 01:54:02 +07:00
Daniel Maddern
03dbe1456d Prototype Vortex NVFP4 quantizer seam 2026-08-15 01:47:03 +07:00
Daniel Maddern
d6eabb150e Add NVFP4 linear profiler 2026-08-15 01:37:42 +07:00
Daniel Maddern
7cc03f3e57 Add H3 block profiler plan 2026-08-15 01:32:18 +07:00
Daniel Maddern
3d0c093168 Add Sol-Attn backend 2026-08-14 21:04:32 +07:00
Daniel Maddern
75ee9ba4ca Document backend implementation status 2026-08-14 20:39:20 +07:00
Daniel Maddern
c3cc04e98d Add approximate H3 cache modes 2026-08-14 20:38:48 +07:00
Daniel Maddern
fb257ef982 Add exact memory backend options 2026-08-14 20:34:41 +07:00
Daniel Maddern
eaf9324145 Add KJ Sage attention backends 2026-08-14 20:28:56 +07:00
Daniel Maddern
1c0883a54b Add persistent hot runtime service 2026-08-14 20:13:48 +07:00
Daniel Maddern
54dd649ccf Plan persistent hot runtime 2026-08-14 20:02:47 +07:00
Daniel Maddern
d1cdd4b6b3 Record Sage3 cat benchmark 2026-08-14 20:02:14 +07:00
Daniel Maddern
a388aa64ff Default video VAE decode to FP16 2026-08-14 19:50:36 +07:00
Daniel Maddern
ea7712b4b2 Use paired kitchen RoPE in VAE fast path 2026-08-14 14:58:11 +07:00
Daniel Maddern
8595dd875e Add optional kitchen VAE fast ops 2026-08-14 14:54:38 +07:00
Daniel Maddern
f6166ede68 Add VAE decode benchmark tool 2026-08-14 14:36:42 +07:00
Daniel Maddern
ea4f4a2dad Add Comfy cat benchmark submitter 2026-08-14 14:20:45 +07:00
Daniel Maddern
53cd8bd4f4 Make runtime diagnostics opt in 2026-08-14 14:11:36 +07:00
Daniel Maddern
fea69673cd Return native H3 audio latents 2026-08-14 13:57:30 +07:00
Daniel Maddern
59b8302d4e Add direct H3 audio VAE decode 2026-08-14 13:39:46 +07:00
Daniel Maddern
c5cf42850b Document H3 audio VAE path 2026-08-14 13:33:08 +07:00
Daniel Maddern
4696a3e72c Add safetensors shape inspector 2026-08-14 13:32:01 +07:00
Daniel Maddern
b73d08b231 Compute upstream VAE temporal overlap constants 2026-08-14 13:04:58 +07:00
Daniel Maddern
81714ed50f Trace VAE temporal blend metadata 2026-08-14 12:56:36 +07:00
Daniel Maddern
26fe7be966 Document VAE debug handoff 2026-08-14 01:58:27 +07:00
Daniel Maddern
feeb4b75c9 Trace VAE blend inputs 2026-08-14 01:50:14 +07:00
Daniel Maddern
28a4121df9 Match upstream VAE blend implementation 2026-08-14 01:41:53 +07:00
Daniel Maddern
4e17e866a0 Add VAE temporal assembly tracer 2026-08-14 01:33:33 +07:00
Daniel Maddern
49bae4ab74 Match upstream VAE temporal padding 2026-08-14 01:25:53 +07:00
Daniel Maddern
6dd0b0e737 Add VAE tiled clip comparator 2026-08-14 01:20:27 +07:00
Daniel Maddern
9658faa4be Add full VAE decode comparator 2026-08-14 01:12:12 +07:00
Daniel Maddern
f85627a9fd Use SageAttention fallback for direct VAE 2026-08-14 01:00:16 +07:00
Daniel Maddern
9c9e0857c2 Load direct VAE weights as float32 2026-08-14 00:52:57 +07:00
Daniel Maddern
e4f145e9d5 Mirror upstream VAE block math 2026-08-14 00:50:03 +07:00
Daniel Maddern
e043e9af82 Use Comfy attention for VAE when available 2026-08-14 00:41:20 +07:00