Commit graph

173 commits

Author SHA1 Message Date
Daniel Maddern
d345aae6e9 Record post-FC2 production profile 2026-08-26 16:14:12 +07:00
Daniel Maddern
67e05f517c Validate aligned Vortex attention prototype 2026-08-26 15:51:39 +07:00
Daniel Maddern
c58e4c6d12 Validate Vortex attention capabilities 2026-08-26 14:44:28 +07:00
Daniel Maddern
ff8f7672b3 Complete Vortex attention interface design 2026-08-26 13:40:59 +07:00
Daniel Maddern
7d0608e857 Register Vortex exact attention research 2026-08-26 13:40:16 +07:00
Daniel Maddern
b842badfc1 Select Vortex exact attention architecture 2026-08-26 13:39:20 +07:00
Daniel Maddern
c5028427d7 Define Vortex exact attention contract 2026-08-26 13:20:33 +07:00
Daniel Maddern
a29b8960b0 Integrate guarded FC2 cuBLASLt schedule 2026-08-26 00:48:44 +07:00
Daniel Maddern
0298ccd1cb Record exact FC2 cuBLASLt schedule 2026-08-25 22:32:48 +07:00
Daniel Maddern
ea14b98544 Preserve Vortex performance research history 2026-08-25 20:30:22 +07:00
Daniel Maddern
bee998d840 Record RTX Pro 6000 multi-GPU scaling 2026-08-22 16:42:09 +07:00
Daniel Maddern
6d8a1c3c2b Record RTX Pro 6000 SDPA baseline 2026-08-22 15:38:09 +07:00
Daniel Maddern
49a9d0d1a1 Fix RunPod API client requests 2026-08-22 14:13:15 +07:00
Daniel Maddern
bd92baeb46 Add distributed H3 execution and validation 2026-08-22 14:09:45 +07:00
Daniel Maddern
1d5faa8f16 Expand H3 runtime acceleration and validation 2026-08-20 22:08:52 +07:00
Daniel Maddern
837c16871d Add resident FL2VA Turbo variants 2026-08-20 19:13:23 +07:00
Daniel Maddern
6d8c9ca4cf Add selectable hot attention backends 2026-08-20 17:39:44 +07:00
Daniel Maddern
9bb96a26e8 Fix FL2VA conditioning parity end to end 2026-08-20 16:43:22 +07:00
Daniel Maddern
9f62f6ea83 Remove debug prints from vision tower (fl2va passes e2e smoke) 2026-08-19 23:03:58 +07:00
Daniel Maddern
45d3e7bc64 Fix mrope_freqs_cis call (no device kwarg) 2026-08-19 22:59:26 +07:00
Daniel Maddern
9fbd6fe77e Batch-dim on input_ids for _embed_rows ([1, seq]) 2026-08-19 22:57:03 +07:00
Daniel Maddern
0903b849b2 Flatten _text_run_ids output (input_ids is [1,seq]) 2026-08-19 22:54:32 +07:00
Daniel Maddern
428c83d1d8 Coerce token ids to int in build_fl2va_presentation 2026-08-19 22:51:48 +07:00
Daniel Maddern
4add435bf9 Fix vision merger: main=per-patch-norm+2x2-interleave, deepstack=merged-norm 2026-08-19 22:48:26 +07:00
Daniel Maddern
68c49fdc95 Use merge_dim as normalized_shape in _VisionPatchMerger (4*1152 for 2x2 merge) 2026-08-19 22:39:05 +07:00
Daniel Maddern
b085ef02e8 Merge tokens expands C by merge^2 (merger takes pre-expanded) 2026-08-19 22:36:32 +07:00
Daniel Maddern
571d3541e8 Use explicit C (not x.shape[-1]) in _merge_tokens 2026-08-19 22:34:16 +07:00
Daniel Maddern
99a7550a51 Debug _merge_tokens prod 2026-08-19 22:31:52 +07:00
Daniel Maddern
ece7b2497e Use explicit C instead of -1 in _merge_tokens view 2026-08-19 22:29:26 +07:00
Daniel Maddern
834bd96111 Trace x shape at deepstack layers 2026-08-19 22:27:16 +07:00
Daniel Maddern
b9dcdda116 Debug _merge_tokens shapes 2026-08-19 22:21:30 +07:00
Daniel Maddern
ffb3c9e729 Debug print in vision tower forward 2026-08-19 22:18:33 +07:00
Daniel Maddern
e4d9a6f8ff Fix position_embeddings unpack (3-tuple of cos/sin/-sin) 2026-08-19 22:12:48 +07:00
Daniel Maddern
a19f051800 Cast qkv to common dtype before SDPA (q/k/v match) 2026-08-19 22:10:39 +07:00
Daniel Maddern
efc5fd9bc1 Fix col_idx expand/reshape precedence in rot_pos_emb 2026-08-19 22:08:21 +07:00
Daniel Maddern
67e4b12246 Make process_image return 2D grid_thw [[t,h,w]] for multi-image support 2026-08-19 22:04:12 +07:00
Daniel Maddern
6866263631 Fix F.conv3d call: remove invalid kernel_size kwarg (uses weight.shape) 2026-08-19 22:01:12 +07:00
Daniel Maddern
453aa86328 Use PIL Lanczos resize in resize_keyframe (F.interpolate no-4D-lanczos) 2026-08-19 21:56:32 +07:00
Daniel Maddern
0b7217485c nin_shortcut is a plain 1x1x1 conv (no causal padding) 2026-08-19 21:49:40 +07:00
Daniel Maddern
ea6ab87a34 Decouple spatial_padding from temporal_causal in causal conv 2026-08-19 21:47:00 +07:00
Daniel Maddern
b557cba173 Fix Downsample3D spatial reflect pad to (W,H) dims only 2026-08-19 21:41:16 +07:00
Daniel Maddern
136297f4ae Fix F.pad dim order (spatial reflect + no T pad) for 1-frame path 2026-08-19 21:36:40 +07:00
Daniel Maddern
c2d507691b Restore front-zero temporal pad for multi-frame causal conv; two-step F.pad (reflect spatial + constant T) 2026-08-19 21:35:07 +07:00
Daniel Maddern
f7c48b067a Remove permute bug: rely on F.conv3d spatial padding 2026-08-19 21:33:08 +07:00
Daniel Maddern
6fc7cf0ad6 Fix causal conv: correct F.pad spatial dim order + 1-frame kernel truncation 2026-08-19 21:31:05 +07:00
Daniel Maddern
3386975326 Fix VAE: use same multi-frame causal path for keyframes, add frame_pre_padding so 1 keyframe -> 1 latent 2026-08-19 21:20:32 +07:00
Daniel Maddern
a0274a9868 Fix tiled_encode latent x-overlap off-by-one (use [j-1] for left neighbor) 2026-08-19 21:13:40 +07:00
Daniel Maddern
65e80be1cf Thread single_frame flag so keyframe truncation does not apply to 1-frame tiles 2026-08-19 21:11:43 +07:00
Daniel Maddern
06fd79a8fd Fix causal temporal padding to match reference (2k-1 front zeros when spatial_padding>0) 2026-08-19 21:09:03 +07:00
Daniel Maddern
390135fca6 Fix VAE pixel normalization in-place bug 2026-08-19 21:07:34 +07:00