Artus' thoughts

The Frankenstein, Part 3: One Part In, One Base Rejected

Part 3 of assembling a DeepSeek-V4.1-Flash server on two RTX PRO 6000s. A host-expert plan built from our own agent traffic cut time per verify step by 2.42% in 5 of 5 randomized blocks and is served. A newer vLLM base took 10.0% longer per agent-task draw in 4 of 4 blocks and was not adopted. Our first randomized agent-task quality check of a served part was inconclusive at its planned size, and a time split of today's stack points our first own part at decode.

The Frankenstein, Part 2: A Part from Another Fork

Part 2 of assembling a DeepSeek-V4.1-Flash server from the best parts of other engines on two RTX PRO 6000s. An SM120 mHC overlap from kacper-daftcode's vLLM-Moet cut time per verify step by 4.88% in 5 of 5 randomized blocks and is now served for single-stream use. The CPU-expert schedule passed its ten-block agent-task comparison with no pass-rate harm shown, the prompt region cache is served, and four things did not work.