Engineering constraints: limited memory, 1M context, multimodal, immature stack

The post describes harsh engineering conditions: limited accelerator memory and interconnect bandwidth, 1M token context, multimodal requests, and immature software stack with missing kernels and undocumented features. All optimizations are trade-offs, not free gains.