Startup Gimlet Labs is solving the AI inference bottleneck in a surprisingly elegant way

Gimlet Labs, founded by Stanford adjunct professor Zain Asgar, raised an $80M Series A led by Menlo Ventures for its "multi-silicon inference cloud" — software that orchestrates AI workloads across diverse hardware types including CPUs, GPUs, and high-memory systems. The company claims to speed up AI inference 3x to 10x by efficiently utilizing idle resources, addressing the problem that existing hardware is only used 15–30% of the time, and has partnered with NVIDIA, AMD, Intel, ARM, Cerebras, and d-Matrix.