“Modal has done the most to reduce cold-start times out of all the serverless inference solutions I’ve tried. They’ve put a ton of their engineering effort into system optimizations such as lazily loading container filesystems, and they give developers fine-grained control to trade off latency vs. cost.”

“Using SageMaker just felt like a very convoluted process. It felt very removed from a normal engineering workflow. With Modal, it’s a lot faster. You don’t feel like you have to wait for notebooks to spin up or remember to turn them off or any of that type of stuff.”