Baseten

High-performance LLM inference infrastructure

Growth
San Francisco, CA
Founded 2019

About

Founded in 2019 by Tuhin Srivastava and co-founders, Baseten is headquartered in San Francisco and has raised $585M through a Series E. The platform provides production-grade ML inference infrastructure optimized for latency, throughput, and cost efficiency, enabling enterprises to deploy and scale proprietary and open-source models—including Llama, DeepSeek, and Gemma—without managing GPU clusters themselves. Baseten partners with Google Cloud and NVIDIA and focuses on mission-critical inference workloads where performance SLAs are non-negotiable. It targets AI-native companies and large enterprises moving LLM applications from prototype to production at scale.

Products

  • Baseten Inference Stack — Deploy custom and open-source AI models at scale with high performance, uptime, and optimized infrastructure for AI inference workloads.
    Customer sectors: ai startups, enterprise ai teams, ml engineers
  • Pre-optimized Model APIs — Instantly test and prototype AI models optimized for fast production performance to evaluate latest workloads with minimal setup.
    Customer sectors: product teams, ml researchers, ai developers
  • Baseten Train — Train and deploy custom AI models easily with one-click deployment on infrastructure optimized for fast inference performance.
    Customer sectors: ml engineers, data scientists, ai startups
  • Baseten Cloud — Managed global cloud service offering fast time-to-market, massive scale, and single-tenant clusters for workload isolation.
    Customer sectors: enterprise ai teams, cloud-native startups, software companies
  • Self-hosted Deployment — Run Baseten’s managed inference services securely within your own VPC for low latency, high throughput, and flexible scaling.
    Customer sectors: regulated industries, enterprise it, security-conscious teams

Market research & competitive positioning

Source-backed TAM / SAM / SOM sizing, displacement analysis, and an interactive peer positioning map for Baseten — available to members.

Related Companies

Other startups in Data Management Platforms