ScaleOps raises $130M to enhance computing efficiency amid AI demand

While AI is booming, companies are wasting significant amounts on inefficient use of computing resources. GPUs are idle, workloads are over-provisioned, and cloud costs continue to rise. ScaleOps believes the issue is not a shortage of resources but mismanagement. The startup, which develops software to automatically manage and reallocate computing resources in real time, has raised $130 million at an $800 million valuation.

The Series C funding round was led by Insight Partners, with participation from existing investors including Lightspeed Venture Partners, NFX, Glilot Capital Partners, and Picture Capital. ScaleOps claims its software can reduce cloud and AI infrastructure costs by up to 80%.

Founded in 2022 by Yodar Shafrir, a former engineer at Run:ai, a GPU orchestration startup acquired by Nvidia, ScaleOps was born out of the realization of how challenging it is for companies to manage increasingly complex AI workloads. While tools like Kubernetes help run applications across large clusters, they often rely on static configurations that struggle to keep pace with rapidly changing demands, leading to underutilized GPUs and performance issues.

Shafrir, who serves as the CEO, noted that many DevOps teams face challenges in managing production workloads, especially as inference workloads have become more common in the AI era. He concluded that the problem extends beyond GPUs to computing, memory, storage, and networking. Teams often find themselves chasing down multiple stakeholders to resolve issues, and those efforts frequently fall short.

ScaleOps provides a solution that connects application needs with infrastructure decisions in real time, offering fully autonomous infrastructure management. Shafrir emphasized that while Kubernetes is flexible, it requires constant manual configuration, which is inefficient for dynamic applications.

Competitors include Cast AI, Kubecost, and Spot. Although many companies have introduced automation tools, they often operate without full context, leading to performance issues. ScaleOps' platform was built from the ground up specifically for production environments and does not require manual configuration.

Since its inception, the company has raised around $210 million and recorded over 450% year-over-year growth, tripling its headcount over the past 12 months. With the new funding, ScaleOps plans to roll out new products and expand its platform to meet the growing demand for computing resources in the AI era.