Engineering Manager, Inference Cloud Platform

Описание вакансии

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.  

Cerebras' current customers include top model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

Thanks to the groundbreaking wafer-scale architecture, Cerebras Inference offers the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Location: Sunnyvale

About the Role

We're looking for a deeply technical, hands-on engineering leader to scale our Inference Cloud Platform. This team owns the cloud layer that powers our Inference Service, with direct responsibility for availability, reliability, latency, and global scalability. 

You'll lead a high-performing team building the systems that keep inference fast and reliable at massive scale: multi-region traffic management, intelligent routing, graceful degradation under load, and best-in-class observability. The work sits at the intersection of distributed systems, cloud-native infrastructure, and the unique demands of serving AI workloads in production, including bursty, unpredictable traffic patterns unique to model serving. 

If you're passionate about building resilient, globally distributed systems and solving hard infrastructure problems for AI, we'd love to talk. 

Responsibilities 

Technical Strategy & Architecture 

• Platform Vision & Roadmap. Own the technical direction for the Inference Cloud Platform, prioritizing cloud-native scalability, reliability, and multi-region architecture.

• Core Infrastructure. Lead the design of foundational cloud-layer systems including service discovery, service mesh, request routing, load balancing, caching, and batching to optimize latency, throughput, and cost efficiency.

• Resilience & High Availability. Build and operate fault-tolerant, active-active multi-region systems with strong SLAs/SLOs, rapid failover, and graceful degradation strategies such as circuit breaking, backpressure, and load shedding.

• Traffic Control & Quality of Service. Design traffic prioritization, rate limiting, quota management, and admission control systems, including differentiated service tiers with independent SLOs, to ensure fairness and protect stability under extreme load.

Operational Excellence 

• Observability. Establish monitoring, logging, and alerting systems; define and own key metrics for latency, availability, and system health.

• Reliability Practices. Drive operational maturity through incident response leadership, blameless postmortems, chaos engineering, and continuous improvement of platform reliability.

People & Partnerships 

• Team Building. Recruit, mentor, and scale a high-caliber engineering team; foster a culture of ownership, technical excellence, and rapid execution.

• Cross-Functional Collaboration. Partner with ML, Product, Infrastructure, and Platform teams to align the roadmap with customer needs and deliver scalable cloud services.

Skills & Qualifications 

• 8+ years in high-scale software engineering, with 4+ years leading distributed systems or cloud infrastructure teams. Strong hands-on coding and system design skills.

• Deep expertise in building and operating large-scale distributed systems in cloud environments (AWS; GCP or Azure experience), including compute orchestration, networking, and container platforms (Kubernetes/EKS).

• Proven track record delivering highly available, multi-region production services with well-defined SLIs/SLOs/SLAs and measurable reliability outcomes.

• Experience driving latency optimization (including TTFT and tail latency), throughput improvements, and system efficiency gains in high-QPS environments.

• Strong proficiency in systems-level or backend languages such as Go, C++ or Python.

• Hands-on experience building observability stacks including metrics, logging, distributed tracing, and alerting (e.g., Prometheus, Grafana, or equivalents).

• Demonstrated ability to recruit, develop, and lead high-performing engineering teams and to collaborate effectively across engineering, product, and operations.

• Experience with ML inference infrastructure, model serving frameworks, or GPU-accelerated workloads is a plus.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection  point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

1. Build a breakthrough AI platform beyond the constraints of the GPU.
2. Publish and open source their cutting-edge AI research.
3. Work on one of the fastest AI supercomputers in the world.
4. Enjoy job stability with startup vitality.
5. Our simple, non-corporate work culture that respects individual beliefs.

Read our blog: Five Reasons to Join Cerebras in 2026.

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer.We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.