Senior Site Reliability Engineer

4w1 month ago

HavocAI

US · Full-time · $150,000 – $185,000

About this role

HavocAI is an unquestioned leader in collaborative autonomy, setting the standard for autonomous surface vessels in defense and maritime missions. We are seeking a Senior Site Reliability Engineer to ensure the availability, performance, and resilience of mission-critical services supporting autonomy, simulation, and data-intensive workloads.

In this role, you will design and evolve reliability architecture for distributed and cloud-hosted systems, define SRE best practices including SLIs and SLOs, and lead incident response processes. You will conduct root cause analysis for complex production incidents and drive long-term corrective actions to improve operational maturity.

You will work closely with Cloud Platform, DevOps, Data Engineering, and Autonomy teams to establish reliability standards and build systems that scale safely under real-world conditions. The ideal candidate is deeply technical, calm under pressure, and experienced in owning reliability outcomes end to end.

This role offers the opportunity to shape reliability patterns for cutting-edge autonomy and simulation workloads, reducing operational toil through automation and resilience testing. You will help build a culture of ownership, accountability, and continuous improvement across production systems.

Requirements

7+ years of experience designing, operating, and scaling highly reliable distributed systems
Deep technical expertise in reliability engineering, including SLIs, SLOs, and error budgets
Experience leading incident response and conducting root cause analysis for complex production incidents
Proficiency in designing and maintaining observability systems for metrics, logging, tracing, and alerting
Strong background in automation, infrastructure-as-code, and Kubernetes-based environments
Experience partnering with platform, DevOps, and application teams to improve operational maturity
Calm under pressure with a track record of owning reliability outcomes end to end

Responsibilities

Design and evolve reliability architecture for distributed and cloud-hosted systems
Define and implement SRE best practices, including SLIs, SLOs, error budgets, and capacity planning
Lead incident response processes, including on-call rotations, escalation paths, and post-incident reviews
Conduct root cause analysis for complex production incidents and drive long-term corrective actions
Design, implement, and maintain observability systems for metrics, logging, tracing, alerting, and service health
Build automation to improve system reliability, deployment safety, and recovery processes
Partner with DevOps and Cloud Platform teams on CI/CD reliability, rollout strategies, and safe deployment patterns
Collaborate with security teams to ensure secure and resilient system design and participate in disaster recovery planning

Benefits

Opportunity to work on mission-critical systems supporting collaborative autonomy and defense missions
Collaborative environment with Cloud Platform, DevOps, Data Engineering, and Autonomy teams
Chance to shape reliability standards and reduce operational toil through automation
Role with high impact on preventing conflict and saving lives through technology