Staff + Senior Software Engineer, Inference Deployment

About this role

<div class="content-intro"><h2><strong>About Anthropic</strong></h2> <p>Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.</p></div><p class="font-claude-response-body break-words whitespace-normal"><strong>About the role</strong></p> <p class="font-claude-response-body break-words whitespace-normal">Anthropic serves Claude to millions of users across GPUs, TPUs, and Trainium — and every model update must reach production safely, quickly, and without disrupting service. The Launch Engineering team's mandate is to make inference deployment boring and unattended.</p> <p class="font-claude-response-body break-words whitespace-normal">As a Software Engineer on Launch Engineering, you'll design and build the deployment infrastructure that moves inference code from merge to production. This is a resource-constrained optimization problem at its core: validation and deployment consume the same accelerator chips that serve customer traffic, so your deploys compete with live user requests for the same hardware. Every model brings different fleet sizes, startup times, and correctness requirements, and the system must adapt continuously. You'll build systems that navigate these constraints — orchestrating validation, scheduling deployments intelligently, and driving down cycle time from merge to production.</p> <p class="font-claude-response-body break-words whitespace-normal"><strong>Key responsibilities</strong></p> <ul class="[li_&]:mb-0 [li_&]:mt-1 [li_&]:gap-1 [&:not(:last-child)_ul]:pb-1 [&:not(:last-child)_ol]:pb-1 list-disc flex flex-col gap-1 pl-8 mb-3"> <li class="font-claude-response-body whitespace-normal break-words pl-2">Own deployment orchestration that continuously moves validated inference builds into production across GPU, TPU, and Trainium fleets, unattended under normal conditions</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Improve capacity-aware deployment scheduling to maximize deployment throughput against constrained accelerator budgets and variable fleet sizes</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Extend deployment observability — dashboards and tooling that answer "what code is running in production," "where is my commit," and "what validation passed for this deploy"</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Drive down cycle time from code merge to production with pipeline architectures that minimize serial dependencies and maximize parallelism</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Optimize fleet rollout strategies for large-scale deployments across thousands of accelerator chips, minimizing disruption to serving capacity</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Evolve self-service model onboarding so new models can be added to the continuous deployment pipeline without Launch Engineering involvement</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Partner across the Inference organization with teams owning validation, autoscaling, and model routing to integrate deployment automation with their systems</li> </ul> <p class="font-claude-response-body break-words whitespace-normal"><strong>Minimum qualifications</strong></p> <ul class="[li_&]:mb-0 [li_&]:mt-1 [li_&]:gap-1 [&:not(:last-child)_ul]:pb-1 [&:not(:last-child)_ol]:pb-1 list-disc flex flex-col gap-1 pl-8 mb-3"> <li class="font-claude-response-body whitespace-normal break-words pl-2">Strong software engineering skills, including experience designing systems that manage complex state machines and multi-stage pipelines</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Proficiency with Kubernetes-based deployments, rolling update mechanics, and container orchestration</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Experience building deployment, release, or delivery infrastructure where resource constraints (fleet capacity, network bandwidth, hardware availability, coordinated rollout windows) shape the design</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">A track record of building automation that measurably improves deployment velocity and reliability</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Comfort working across the stack — from backend services and databases to CLI tools and web UIs</li> <li class="font-claude-response-body whitespace-normal break-words pl-2">Strong communication skills and the ability to work closely with oncall engineers, model teams, and infrastructure partners</li> </ul> <p class="font-claude-response-body break-words whitespace-normal"><strong>Preferred qualifications</strong></p> <ul class="[li_&]:mb-0 [li_&]:mt-1 [li_&]:gap-1 [&:not(:last-child)_ul]:pb-1 [&:not(:last-child)_ol]:pb-1 list-disc flex flex-col gap-1 pl-8 mb-3"> <li…