Senior AI Software Engineer

About this role

<div class="content-intro"><div> <div> </div> <div>At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology and ingenuity for clients across defense, national security, public safety, civilian, and military health organizations. </div> <div> </div> <div>Join Accenture Federal Services, a technology company within global Accenture. Recognized as a Glassdoor Top 100 Best Place to Work, we offer a collaborative and caring community where you feel like you belong and are empowered to grow, learn and thrive through hands-on experience, certifications, industry training and more. </div> <div> </div> <div>Join us to drive positive, lasting change that moves missions and the government forward!</div> <div> </div> </div></div><p><strong>Job Description:</strong></p> <p>We are looking for a Senior AI / Software Platform Engineer to help drive the integration of AI-assisted development workflows into a large-scale enterprise Linux environment.</p> <p>This role is focused on practical AI application within software engineering, including code intelligence, developer tooling, requirements-driven development, and AI-assisted modernization of a large legacy codebase consisting primarily of C/C++ with additional modern languages and frameworks.</p> <p>The ideal candidate is a strong software engineer first, with hands-on experience integrating and operationalizing modern AI/LLM technologies within real-world development environments.</p> <p> </p> <p><strong>Environment:</strong></p> <ul> <li>Large enterprise software platform (~6M+ LOC)</li> <li>Primarily C/C++</li> <li>Red Hat Enterprise Linux environment</li> <li>GitLab-based development workflows</li> <li>GPU-enabled internal AI infrastructure</li> <li>Complex legacy and modern hybrid systems</li> </ul> <p><strong>Responsibilities:</strong></p> <ul> <li>Design, develop, and deploy scalable AI/ML and LLM-powered applications in production environments</li> <li>Build and optimize high-performance inference pipelines using technologies such as vLLM and modern GPU-serving frameworks</li> <li>Develop agentic AI workflows leveraging orchestration frameworks, tool calling, and retrieval-augmented generation (RAG)</li> <li>Integrate LLMs, vector databases, APIs, and enterprise systems into production applications</li> <li>Collaborate with software engineers, AI researchers, and platform teams to productionize AI prototypes and services</li> <li>Improve model performance, throughput, latency, scalability, and operational efficiency</li> <li>Implement monitoring, observability, evaluation, and testing frameworks for AI systems</li> <li>Develop APIs, backend services, and automation workflows supporting AI-driven products</li> <li>Evaluate emerging AI technologies, frameworks, and developer tooling including Open Code, OpenwebUI, Claude Code and modern AI coding assistants</li> <li>Contribute to AI platform architecture, deployment standards, and engineering best practices</li> </ul> <p><strong>Required Skills:</strong></p> <ul> <li>4 years of software development with experience in any of the following:</li> <ul> <li>Strong Linux experience (Red Hat / Enterprise Linux required)</li> <li>Experience with LLMs, RAG systems, embeddings, or AI-assisted tooling</li> <li>Advanced C/C++ experience</li> <li>Experience with GitLab workflows and CI/CD</li> <li>Strong Python development experience</li> <li>Experience with APIs, backend systems, and automation</li> <li>Strong understanding of software architecture and large-scale systems</li> </ul> </ul> <p><strong>Preferred Skills:</strong></p> <ul> <li>GPU infrastructure experience</li> <li>Experience deploying or operating local/open-source models</li> <li>Experience with vector databases and semantic search</li> <li>Experience with developer tooling or IDE integrations</li> <li>Experience with AI evaluation/testing frameworks</li> <li>Experience with secure/offline AI environments</li> <li>Familiarity with code indexing and static analysis systems</li> <li>Ability to work independently and drive technical initiatives</li> <li>Strong debugging and problem-solving skills</li> <li>Experience working with legacy systems and modernization efforts</li> </ul> <p><strong>Clearance:</strong></p> <ul> <li>Must have an active secret federal security clearance</li> </ul><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p> </p> <p><span class="TextRun SCXW225111203 BCX8" lang="EN-US" data-contrast="auto"><span class="NormalTextRun SCXW225111203 BCX8">As required by local law, Accenture Federal Services provides reasonable ranges of compensation for hired roles based on labor costs in the states of <strong>California, Colorado, Hawaii, Illinois, Maine, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont,…