Senior Software Engineer, ML Evaluation

About this role

<p><strong>Mission:</strong></p> <p>We are seeking a highly skilled and motivated Senior Data Analysis Engineer for our large-scale AI model and software evaluation framework – Ground Truth Regression. The ideal candidate will have a strong background in data engineering, machine learning principals and statistical analysis. </p> <p>At Motional, large scale orchestration for data analysis plays a critical role in delivering our ML-centered autonomous driving vehicle. Our robo-taxi ML Models and software are developed by hundreds of developers and deployed multiple times a day – The Ground Truth Regression team provides the large scale perception analysis framework for validating all changes to perception which can impact the autonomous vehicle behavior. </p> <p>The GTRegression team validates the end impact of ML and software changes to the autonomous vehicle while those changes are in development, providing the tools for Root Cause Analysis, and safety consideration. We monitor for model errors, anomalies, rare objects & long-tail driving scenarios across thousands of driving hours. The team develops the full stack – AWS Kubernetes orchestration framework, ReSimulation, model metrics, regression reports, and deep dive analysis UI’s. The team works together with all other perception and ML teams to develop the metrics and analyze results.<br><br></p> <p><strong>What You'll Do:</strong></p> <ul> <li>Work with ML Engineers and Autonomy Software Developers to develop new data analysis metrics and KPI’s for the validation of the autonomous vehicle performance.</li> <li>Drive innovation by researching and developing new large scale data analysis systems.</li> <li>Own large-scale data analysis workflows that surface unexpected impacts of planned and unplanned changes to the ML models and software.</li> <li>Work with annotation specialists to build high-quality evaluation datasets.</li> <li>Provide statistical depth on model performance & generalization through rigorous error and change analysis.</li> <li>Read, understand, and modify complex codebases written in Python and SQL.</li> </ul> <p><strong>What We're Looking For:</strong></p> <ul> <li>Bachelor's or Master's degree in Computer Science, Data Science, or a related field.</li> <li>Strong programming skills in Python and scientific computing frameworks (NumPy, Pandas, etc.).</li> <li>Experience in machine learning, data mining, and statistical analysis.</li> <li>Experience with large-scale data processing and distributed computing technologies.</li> <li>Strong communication and software development skills: goal setting, design documentation, test frameworks, collaborative cross team development.<br><br></li> </ul> <p><strong>Bonus Points:</strong></p> <ul> <li>Ph.D. in Computer Science or a related field.</li> <li>Experience with cloud platforms such as AWS, Google Cloud, or Azure.</li> <li>Experience with machine learning in the autonomous driving domain.</li> <li>Experience with ML frameworks such as PyTorch, TensorFlow, or JAX.</li> <li>Familiarity with C++ and comfort reading and navigating existing C++ code.</li> <li>Experience with large-scale data processing and distributed computing technologies.</li> <li>Basic fluency with modern web frameworks and Go.</li> <li>Publications or contributions to the AI/ML community.</li> </ul><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p><span style="font-weight: 400;">The salary range for this role is an estimate based on a wide range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range listed in this job posting reflects base salary only. This role may include additional forms of compensation such as a bonus or company equity. The recruiter assigned to this role can share more information about the specific compensation and benefit details associated with this role during the hiring process. </span></p> <p><span style="font-weight: 400;">Candidates for certain positions are eligible to participate in Motional’s benefits program. Motional’s benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more. </span></p></div><div class="title">Salary Range</div><div class="pay-range"><span>$159,000</span><span class="divider">—</span><span>$207,000 USD</span></div></div></div><div class="content-conclusion"><p><strong>Motional is a driverless technology company making autonomous vehicles a safe, reliable, and accessible reality. We’re driven by something more.</strong></p> <p><strong>Our journey is always people first.</strong></p> <p>We aren't just developing driverless cars; we're creating safer roadways, more equitable transportation options, and making our communities better places to live, work, and connect. Our team is made up of engineers, researchers, innovators, dreamers and doers, who are creating a technology with the potential to transform the way we move.</p> <p><strong>Higher purpose, greater…