Director, Analytics & Business Intelligence, Digital Product Operations

About this role

College Board – OCEP/Digital Product
Location: This is a remote role, aligned to core EST hours. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). All CB employees are required to occasionally travel to meet in person for business purposes.
Role Type: This is a full-time position
About the Team
The Digital Product division is driving the evolution of College Board’s digital assessment experience, providing opportunities that shape futures and open doors. As AI reshapes education, we are preparing students for the future by ensuring our digital assessments remain secure, meaningful, and reflective of the knowledge and skills needed to thrive in an AI-enabled world.
The Digital Product Operations team exists to bring clarity, structure, and measurable outcomes to how College Board’s Digital Product organization plans, delivers, and improves. We are a small, high-performing team that owns the operational systems, practices, and cross-functional coordination that enable 15+ product teams to deliver meaningful digital assessment experiences to millions of students and educators every year. We partner closely with Product, Technology, Design, and go-to-market functions, and we hold ourselves to the same bar we help others reach: rigorous, data-informed, and always improving.
Together, we are transforming College Board’s trusted assessment platform into a next generation digital assessment experience that is secure, user-centered, and built to evolve with the future of learning and assessment.
About the Opportunity
As Director, Analytics & Business Intelligence, you are the measurement infrastructure behind how Digital Product Operations understands and improves its impact. You build the dashboards, define the metrics, and create the coaching conditions that let product teams and the ProdOps function itself operate on evidence rather than instinct. You're comfortable building in a still-forming space, defining what "healthy" and "adopted" look like before anyone else has, and you don't stop at delivering a dashboard: you take a position on what the data means and own driving the change that follows.
In this role, you own the evidence layer that tells Digital Product whether it is improving, not just whether it is busy. Your work spans three domains at once: the health of 15+ product teams' planning and delivery practices, tracked through measures like roadmap completeness and Productboard field discipline; how well those teams are adopting ProdOps-driven ways of working; and whether the ProdOps function’s own change management efforts are gaining traction or falling short. You make the call on what the data means and what should happen next, then act on it, from diagnosing why an initiative is underperforming to designing and driving the intervention. You keep the Senior Director informed as a thought partner in that process, not a gatekeeper for it. What you build doesn’t wait to become useful until it reaches the Senior Director. Your dashboards, frameworks, and coaching directly change how product teams plan, prioritize, and improve.
In this role, you will:
Product Metrics & Dashboard Development (40%)

• Define and build product metrics dashboards tracking roadmap maturity, Productboard field completeness, and roadmap change patterns across all 15+ Digital Product teams

• Partner with Product leaders and PM/POs to define what “healthy” looks like for each metric, establishing baselines and targets that reflect meaningful improvement, not just activity

• Design dashboards that are self-serve and easy to interpret, so product teams can understand their own health data without requiring ProdOps to translate it for them

• Prepare executive-ready dashboards with minimal oversight from the Senior Director

• Identify gaps in available data and partner with the Planning & Tooling Governance Director to ensure tooling standards support the metrics the function needs to track

ProdOps Effectiveness & Change Management Measurement (30%)

• Build and maintain a measurement framework that tracks how effectively the product group is adopting ProdOps-driven ways of working, including new planning practices, tooling standards, and process changes

• Define adoption metrics for each major ProdOps initiative before it launches, establishing what “adopted” looks like and how it will be measured from day one

• Take a documented position on what the adoption data means, not just what it shows: diagnose whether gaps in adoption stem from awareness, capability, process design, or resistance, then bring a recommended course of action to the relevant stakeholders, partner with the relevant director to design the response, and own the follow-through to confirm whether the intervention worked

• Track change management signals across the product group: awareness rates, behavior change indicators, and the difference between leading and lagging adoption signals

Dashboard Maintenance & Data Governance (20%)

• Own ongoing maintenance of all dashboards across product and ProdOps metrics, ensuring data is current, accurate, and trustworthy at all times

• Establish governance standards for metric definitions, ensuring consistent interpretation across teams and preventing measurement drift as the organization evolves

• Conduct regular audits of data quality; identify and address gaps, inconsistencies, or stale data before they surface in leadership reviews or team conversations

• Partner with the Planning & Tooling Governance Director to ensure metric definitions align with tooling standards and that field governance decisions support accurate measurement

• Document all metric definitions, calculation methods, and data sources in the ProdOps Info Hub so the measurement framework is transparent and maintainable

Metrics Coaching & Adoption (10%)

• Coach PM/POs on how to read and act on their roadmap health dashboards, translating data signals…