Senior Software Engineer (Data Platform)

About this role

<div class="content-intro"><p style="line-height: 1.5;"><strong><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt; color: rgb(40, 40, 40);">About Us</span></strong></p> <p style="line-height: 1.5;"><span style="font-family: arial, helvetica, sans-serif; color: rgb(40, 40, 40); font-size: 12pt;">Our leading SaaS-based Global Employment Platform™ enables clients to expand into over 180 countries quickly and efficiently, without the complexities of establishing local entities. At G-P, we’re dedicated to breaking down barriers to global business and creating opportunities for everyone, everywhere.</span></p> <p style="line-height: 1.5;"><span style="font-family: arial, helvetica, sans-serif; color: rgb(40, 40, 40); font-size: 12pt;">Our diverse, remote-first teams are essential to our success. We empower our Dream Team members with flexibility and resources, fostering an environment where innovation thrives and every contribution is valued and celebrated.</span></p> <p style="line-height: 1.5;"><span style="font-family: arial, helvetica, sans-serif; color: rgb(40, 40, 40); font-size: 12pt;">The work you do here will positively impact lives around the world. We stand by our promise: Opportunity Made Possible. In addition to competitive compensation and benefits, we invite you to join us in expanding your skills and helping to reshape the future of work.</span></p> <p style="line-height: 1.5;"><span style="font-family: arial, helvetica, sans-serif; color: rgb(40, 40, 40); font-size: 12pt;">At G-P, we assist organizations in building exceptional global teams in days, not months—streamlining the hiring, onboarding, and management process to unlock growth potential for all.</span></p></div><h3><strong>About the Role</strong></h3> <p>As a Senior Data Engineer, you will be the architectural backbone of the <strong>AI-native Data Platform</strong>. You won't just build pipelines; you will design the <strong>self-service frameworks</strong> and <strong>high-performance engines</strong> that power every product and AI workflow across the company.</p> <p>You will bridge the gap between strategic leadership and technical execution, ensuring that our <strong>Databricks Lakehouse</strong> scales efficiently to handle hundreds of services while maintaining world-class data reliability and cost-efficiency.</p> <h3><strong>What You Will Do</strong></h3> <p><strong>Architect the Data Platform</strong></p> <ul> <li>Lead the design and implementation of <strong>internal SDKs and self-service frameworks</strong> that enable distributed engineering teams to ingest and transform data autonomously.</li> <li>Shift from "pipeline building" to <strong>"platform engineering,"</strong> creating reusable patterns for batch and real-time event processing.</li> </ul> <p><strong>Own Platform Performance</strong></p> <ul> <li>Take full ownership of the <strong>cost-effectiveness</strong> of the Databricks ecosystem. You will tune Spark execution plans, optimize shuffle partitions, and implement auto-scaling strategies to manage DBU consumption.</li> <li>Ensure the platform remains performant as volume grows, managing the trade-offs between latency, throughput, and cloud spend.</li> </ul> <p><strong>Drive Data Contracts & Governance</strong></p> <ul> <li>Implement <strong>Schema-on-Write validation</strong> and <strong>Data Contracts</strong> to ensure data from hundreds of internal services meets strict quality standards before hitting the Bronze layer.</li> <li>Partner with the Data Architect & Data Stewards to enforce data privacy (PII), security standards, and metadata lineage across the global ecosystem.</li> </ul> <p><strong>Lead an AI-Infused SDLC</strong></p> <ul> <li>Champion the use of <strong>AI-assisted development tools</strong> (e.g., GitHub Copilot, Cursor) to accelerate the engineering lifecycle and improve code quality.</li> <li>Mentor engineers on distributed computing best practices, conducting deep-dive code reviews that focus on scalability and maintainability.</li> </ul> <h3><strong>What We Are Looking For</strong></h3> <ul> <li><strong>Scale Specialist:</strong> 5+ years of experience building and operating production-grade data systems at massive scale.</li> <li><strong>Databricks Expert:</strong> Deep, hands-on mastery of the <strong>Databricks/Spark</strong> ecosystem (Delta Lake, DLT, Spark UI debugging, and performance tuning).</li> <li><strong>Streaming Veteran:</strong> Proven track record of building <strong>Real-time/Streaming</strong> architectures (Spark Structured Streaming, Kafka, or Kinesis) as a core production requirement.</li> <li><strong>Optimisation Mindset:</strong> Experience managing and optimizing cloud costs in a high-growth environment.</li> <li><strong>Platform Thinker:</strong> Experience building APIs, tools, or frameworks used by other internal engineering teams.</li> </ul><div class="content-conclusion"><div id="message-list_1761669766.039629" class="c-virtual_list__item" data-qa="virtual-list-item"…