Lead Data Engineer

Sobre esta vaga

<p></p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Job Title: </strong>Lead Data Engineer</span><br><br><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Key Skills:</strong> DBT, Python, SQL, Snowflake, Databricks</span><br><br><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Location:</strong> Brazil</span><br><br><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>Mode: </strong>Remote</span><br><br><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">We at Coforge are hiring <strong>Lead Data Engineer</strong> with the following skill set.</span><br><br><strong><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Key Responsibilities</span></strong></p> <ul> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and promoting engineering excellence.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business needs.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Take full ownership of implementation delivery, from design through deployment, ensuring high-quality, production-ready solutions.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Define and drive the data migration strategy from Snowflake / SSIS to Azure Databricks and DBT, including architecture decisions and execution oversight.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Collaborate closely with cross-functional stakeholders (data, product, architecture, and business teams) to translate requirements into robust technical designs.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Design and oversee the development of scalable data pipelines and data models, ensuring best practices in performance and maintainability.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Lead the implementation of infrastructure-as-code using Terraform, enforcing consistency and automation across environments.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Establish and enforce architectural standards, design patterns, and engineering best practices across the data ecosystem.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Ensure reliable and efficient data integration between Legacy system and Azure environments, with strong focus on data quality and observability.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Drive CI/CD adoption and oversee release processes for data pipelines and platform components.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Act as the primary technical owner for troubleshooting complex issues and ensuring long-term stability of the platform.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Maintain comprehensive documentation of architecture, design decisions, and implementation standards.</span></li> </ul> <p> </p> <p><strong><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Required Skills & Qualifications</span></strong></p> <ul> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Proven experience owning system design and leading implementations of large-scale data platforms.</span></li> <li style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;">Strong hands-on expertise with Snowflake, Azure Databricks, and DBT…