Solution Data Engineer Sr.

About this role

Must Have Skills:
English advanced

Databricks Ecosystem

o Full management of the Databricks environment

o Environment configuration and workspace administration

Governance & Storage

o Implement data governance using Unity Catalog

o Manage structured storage with Delta Lake tables

Development

o Write and optimize data processing logic using Python, SQL, and PySpark

Version Control

o Manage code lifecycle and collaborative development using Git

o Data Warehousing & Integration (Important)

Important Skills:

Snowflake

o Manage data architecture, performance, and integrations within Snowflake

Adobe Data Ingestion

o Handle Adobe Data Feeds and Adobe Analytics

o Ensure correct ingestion and transformation of external marketing data

Nice to Have:

Redshift

o Oversee data warehousing operations in Amazon Redshift

Orchestration

o Use Airflow to schedule, monitor, and manage complex data pipeline workflows

Desirable:

Google Cloud Platform

o Maintain data availability and basic operations in BigQuery

AWS Data Services

o Manage serverless querying with Athena

o Handle metadata management with AWS Glue

Pipeline Ownership

o Own end to end maintenance of data pipelines

o Ensure reliability from data ingestion through final delivery across multiple cloud platforms

REMOTE

ADVANCED ENGLISH

Originally posted on Himalayas