Job Overview: We are looking for a skilled
Azure Technical Lead (Lead Azure Data Engineer) with strong experience in building scalable data pipelines using Azure Data Factory and Azure Databricks.
The ideal candidate will have a solid background in data engineering, particularly in migrating traditional ETL workloads to modern ELT architectures on the cloud.
You will work directly with client stakeholders and must be comfortable operating in overlapping U.S. business hours.
Key Responsibilities:
- Design, develop, and maintain Azure Data Factory (ADF) pipelines and Azure Databricks (ADB) notebooks using PySpark.
- Migrate legacy RDBMS/ETL workloads into modern Data Lake/ELT architectures on Azure.
- Analyze, design, and implement scalable solutions involving Azure Data Lake and data marts.
- Collaborate directly with business and technical stakeholders to gather requirements and deliver solutions.
- Ensure best practices in performance, security, and DevOps for data pipeline development.
Must-Have Skills:
- Proven expertise in Azure Data Engineering tools:
- Azure Data Factory (ADF)
- Azure Databricks (ADB)
- Azure Data Lake Storage Gen2
- Azure SQL DB
- Azure DevOps
- Key Vault, Storage Accounts
- Strong hands-on experience with PySpark and PL/SQL
- Experience migrating traditional ETL workloads to cloud-based ELT/data lake architectures
Desirable Skills:
- Experience with DataStage and SQL Server
- Strong communication and collaboration skills
- Ability to work in a client-facing role with overlapping U.S. time zone availability