Skills/Experience:
- Mandatory hands-on experience with Azure Databricks
- Strong expertise in PySpark
- Experience with Azure Data Factory
- Azure Cloud Data Engineering experience
- Delta Lake, CI/CD, DevOps exposure
- Infrastructure as Code – Terraform, ARM
- Strong communication and documentation skills
- Design and build scalable data pipelines using Azure Databricks
- Develop data ingestion workflows using Azure Data Factory
- Optimize Spark jobs and Databricks clusters
- Implement CI/CD using Azure DevOps
- Act as L3 support and mentor teams
- Ensure data security, governance and compliance

