Senior Azure Data Engineer - Platform & Analytics
0 viewsNorthBay Solutions LLCAbu DhabiOnsite
6-10 years
Posted 4 days ago
- Azure
- Docker
- Kafka
- Python
- Spark
- Terraform
Location: Abu Dhabi, United Arab Emirates (UAE) Employment Type: Full-Time, Permanent Work Model: Onsite Required Experience: 6 - 10 Years
Job Summary: We are seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms, scalable data pipelines, and cloud-based analytics solutions. Strong hands-on expertise in Microsoft Azure Data Services, large-scale data processing, data warehousing, ETL/ELT frameworks, and cloud-native integration patterns.
Key Responsibilities:
- Design, build, and optimize enterprise-grade data pipelines using Azure Data Factory, Databricks, and PySpark
- Develop and maintain data models, data lakehouses, and analytics structures in Azure Synapse Analytics
- Ingest and transform streaming and batch data from disparate sources including relational databases, APIs, and Kafka
- Write and maintain robust, production-grade Python and SQL code for ETL/ELT workflows
- Implement data governance, metadata management, and data quality checks using Microsoft Purview
- Manage cloud infrastructure deployment and CI/CD automation via Azure DevOps, Terraform, and Docker
- Monitor, troubleshoot, and optimize data workloads for performance, latency, and cost-efficiency
- Partner with cross-functional data teams, BI developers, and data scientists to support reporting and analytics
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Data Science, or related engineering discipline
- 6-10 years of proven experience in Data Engineering with primary focus on the Azure Data Platform
- Proficient in Python, PySpark, and advanced SQL for complex data processing
- Strong hands-on experience with Azure Data Factory, Databricks, Azure Synapse Analytics, and Azure Data Lake Storage
- Solid understanding of distributed computing, data warehousing principles, and dimensional modeling
- Experience with CI/CD tools, Azure DevOps, and Infrastructure as Code (Terraform)
- Relevant Azure certifications (e.g., Azure Data Engineer Associate) are highly preferred