Data Engineer
0 viewsVenquisAbu DhabiHybrid
5+ years
Posted 3 days ago
- AWS
- Devops
- Git
- Spark
- Terraform
About the Role
Venquis is seeking a skilled AWS Glue Data Engineer to join our Data Factory Squad in Abu Dhabi / Dubai, responsible for migrating source systems into the Lakehouse ingestion zone.
Key Responsibilities
- Build and implement AWS Glue jobs for Bronze layer ingestion using defined standards and templates
- Implement loading methods based on source requirements (CDC, full load, delta, snapshot)
- Design and execute historical loading mechanisms to bring legacy data into the Lakehouse
- Optimize Glue job performance (DPU allocation, parallelization, partitioning) according to best practices
- Ensure jobs are version-controlled and production deployment is automated via Git and Terraform
- Implement source system connectivity into CDP and ensure compliance with data contracts
Requirements
- 5+ years of data engineering experience with strong hands-on AWS Glue and PySpark
- Deep knowledge of Lakehouse architecture and Medallion design principles
- Familiarity with CDC, delta loads, and historical data ingestion strategies
- Hands-on experience with AWS services: Glue, S3, Athena, Lambda
- Automated deployments using Git and Terraform in CI/CD pipelines
- Strong collaboration skills in agile engineering teams