Lead AWS Data Engineer (Data Governance)
1 viewNeuroDriftBengaluruHybrid
8+ years
Posted today
- Airflow
- AWS
- Engineering Management
- Llm
- Python
- Spark
About the Role:
We are looking for a Lead AWS Data Engineer with a focus on Data Governance to design, implement, and maintain our enterprise data platform on AWS.
Key Responsibilities:
- Design and implement scalable data pipelines, data models, and ETL/ELT processes on AWS.
- Implement robust data governance frameworks, data cataloging, lineage, and access controls using AWS Glue, Lake Formation, and open-source tooling.
- Lead and mentor junior data engineers, conducting code reviews and defining architectural guidelines.
- Collaborate with data scientists, ML engineers, and business analysts to ensure high data quality and reliability.
- Optimize big data workloads using Apache Spark, PySpark, and Airflow.
Required Qualifications:
- 8+ years of total experience in Data Engineering.
- 4+ years of hands-on experience building big data architectures on AWS (EMR, Glue, Athena, Redshift, S3).
- Strong programming proficiency in Python or Scala.
- Deep knowledge of Data Governance, Data Quality, and Security frameworks.
- Experience with workflow orchestration using Apache Airflow.
- Excellent communication and technical leadership skills.