Senior Data Engineer-Python
1 viewAnblicksHyderabadHybrid
4-7 years
Posted 5 days ago
- AWS
- Docker
- GCP
- Kafka
- Python
- Spark
Roles and Responsibilities:
- Build back-end features in Python, including profiling and integrating large datasets.
- Support the design and implementation of scalable data pipelines and ETL processes.
- Collaborate with cloud teams to deploy data solutions on AWS and GCP.
- Utilize Apache Spark and Kafka for distributed processing and real-time streaming.
- Implement automated testing, containerization with Docker, and CI/CD best practices.
- Ensure high data quality, integrity, and performance optimization.
Qualifications:
- Bachelor's or Master's degree in Computer Science or related field.
- 4 to 7 years of software and data engineering experience using Python and SQL.
- Hands-on experience with cloud infrastructure, containerization, and big data technologies.