Jobs by Fastorial
Back to all jobs

Senior Data Engineer-Python

1 view
AnblicksHyderabadHybrid

4-7 years

Posted 5 days ago

  • AWS
  • Docker
  • GCP
  • Kafka
  • Python
  • Spark

Roles and Responsibilities:

  • Build back-end features in Python, including profiling and integrating large datasets.
  • Support the design and implementation of scalable data pipelines and ETL processes.
  • Collaborate with cloud teams to deploy data solutions on AWS and GCP.
  • Utilize Apache Spark and Kafka for distributed processing and real-time streaming.
  • Implement automated testing, containerization with Docker, and CI/CD best practices.
  • Ensure high data quality, integrity, and performance optimization.

Qualifications:

  • Bachelor's or Master's degree in Computer Science or related field.
  • 4 to 7 years of software and data engineering experience using Python and SQL.
  • Hands-on experience with cloud infrastructure, containerization, and big data technologies.