Jobs by Fastorial
Back to all jobs

Data Engineer II

2 views
emagineBengaluruHybrid

5+ years

Posted 4 days ago

  • Airflow
  • Java
  • Kafka
  • Python
  • Spark

About the Role

We are looking for a Data Engineer to enhance our experimentation platform by improving data reliability, scalability, and operations. The role will involve collaboration with other engineers to maintain and optimize data products.

Main Responsibilities

  • Take ownership of multiple data pipelines and products, and provide innovative solutions to reduce operational workload
  • Rapidly develop scalable, flexible, and high-performance data pipelines
  • Contribute to developing capabilities like monitoring, debugging, and alerting for data products
  • Prioritize and resolve issues with data pipelines based on customer impact
  • Ensure end-to-end ownership of data quality in complex datasets
  • Experiment with new tools and technologies for performance and data quality improvements
  • Provide tools for the analytics community to discover and assess data quality
  • Serve as the main point of contact for stakeholders on data engineering issues

Key Requirements

  • Minimum of 5 years of hands-on experience in data engineering or software engineering for data pipelines
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent experience
  • Solid experience in at least one programming language, preferably Java or Python
  • Experience building production data pipelines in the cloud
  • Hands-on experience with schema design and data modeling
  • Knowledge of tools like Flink, Kafka, Airflow, Spark, etc.

Nice to Have

  • Experience with teams across different timezones
  • Familiarity with experimentation, statistics, and A/B testing