Data Engineer II
2 viewsemagineBengaluruHybrid
5+ years
Posted 4 days ago
- Airflow
- Java
- Kafka
- Python
- Spark
About the Role
We are looking for a Data Engineer to enhance our experimentation platform by improving data reliability, scalability, and operations. The role will involve collaboration with other engineers to maintain and optimize data products.
Main Responsibilities
- Take ownership of multiple data pipelines and products, and provide innovative solutions to reduce operational workload
- Rapidly develop scalable, flexible, and high-performance data pipelines
- Contribute to developing capabilities like monitoring, debugging, and alerting for data products
- Prioritize and resolve issues with data pipelines based on customer impact
- Ensure end-to-end ownership of data quality in complex datasets
- Experiment with new tools and technologies for performance and data quality improvements
- Provide tools for the analytics community to discover and assess data quality
- Serve as the main point of contact for stakeholders on data engineering issues
Key Requirements
- Minimum of 5 years of hands-on experience in data engineering or software engineering for data pipelines
- Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent experience
- Solid experience in at least one programming language, preferably Java or Python
- Experience building production data pipelines in the cloud
- Hands-on experience with schema design and data modeling
- Knowledge of tools like Flink, Kafka, Airflow, Spark, etc.
Nice to Have
- Experience with teams across different timezones
- Familiarity with experimentation, statistics, and A/B testing