Data Engineer
0 viewsCareernetKochiHybrid
6-14 years
Posted 7 days ago
- Airflow
- AWS
- Azure
- Python
- Spark
Key Skills
Apache Spark, Python, Databricks, Microsoft Azure, AWS, Distributed Data Processing, Data Pipelines, Data Integration, SQL, Apache Airflow
Roles and Responsibilities
- Design, develop, and maintain batch and distributed data pipelines using Spark and Python.
- Build and manage data engineering solutions on Databricks and Azure or AWS.
- Transform and curate data from multiple sources into dependable, analytics-ready datasets.
- Improve pipeline reliability, scalability, and processing efficiency for growing data volumes.
- Partner with analytics and application teams to deliver data integrations that meet business requirements.
Skills Required
- 6-14 years of relevant data engineering experience.
- Hands-on experience with Apache Spark and Python for data processing.
- Practical experience developing data solutions with Databricks.
- Experience with either Microsoft Azure or Amazon Web Services (AWS) data environments.
- Strong understanding of distributed data processing, scalable pipelines, and data integration patterns.
Good to Have
- SQL and Apache Airflow experience.
Education
- B.E. or B.Tech degree.