Jobs by Fastorial
Back to all jobs

Data Engineer

0 views
CareernetKochiHybrid

6-14 years

Posted 7 days ago

  • Airflow
  • AWS
  • Azure
  • Python
  • Spark

Key Skills

Apache Spark, Python, Databricks, Microsoft Azure, AWS, Distributed Data Processing, Data Pipelines, Data Integration, SQL, Apache Airflow

Roles and Responsibilities

  • Design, develop, and maintain batch and distributed data pipelines using Spark and Python.
  • Build and manage data engineering solutions on Databricks and Azure or AWS.
  • Transform and curate data from multiple sources into dependable, analytics-ready datasets.
  • Improve pipeline reliability, scalability, and processing efficiency for growing data volumes.
  • Partner with analytics and application teams to deliver data integrations that meet business requirements.

Skills Required

  • 6-14 years of relevant data engineering experience.
  • Hands-on experience with Apache Spark and Python for data processing.
  • Practical experience developing data solutions with Databricks.
  • Experience with either Microsoft Azure or Amazon Web Services (AWS) data environments.
  • Strong understanding of distributed data processing, scalable pipelines, and data integration patterns.

Good to Have

  • SQL and Apache Airflow experience.

Education

  • B.E. or B.Tech degree.