Jobs by Fastorial
Back to all jobs

Senior Data Engineer

0 views
RecruitoBengaluruRemote

5+ years · ₹25-35 LPA

Posted 3 days ago

  • AWS
  • Java
  • Kafka
  • Python
  • Scala
  • Spark

Responsibilities:

  • Build and maintain real-time and batch data pipelines.
  • Develop data processing systems to handle large datasets.
  • Build data ingestion and transformation workflows.
  • Work with Product, Analytics, and Infrastructure teams to ensure data quality and reliability.
  • Develop APIs and data models for analytics and machine learning.
  • Improve database performance, storage, and ETL pipelines.

Requirements:

  • Experience in Data Engineering.
  • Strong knowledge of Python; Java or Scala is a plus.
  • Experience with Kafka, Spark Streaming, or Flink.
  • Understanding of data modelling, distributed systems, and API integration.
  • Good knowledge of SQL, NoSQL, and AWS services like S3, EMR, Redshift, Glue, and Kinesis.
  • Experience with web scraping tools like Scrapy, Selenium, or Playwright.
  • Knowledge of ETL pipelines and large-scale data processing.