Jobs by Fastorial
Back to all jobs

Software Engineer - (Sr. Spark)

1 view
AnblicksHyderabadHybrid

5+ years

Posted 5 days ago

  • AWS
  • Azure
  • Kafka
  • Python
  • Scala
  • Spark

Job Description:

  1. Experience in object oriented design and implementation.
  2. Experience in creating end-to-end data processing systems: Design, build, operate, test, deploy.
  3. Experience in building big data solutions using Spark, Spark SQL, and associated technologies: databases, streaming platforms, data warehouses.
  4. Experience in creating lean and efficient processes to track work and project progress.
  5. Highly focused on deliverables, identifying blockers that effect delivery and resolving them.
  6. Good coding and debugging skills.
  7. Experienced team leader and mentor.
  8. Good knowledge on creating efficient production deployments for data projects leveraging native services of specific cloud providers.
  9. Experience in multi-cloud deployments (AWS / Azure) is an advantage.
  10. Experience building enterprise data platforms: Data Ingestion, Data Lake, ETL, Data Warehouse.
  11. Good communication and articulation skills for client facing.
  12. Nice to have Big Data technologies: Hadoop, HDFS, Hive, Impala, HBase, MongoDB, Cassandra, Kafka.

Requirements:

  • 5+ years of experience in data engineering with Apache Spark, Scala, or Python.
  • Strong proficiency in SQL and cloud architectures.