Jobs by Fastorial
Back to all jobs

Software Developer (Spark/Pyspark)

2 views
AnblicksHyderabadHybrid

3+ years

Posted 5 days ago

  • AWS
  • Azure
  • GCP
  • Python
  • Scala
  • Spark

Job Description:

  1. Highly proficient in writing good and efficient Python or Scala code. Preferably Python as it has vast number of libraries.
  2. Experience in deploying Spark jobs on AWS/GCP/Azure.
  3. Good experience in Spark architecture and tuning Spark jobs for performance.
  4. Experience in building data pipelines using Spark Streaming, PySpark, and Delta Lake.
  5. Solid foundation in SQL, relational databases, and data warehousing principles.
  6. Experience working with Git, automated testing, and CI/CD pipelines.

Qualifications:

  • 3+ years of experience in data engineering with Apache Spark / PySpark.
  • Bachelor's or Master's degree in Computer Science, IT, or related field.