Software Developer (Spark/Pyspark)
2 viewsAnblicksHyderabadHybrid
3+ years
Posted 5 days ago
- AWS
- Azure
- GCP
- Python
- Scala
- Spark
Job Description:
- Highly proficient in writing good and efficient Python or Scala code. Preferably Python as it has vast number of libraries.
- Experience in deploying Spark jobs on AWS/GCP/Azure.
- Good experience in Spark architecture and tuning Spark jobs for performance.
- Experience in building data pipelines using Spark Streaming, PySpark, and Delta Lake.
- Solid foundation in SQL, relational databases, and data warehousing principles.
- Experience working with Git, automated testing, and CI/CD pipelines.
Qualifications:
- 3+ years of experience in data engineering with Apache Spark / PySpark.
- Bachelor's or Master's degree in Computer Science, IT, or related field.