Software Engineer - (Sr. Spark)
1 viewAnblicksHyderabadHybrid
5+ years
Posted 5 days ago
- AWS
- Azure
- Kafka
- Python
- Scala
- Spark
Job Description:
- Experience in object oriented design and implementation.
- Experience in creating end-to-end data processing systems: Design, build, operate, test, deploy.
- Experience in building big data solutions using Spark, Spark SQL, and associated technologies: databases, streaming platforms, data warehouses.
- Experience in creating lean and efficient processes to track work and project progress.
- Highly focused on deliverables, identifying blockers that effect delivery and resolving them.
- Good coding and debugging skills.
- Experienced team leader and mentor.
- Good knowledge on creating efficient production deployments for data projects leveraging native services of specific cloud providers.
- Experience in multi-cloud deployments (AWS / Azure) is an advantage.
- Experience building enterprise data platforms: Data Ingestion, Data Lake, ETL, Data Warehouse.
- Good communication and articulation skills for client facing.
- Nice to have Big Data technologies: Hadoop, HDFS, Hive, Impala, HBase, MongoDB, Cassandra, Kafka.
Requirements:
- 5+ years of experience in data engineering with Apache Spark, Scala, or Python.
- Strong proficiency in SQL and cloud architectures.