Data Engineer
6 viewsHCL Technologies LimitedDubaiHybrid
5+ years
Posted 9 days ago
- Oracle
- Python
- Spark
About the Role: HCLTech is seeking a highly talented and self-motivated PySpark Engineer to join our data team in Dubai. The role focuses on building robust ETL pipelines and data marts using PySpark and Python, with Oracle query and data analysis.
Key Responsibilities:
- Build data marts and ETL pipelines in production
- Write clean, maintainable, and robust code in Python and PySpark
- End-to-end SDLC: build UAT, bug fixes, production deployment, and post-production support
- Oracle query and data analysis, PySpark code debugging
- Work across structured, semi-structured, and unstructured data
Requirements:
- 5+ years of commercial experience in a data-driven role
- Hands-on experience with Python, Spark / PySpark, Hadoop / MapReduce / Hive, Pandas
- Daily tech stack: Python, Spark (PySpark), Jupyter, SQL and No-SQL DBMS
- Familiarity with CI/CD, testing and data validation
- Strong data warehousing knowledge base