Senior Data Engineer (Python)
0 viewsParser LimitedDubaiHybrid
6+ years
Posted 4 days ago
- Airflow
- Azure
- Kafka
- Kubernetes
- Oracle
- Python
As a Senior Data Engineer you will lead the design and development of data ingestion ETL and multi-agent analytical systems by creating scalable schemas and transformation layers that power analytics and AI agents across the UAE and beyond.
Responsibilities:
- Build and maintain end-to-end data ingestion and ETL pipelines
- Ingest structured and unstructured data from APIs, Snowflake, Oracle, documents and market data providers
- Develop production-quality Python services and data workflows
- Orchestrate pipelines using Kubernetes and workflow tools
- Prepare data for AI and RAG systems (chunking, embeddings, retrieval pipelines)
Requirements:
- 6 years of experience in Python
- 3 years of experience with Kubernetes-based workloads
- ETL/ELT pipeline design and orchestration (Airflow, ADF, Databricks)
- Hands-on experience with RAG systems, embeddings and vector databases
- Experience with Azure cloud, Snowflake, and Oracle
- Kafka streaming systems