Jobs by Fastorial
Back to all jobs

Senior Data Engineer (Python)

0 views
Parser LimitedDubaiHybrid

6+ years

Posted 4 days ago

  • Airflow
  • Azure
  • Kafka
  • Kubernetes
  • Oracle
  • Python

As a Senior Data Engineer you will lead the design and development of data ingestion ETL and multi-agent analytical systems by creating scalable schemas and transformation layers that power analytics and AI agents across the UAE and beyond.

Responsibilities:

  • Build and maintain end-to-end data ingestion and ETL pipelines
  • Ingest structured and unstructured data from APIs, Snowflake, Oracle, documents and market data providers
  • Develop production-quality Python services and data workflows
  • Orchestrate pipelines using Kubernetes and workflow tools
  • Prepare data for AI and RAG systems (chunking, embeddings, retrieval pipelines)

Requirements:

  • 6 years of experience in Python
  • 3 years of experience with Kubernetes-based workloads
  • ETL/ELT pipeline design and orchestration (Airflow, ADF, Databricks)
  • Hands-on experience with RAG systems, embeddings and vector databases
  • Experience with Azure cloud, Snowflake, and Oracle
  • Kafka streaming systems