Jobs by Fastorial
Back to all jobs

Senior Data Engineer

2 views
NuaavNoidaHybrid

4-7 years

Posted 3 days ago

  • Airflow
  • AWS
  • FastAPI
  • Flask
  • Kafka
  • Llm
  • Python
  • Spark

Role Overview

We are looking for a hands-on Senior AI and Data Engineer with strong expertise in AWS, Python, modern data engineering, and AI-enabled data platforms. You will work on building scalable data lakehouse architectures, developing high-performance data pipelines, designing semantic data layers, and integrating AI capabilities such as LLM-powered natural language querying.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Python and SQL.
  • Build and manage data ingestion pipelines from multiple sources, leveraging AWS S3 and modern lakehouse platforms.
  • Develop and optimize data lakehouses, data warehouses, and semantic data models.
  • Build REST APIs using Python frameworks such as FastAPI or Flask.
  • Implement data transformation workflows using dbt and orchestration tools such as Apache Airflow.
  • Integrate AI capabilities including LLM integration, RAG architectures, and natural language querying.
  • Optimize data processing, query performance, data quality, and system reliability.

Requirements

  • 4 - 7 years of hands-on experience in Data Engineering, Python, and advanced SQL.
  • Strong experience building production-grade data pipelines and ETL/ELT workflows.
  • Experience with Apache Airflow or similar workflow orchestration engines.
  • Hands-on experience with AWS services (S3, IAM, CodePipeline, CodeBuild).
  • Experience with modern data lakehouse platforms (Databricks, Snowflake, Apache Iceberg, or Delta Lake).
  • Exposure to LLM integration, RAG pipelines, or AI-assisted data engineering.

Nice to Have

  • Experience with Kafka, Spark Streaming, or real-time data processing.
  • Exposure to BI and analytics platforms (Power BI).