Senior Data Engineer
2 viewsNuaavNoidaHybrid
4-7 years
Posted 3 days ago
- Airflow
- AWS
- FastAPI
- Flask
- Kafka
- Llm
- Python
- Spark
Role Overview
We are looking for a hands-on Senior AI and Data Engineer with strong expertise in AWS, Python, modern data engineering, and AI-enabled data platforms. You will work on building scalable data lakehouse architectures, developing high-performance data pipelines, designing semantic data layers, and integrating AI capabilities such as LLM-powered natural language querying.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Python and SQL.
- Build and manage data ingestion pipelines from multiple sources, leveraging AWS S3 and modern lakehouse platforms.
- Develop and optimize data lakehouses, data warehouses, and semantic data models.
- Build REST APIs using Python frameworks such as FastAPI or Flask.
- Implement data transformation workflows using dbt and orchestration tools such as Apache Airflow.
- Integrate AI capabilities including LLM integration, RAG architectures, and natural language querying.
- Optimize data processing, query performance, data quality, and system reliability.
Requirements
- 4 - 7 years of hands-on experience in Data Engineering, Python, and advanced SQL.
- Strong experience building production-grade data pipelines and ETL/ELT workflows.
- Experience with Apache Airflow or similar workflow orchestration engines.
- Hands-on experience with AWS services (S3, IAM, CodePipeline, CodeBuild).
- Experience with modern data lakehouse platforms (Databricks, Snowflake, Apache Iceberg, or Delta Lake).
- Exposure to LLM integration, RAG pipelines, or AI-assisted data engineering.
Nice to Have
- Experience with Kafka, Spark Streaming, or real-time data processing.
- Exposure to BI and analytics platforms (Power BI).