Jobs by Fastorial
Back to all jobs

Data and Analytics Engineering Lead

1 view
Orbia PunePuneHybrid

12+ years

Posted 1 day ago

  • Azure
  • Devops
  • Engineering Management
  • Python
  • Spark

Main Purpose

The Engineering Lead for Data and Analytics Platforms plays a pivotal role in driving technical strategy, agile delivery, and platform excellence across enterprise data initiatives. This role is accountable for leading the end-to-end design, development, and deployment of scalable data engineering and analytics solutions on Azure spanning domains such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

Key Responsibilities

  • Lead the design, development, and deployment of Azure Data Engineering and Analytics platforms (Azure Data Factory, Databricks, SAC, Power BI) across multiple business groups.
  • Be accountable for Business Group IT engagement and delivery of data and analytics solutions aligned with business outcomes.
  • Translate business requirements into technical specifications, develop comprehensive migration plans, and oversee data ingestion, transformation, storage, and access control.
  • Design and implement scalable data pipelines and streaming solutions using Azure technologies.
  • Develop scalable and reusable frameworks for ingesting large data sets.
  • Establish and ensure data security, quality, and integrity throughout pipelines with validation and cleansing mechanisms.
  • Optimize platform performance for scalability and cost efficiency, maintaining architecture documentation and best practices.
  • Provide technical guidance, resolve migration challenges, and mentor data engineers and developers.
  • Oversee change, incident, and problem management processes to maintain operational excellence.
  • Lead domain-specific squads driving agile delivery and capability building.

Required Knowledge and Experience

  • 12+ years of IT experience delivering medium-to-large data engineering and analytics solutions.
  • Minimum 4 years working with Azure Databricks, Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL, and Power BI.
  • Deep understanding of master data management and data governance concepts.
  • Proven experience in Data Modelling and Source System Analysis.
  • Strong proficiency in PySpark, SQL, and Python for data engineering.
  • Ability to conduct data profiling, cataloging, and mapping for technical data flows.
  • Exposure to AI services in Azure and Agentic Analytics solutions (preferred).