Jobs by Fastorial
Back to all jobs

Lead - Data Engineer M/F

7 views
KK GroupBengaluruHybrid

3-4 years

Posted 5 days ago

  • Azure
  • Git
  • Python
  • Spark

About KK Group:

KK Group is a global technology partner delivering power, controls, cooling, monitoring and service solutions for renewable energy and energy-intensive industries. With more than 45 years of experience in the wind industry and technologies installed in over 120,000 turbines worldwide, KK Group provides critical electro-mechanical systems that enable electrification, improve energy efficiency, and optimise the lifetime performance of industrial assets.

Role Overview: Lead - Data Engineer M/F Type of work: Hybrid Location: Asia, India, Bengaluru

We are seeking a highly skilled and experienced Azure Data Engineer with deep expertise in Azure Databricks, Delta Lake, and the broader Azure data ecosystem. As a key member of our data engineering team, you will design, develop, and optimize scalable data pipelines, implement best-in-class data lakehouse architecture, and enable data-driven decision-making across the organization.

You will be instrumental in transforming raw data into actionable insights and building the data infrastructure that powers advanced analytics, data science, and reporting use cases.

Responsibilities:

  • Design, implement, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  • Develop and optimize data workflows using Delta Lake following the Medallion architecture (Bronze, Silver, Gold layers).
  • Build and manage Databricks notebooks, clusters, and job workflows for data ingestion, transformation, and analytics.
  • Integrate data from diverse sources (structured/unstructured) into the data lake and ensure data quality and consistency across layers.
  • Implement data governance, quality checks, and lineage tracking using Databricks features and other Azure services.
  • Collaborate with data Architects, Business Super Users, and BI Developers to support analytics and reporting requirements.
  • Apply performance tuning, partitioning strategies, and caching for optimized query performance.
  • Work with CI/CD pipelines using Azure DevOps or equivalent tools to ensure seamless deployment of data solutions.
  • Ensure data security and compliance with company and regulatory standards.

Our Requirements:

Must Have Skills & Experience:

  • Minimum of 3-4 years of experience in data engineering, with at least 3 years of hands-on experience with Azure Databricks and Delta Lake.
  • Technical Skills: Proficiency in SQL, Python, and Spark.
  • Strong understanding of Azure services, including Azure Data Factory, Azure Synapse Analytics, and Azure Storage.
  • Problem-Solving: Excellent analytical and problem-solving skills.
  • Ability to troubleshoot complex data issues.

We Offer:

  • Diverse career paths across global operations.
  • Professional development and opportunity to make an impact in renewable energy.