Jobs by Fastorial
Back to all jobs

Senior Data Engineer - Commercial Data Products

0 views
Mobile Apps USBengaluruOnsite

6-9 years

Posted 1 day ago

  • AWS
  • Git
  • Kafka
  • Spark
  • Terraform

Job Title: Senior Data Engineer - Commercial Data Products

Location: Bengaluru (100% Onsite)

Experience: 6 - 9 Years

Job Summary:

We are seeking a Senior Data Engineer with strong expertise in Databricks, PySpark, Spark SQL, AWS Glue, and dbt to build and optimize scalable data pipelines and commercial data products.

Key Responsibilities:

  • Build and optimize ETL/ELT pipelines using PySpark, Spark SQL, Databricks, and AWS Glue.
  • Develop Delta Lake/Iceberg tables and Medallion Architecture (Bronze, Silver, Gold).
  • Build data products for commercial analytics and reporting.
  • Implement data quality, monitoring, reconciliation, and performance tuning.
  • Integrate data from APIs, databases, Kafka, files, and CDC sources.
  • Support production pipelines, code reviews, and cross-functional collaboration.

Required Skills:

  • 6 - 9 years of Data Engineering experience.
  • Strong Apache Spark, PySpark, and SQL.
  • Hands-on AWS Glue and Databricks experience.
  • Experience with Delta Lake, Iceberg, or Hudi.
  • Production ETL/ELT pipeline development.
  • Commercial domain experience in Sales, Order Management, Rebates, POS, Salesforce, or Commercial Analytics.

Preferred Skills:

  • dbt, Unity Catalog, Databricks Workflows, Snowflake.
  • CI/CD, GitHub Actions, Terraform, and automated testing.
  • Kafka, Kinesis, CDC, Data Governance, and Observability.