Jobs by Fastorial
Back to all jobs

Senior Software Engineer - Open Data Platform (ODP)

0 views
AcceldataBengaluruOnsite

7+ years

Posted 1 day ago

  • Docker
  • Java
  • Kafka
  • Kubernetes
  • Python
  • Scala
  • Spark

Acceldata is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Role: Senior Software Engineer - Open Data Platform (ODP)

Location: Bengaluru, Karnataka (On-site)

About Acceldata

Acceldata is an AI-powered Enterprise Data Observability platform that helps enterprises observe, optimize, and operate modern data platforms.

About The Role

We are looking for a Senior Software Engineer with strong experience in Hadoop ecosystem components, big data processing, open source distributed platforms, and high-performance backend development.

Key Responsibilities

  • Architect, design, and implement scalable big data connectors, integrations, and observability pipelines.
  • Contribute to open source big data projects (e.g., Spark, Hadoop, Kafka, Iceberg, Hive).
  • Optimize distributed processing pipelines for maximum throughput, low latency, and efficient resource utilization across Linux, Docker, and Kubernetes.

Mandatory Skills & Qualifications

  • Mandatory Linux proficiency for automation and efficient use of Linux shortcuts for troubleshooting.
  • Familiarity with Kubernetes, Docker, and cloud environments.
  • Ability to manage threads and debug issues related to deadlocks or memory leaks.
  • Strong comprehension of garbage collection tuning and management challenges.
  • Extensive hands-on experience with advanced Java, Scala, or Python, developed and prepared project build models associated with Maven, Gradle, or SBT.
  • Experienced in Github & Nexus management and its use cases.
  • Profound understanding of software engineering, database concepts, virtualisation and architectural patterns.
  • Comprehensive knowledge and a history of significant contributions to past projects.
  • Past experience of mentoring junior engineers in handling critical issues or tasks.
  • Proven capability in fixing bugs and developing new features within complex software systems.
  • Experience working with Big data stack or its ecosystem components, utilizing appropriate frameworks for application development.
  • Demonstrated fluency in English communication.
  • Ability to communicate effectively with senior leadership, presenting technical accomplishments and strategic insights.
  • Strong capacity for collaboration with internal teams, external contributors, and the broader open-source community.

Desired Skills (Bonus)

  • Demonstrated history of contributions or a committer role in Apache projects (e.g., bug fixes, feature development, documentation).
  • Proficiency in identifying performance bottlenecks within big data applications and frameworks.
  • Experience with the migration of applications, Hadoop-based distributions, or data streaming platforms.
  • Familiarity with distributed systems and architectural patterns optimised for scalable data processing.