Senior Software Engineer - Open Data Platform (ODP)
0 viewsAcceldataBengaluruOnsite
7+ years
Posted 1 day ago
- Docker
- Java
- Kafka
- Kubernetes
- Python
- Scala
- Spark
Acceldata is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Role: Senior Software Engineer - Open Data Platform (ODP)
Location: Bengaluru, Karnataka (On-site)
About Acceldata
Acceldata is an AI-powered Enterprise Data Observability platform that helps enterprises observe, optimize, and operate modern data platforms.
About The Role
We are looking for a Senior Software Engineer with strong experience in Hadoop ecosystem components, big data processing, open source distributed platforms, and high-performance backend development.
Key Responsibilities
- Architect, design, and implement scalable big data connectors, integrations, and observability pipelines.
- Contribute to open source big data projects (e.g., Spark, Hadoop, Kafka, Iceberg, Hive).
- Optimize distributed processing pipelines for maximum throughput, low latency, and efficient resource utilization across Linux, Docker, and Kubernetes.
Mandatory Skills & Qualifications
- Mandatory Linux proficiency for automation and efficient use of Linux shortcuts for troubleshooting.
- Familiarity with Kubernetes, Docker, and cloud environments.
- Ability to manage threads and debug issues related to deadlocks or memory leaks.
- Strong comprehension of garbage collection tuning and management challenges.
- Extensive hands-on experience with advanced Java, Scala, or Python, developed and prepared project build models associated with Maven, Gradle, or SBT.
- Experienced in Github & Nexus management and its use cases.
- Profound understanding of software engineering, database concepts, virtualisation and architectural patterns.
- Comprehensive knowledge and a history of significant contributions to past projects.
- Past experience of mentoring junior engineers in handling critical issues or tasks.
- Proven capability in fixing bugs and developing new features within complex software systems.
- Experience working with Big data stack or its ecosystem components, utilizing appropriate frameworks for application development.
- Demonstrated fluency in English communication.
- Ability to communicate effectively with senior leadership, presenting technical accomplishments and strategic insights.
- Strong capacity for collaboration with internal teams, external contributors, and the broader open-source community.
Desired Skills (Bonus)
- Demonstrated history of contributions or a committer role in Apache projects (e.g., bug fixes, feature development, documentation).
- Proficiency in identifying performance bottlenecks within big data applications and frameworks.
- Experience with the migration of applications, Hadoop-based distributions, or data streaming platforms.
- Familiarity with distributed systems and architectural patterns optimised for scalable data processing.