Senior Software Engineer (Data Pipeline)
FivetranBengaluruOnsite
5+ years
Posted 1 day ago
- AWS
- Azure
- Docker
- GCP
- Grafana
- Java
- Kubernetes
- PostgreSQL
About the role
Senior Software Engineer for Fivetran's data pipeline service, building and working on pipelines that move data from various sources to data warehouses. The work ranges from patching software to building warehouse data writers and optimising sync services on a global Kubernetes compute cluster. You will ensure technical excellence for your team and owned services by contributing code, reviewing code, designing features and mentoring junior colleagues.
Technologies you will use
Java, PostgreSQL, cloud data warehouses, AWS, GCP, Azure, Temporal, Grafana, Kubernetes, Docker.
What you will do
- Work on core product features, systematic enhancements and bug fixes.
- Write or optimise the data writer platform that loads data into warehouses.
- Work with cloud APIs, data writers, SQL databases and SQL warehouses.
- Work on the core pipeline that moves terabytes of data by processing it, splitting it into file formats such as CSV, AVRO and Parquet, then merging and loading into warehouses.
- Own and drive features, pitch design ideas and take part in design reviews.
Skills we are looking for
- 5+ years of professional experience writing Java in a distributed production environment.
- Reliable data-intensive distributed systems experience, with strict SLAs.
- Understanding of complex SQL merge queries and plans.
- Strong system design and troubleshooting skills, including root cause analysis.
- Ability to use AI code assistants and coding agents for features, bugs, testing and investigation.
Location: Bengaluru, Karnataka, India (APAC).