Staff Software Engineer (L4), Twilio Segment Data Pipelines

About the role

Staff Engineer on Twilio's Segment Data platform / pipelines team. You will build and scale systems that process several hundred thousand data points per second, lead development of high-scale ingestion and data processing systems, and design, operate and maintain complex distributed systems while querying petabytes of data for the customer data platform (CDP).

Responsibilities

• Design and deliver robust, high-scale routing experiences for the Data platform / pipelines team.
• Ship features that favor high availability and throughput with eventual consistency.
• Collaborate with engineering and product leads and teams across Twilio Segment.
• Support the reliability and security of the platform.
• Build and optimize globally available, highly scalable distributed systems.
• Act as team Tech Lead as needed; mentor engineers on architecture and design.
• Partner with application teams to deliver end-to-end customer success.

Required

• Bachelor's or Master's degree in Computer Science, Engineering or related field.
• Hands-on experience with high-scale messaging/streaming systems (several thousand events/sec) and processing engines (1M+ events/sec).
• 8+ years writing production-grade code in a modern language.
• Experience designing highly available, fault-tolerant distributed systems.
• Programming in one or more of Go, Java, Scala or similar; concurrent programming; Linux and networking.
• Operating large-scale distributed systems on AWS or GCP.
• Message passing systems (Kafka, AWS Kinesis) and/or stream processing (Spark, Flink).
• Container orchestration (Kubernetes, EKS, ECS); CI/CD; AI tooling for productivity.
• Understanding of architectural patterns of high-scale web applications.

Desired

• Domain expertise in the modern data stack (ingestion, processing, storage).
• Track record of leading teams or owning a complex system end to end.
• Excellent written and verbal technical communication.

Location

Remote, based in any of the permitted 5 India states (Delhi, Karnataka, Maharashtra, Telangana and Tamil Nadu). Occasional travel.