Data Engineer - Platform Engineering
0 views3+ years
Posted 1 day ago
- AWS
- Jenkins
- Node.js
- Platform Engineering
- PostgreSQL
- Python
- Spark
- Terraform
About Gartner IT
Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients. We make a broad organizational impact by delivering cutting-edge technology solutions that power Gartner. Gartner IT values its culture of nonstop innovation, an outcome-driven approach to success, and the notion that great ideas can come from anyone on the team.
About this role
The Data Engineer will be responsible for designing and building Master Data Management functionality that would help enable better Master Data across Gartner. They would maintain the highest data quality standards demanded by Gartner utilizing multiple state of the art technologies in data engineering, data operations and data mastering in a cloud-based environment. They would also be responsible for managing operational issues behind Gartner's primary client-facing websites.
What you'll do
- Analyze business requirements, design solutions and implement functionality related to MDM.
- Build and maintain Data Pipelines using SQL and AWS technologies like Glue and Python.
- Build and configure web services, pub-sub queues, Event Driven Architecture components.
- Follow best practices and industry standards while implementing Data Engineering and Mastering functions.
- Engage in day to day data operations involving troubleshooting of data pipelines, monitor and maintain job schedules.
What you'll need
- Strong IT professional with 3+ years of experience in cloud-based data engineering preferably in AWS ETL. The candidate should have strong analytical and problem-solving skills.
- Bachelor's degree or foreign equivalent degree in Computer Science or a related field required.
- 3+ years of experience in cloud based (AWS preferred) data engineering.
- Experience with AWS Services: Glue, Lambda, SNS, SQS, EventBridge, and Step Functions.
- Expert level coding skills in Node.js and Python/PySpark.
- Very good Postgres SQL and data analytics skills - ability to look at complex stored procedures, troubleshoot performance issues.
- Understanding of Terraform and Deployment pipelines.
- Attitude and aptitude to learn, collaborate and work towards common goals of the MDM team. Must be a team player.
- Experience working with CI/CD tools and technologies (git, Jenkins, Cloudbees).
- Good understanding of Data Engineering fundamentals and domains.
- Experience in Data Governance, Data Architecture and Data Operations.
What we offer
- Competitive compensation packages
- 23 days annual holiday and an additional day off for your birthday
- Private Medical and Dental Care
- Life and Disability Insurance
- Public Transport Subsidy and Meal Vouchers
- IncentiFit - annual reimbursement for health-and-wellness-related activities
- Pension Scheme and Tuition Reimbursement
- Employee Stock Purchase Plan and Employee Assistance Program
- Gartner Gives Charity Match
- Relocation Assistance
- Limitless growth and learning opportunities
- A collaborative and positive culture
- Hybrid environment with flexibility