Senior Data Engineer
0 views5+ years
Posted 1 day ago
- Airflow
- AWS
- Git
- Kafka
- MongoDB
- PostgreSQL
- Python
- Spark
About Snaphomz
Snaphomz is an AI-powered real estate platform helping buyers, sellers, and agents navigate the home buying and selling journey in the US. We bring together property search, market insights, personalized recommendations, and transaction workflows to help people make informed decisions.
About the role
We're looking for a Senior Data Engineer to own the pipelines and data infrastructure behind our platform. You will integrate property listings and third-party data, build reliable datasets, and make accurate, timely information available to our product, analytics, and AI systems.
This is a hands-on role with responsibility for architecture, implementation, production reliability, and mentoring.
What you'll do
- Design, build, and maintain batch and near-real-time pipelines for property listings, market data, user activity, and transaction workflows.
- Integrate MLS feeds, real estate APIs, and other external sources, handling incremental updates, schema changes, rate limits, retries, and backfills.
- Build consistent data models across properties, listings, agents, users, and transactions.
- Implement validation, deduplication, address normalization, entity matching, and data reconciliation.
- Track listing changes and maintain reliable historical records, including price changes, status updates, and removed listings.
- Develop curated datasets for conversational property search, recommendations, affordability tools, and analytics.
- Improve database performance, pipeline efficiency, and infrastructure costs.
- Establish monitoring and alerts for pipeline failures, stale data, missing records, and unexpected volume changes.
- Apply source-specific access, retention, and display requirements throughout the data lifecycle.
- Work with backend engineers, data scientists, and product teams to define data contracts and deliver production-ready solutions.
- Maintain documentation, deployment workflows, and incident runbooks; mentor other engineers.
What we're looking for
- 5+ years of experience building and operating production data pipelines.
- Strong Python and SQL skills, including query optimization and processing large datasets.
- Solid understanding of data modeling, ETL/ELT, incremental ingestion, change data capture, and orchestration.
- Hands-on experience with AWS data infrastructure, including S3 and relevant compute, messaging, or database services.
- Strong experience with PostgreSQL and familiarity with document databases such as MongoDB.
- Experience with an orchestration framework such as Airflow, Dagster, or Prefect.
- Ability to design pipelines that recover safely from failures without duplicating or losing data.
- Experience with Git, CI/CD, automated data quality checks, and production monitoring.
- Clear communication, sound engineering judgment, and ownership from design through ongoing support.
Nice to have
- Experience with real estate data, MLS integrations, RESO Web API, or property data providers.
- Experience with geospatial data, PostGIS, address matching, or geographic search.
- Familiarity with Neo4j, search indexes, vector databases, or data pipelines supporting AI applications.
- Experience with dbt, Spark, Kafka, or comparable tools where scale requires them.
- Experience handling sensitive user data and implementing access controls and audit trails.