We're looking for a Senior Data Engineers with strong Databricks, PySpark, and Python expertise to help modernize a large-scale data platform and build AI-ready infrastructure. This is a hands-on contract role for someone who thrives in fast-moving environments, can work through ambiguity, and is comfortable owning solutions from design through production. You'll help build scalable pipelines, shape data models, and contribute to the evolution of a modern cloud data platform supporting analytics, reporting, and future AI/ML use cases — as the platform evolves from a legacy analytics setup into a modern hybrid architecture built on Databricks and cloud object storage, with BigQuery continuing to support reporting and BI.
What You'll Do
- Design and implement scalable ETL and ELT pipelines using PySpark on Databricks
- Build ingestion frameworks for structured and semi-structured data from multiple sources
- Develop high-performance data transformations that are maintainable, testable, and production-ready
- Integrate pipelines and workflows across cloud storage and BigQuery-based reporting environments
- Contribute to data modeling decisions, including schemas, transformations, and domain structures
- Support schema evolution and design choices that enable long-term platform scalability
- Translate ambiguous business and technical requirements into clear, actionable engineering solutions
- Collaborate closely with data engineers, DevOps, and business stakeholders to align priorities and unblock delivery
- Improve reliability, observability, performance, and operational quality across pipelines and platform components
- Debug, optimize, and continuously improve existing data workflows and engineering practices
What You Bring
- Strong hands-on experience with Databricks in production environments
- Advanced proficiency in Python
- Deep experience with Apache Spark and PySpark
- Strong experience building cloud-based data pipelines and large-scale data processing systems
- Excellent SQL skills and strong database fundamentals
- Experience designing and maintaining scalable ETL or ELT workflows
- Ability to write clean, maintainable, and testable production-grade code
- Strong problem-solving skills, with the ability to break down complex technical challenges independently
- Comfort working in ambiguous environments and driving execution with limited oversight
- Strong communication skills for collaborating across technical and non-technical stakeholders
- Availability with meaningful overlap with US time zones
US
