Backend / Data Engineer — Pipeline & Data Architecture
We are engaging senior Data Engineer to be designing and building the data pipelines and structures that underpin an AI delivery engagement for one of our clients - a global leading strategy-led Tech consultancy for their technology build unit.
The platform is Palantir Foundry — your pipelines will feed directly into the AI layer, so data quality and modelling decisions have real downstream consequences.
What You'll Be Doing
- Designing and building data pipelines using Palantir Foundry Transforms (Python/SQL)
- Modelling data in Foundry's ontology layer — object types, relationships, properties
- Integrating data from external sources via APIs or file-based ingestion
- Ensuring pipeline reliability, data quality, and lineage visibility
- Working in close coordination with the AI Engineer so data outputs are structured for LLM consumption
What We're Looking For
- Solid data pipeline architecture experience — you've designed and owned pipelines in production, not just maintained them
- Python and/or SQL at a professional standard
- Palantir Foundry experience is strongly preferred — particularly Transforms and ontology design
- Data engineers from adjacent platforms (Databricks, dbt, Spark) who have Foundry exposure or genuine appetite to get up to speed quickly will be considered
- Understanding of how structured data feeds into AI/LLM pipelines is a plus
SA
