🕒 Availability: Must be available until 4:30 PM ET (USA)
We are looking for an experienced Data Engineer with strong AI Platform Engineering expertise to build and scale modern data and AI solutions in a Databricks-centric environment.
🔹 Key Responsibilities:
✔ Build and scale Databricks AI/BI solutions (dashboards, Genie experiences, data pipelines)
✔ Develop ETL/ELT pipelines using Apache Spark and Delta Lake (Medallion Architecture)
✔ Integrate data from enterprise systems like PeopleSoft, Salesforce, and D2L
✔ Ensure data quality, governance, and security (Unity Catalog, encryption, access control)
✔ Enable AI/ML teams with high-quality datasets and feature stores
✔ Design and architect cloud data lakes and data marts (ADLS, S3)
✔ Document and enable teams on Databricks, governance, and architecture best practices
✔ Support AIOps/MLOps workflows using MLflow (experiment tracking, model registry, deployment)
🔹 Required Skills & Experience:
✔ Strong hands-on experience with Databricks (Delta Lake, Apache Spark)
✔ Experience building ELT pipelines and Medallion Architecture
✔ Proficiency in SQL, Python, or Scala
✔ Experience integrating enterprise platforms and systems
✔ Strong knowledge of data governance and metadata management
✔ Must have experience in AI Platform Engineering
🔹 Preferred Qualifications:

✔ Experience with Databricks Unity Catalog
✔ Experience in AI/ML model deployment (MLflow)
✔ Exposure to AIOps lifecycle workflows
✔ Cloud experience with Azure or AWS
✔ Knowledge of data warehouse design
IN
