Show more filters
Randstad has partnered with a software solutions company, building innovative and reliable solutions for their clientele. Your future employers are building a tech team who are capable of keeping up with the latest technologies and aligned in building great solutions
key responsibilities:
Architecture: Design fault-tolerant, petabyte-scale distributed data architectures and define company-wide data governance standards.
Streaming: Build high-throughput, low-latency streaming pipelines using Apache Kafka and stateful Apache Flink applications.
Data Warehousing: Integrate diverse data streams into a centralized Cloud Data Warehouse while optimizing query performance and storage costs.
Development: Write clean, production-grade pipeline code using Python and manage end-to-end data lifecycle orchestration.
Optimization: Troubleshoot bottlenecks in distributed systems, ensuring high availability, system uptime, and cost efficiency.
Leadership: Provide technical mentorship to junior engineers and collaborate with cross-functional product and data science teams.
Experience: 7+ years of dedicated data engineering or distributed systems experience.
Streaming: Proven production experience with Apache Kafka (including ecosystem tools) and Apache Flink for real-time processing.
Python: Expert-level proficiency in Python for data processing and automation.
Cloud Data Warehousing: Hands-on experience scaling modern cloud data warehouses (e.g., Snowflake, BigQuery, Redshift).
System Design: Strong grasp of distributed systems architecture, microservices, and modern data lakehouse patterns (e.g., Iceberg, Delta).
Tooling: Familiarity with orchestration (e.g., Airflow), containerization (Docker, Kubernetes), and CI/CD pipelines.
how to apply
Kindly click on the applicable link to apply if you are interested and suitable for this role. Alternatively, you can reach out to me via LinkedIn for a confidential discussion.
Sundar Ravindran | Randstad
