Lead Data Ops

My client is hiring a Lead DataOps Engineer to design, automate, and operate reliable, secure data pipelines across hybrid environments. You’ll apply DevOps principles to data engineering, ensuring high-quality datasets power AI, BI, and operational use cases.

Key Responsibilities

• Build & manage CI/CD pipelines for data workloads
• Implement automated testing, schema validation & data contracts
• Enforce metadata, lineage & governance policies
• Monitor pipeline health, performance & cost (dashboards, alerts)
• Support incident response & SLA management
• Collaborate with Data, BI & AI teams to deliver production-ready data

Tech Stack
Databricks * Spark * Delta Lake * ADF * Airflow * dbt * Kafka * CI/CD (Azure DevOps/GitHub Actions) * Terraform/Ansible

Governance & Ops:

• Apply RBAC, masking, tokenisation for sensitive data (PII/PHI)
• Maintain lineage, cataloging & quality KPIs
• Optimize performance (partitioning, caching, cost efficiency)

Requirements:

• 8+ years in engineering, 2+ years in DataOps/DevOps
• Strong experience with data platforms (Databricks, Spark, ADF, dbt)
• Hands-on CI/CD, IaC & observability
• Solid Linux & distributed systems knowledge
• Experience with CDC (SQL Server/Oracle, Debezium/GoldenGate)
• Understanding of data governance & privacy frameworks

Education
Bachelor’s in Computer Science, Engineering, or related field

Salt is acting as an Employment Agency in relation to this vacancy.