Lead Data Engineer

My client are one of the top banks here in the UAE.

Job Responsibilities:

• Partner with business stakeholders to understand their needs and build impactful analytics solutions
• Design and build data pipelines to support data science projects following software engineering best practices
• Use state of the art technologies to acquire, ingest and transform big datasets
• Design and build Data/Analytics platform
• Map data fields to hypothesis, curate, wrangle and prepare data to be used in advanced analytics models
• Create and manage data environments in the cloud or on premise

The ideal candidate will have:

• Degree educated in computer science, engineering, mathematics, or equivalent experience
• 7+ years of previous commercial experience as a leader in a data-driven role
• 3+ years of experience as a leader in Data/Analytics platform architecture design
• 3+ years of hands-on experience building data pipelines in production and ability to work across structured, semi-structured and unstructured data
• 3+ years of experience in ML pipeline for streaming/batch workflow
• Ability to write clean, maintainable, and robust code in Python, Scala, Java or similar languages
• Deep understanding and expertise of software engineering concepts and best practices
• Deep knowledge and expertise of testing frameworks and libraries

Technical skills:

• Python
• Spark (PySpark)
• Pandas
• Jupyter
• SQL and No-SQL DBMS
• Git (as source code versioning and CI/CD)
• Exploratory Data Analysis (EDA)
• Imputation Techniques,
• Data Linking / Cleansing
• Feature Engineering
• Jenkins
• CI/CD
• Power BI (Optional)

Salt is acting as an Employment Agency in relation to this vacancy.