Data Engineer

Contract Length – 12 Months with the view to extend

Start Date – ASAP

Interview Stages – 2

The client is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Their mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, they are at the forefront of AI research and development.

Position Overview:

The client is seeking an exceptional Data Engineer to join the team of AI specialists in the UAE. As a Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines and infrastructure to support our cutting-edge AI systems. You will collaborate closely with the multidisciplinary team to ensure the efficient collection, storage, processing, and analysis of large-scale data, enabling us to unlock valuable insights and drive innovation across various domains.

Responsibilities:

• Pipeline Development: Design, develop, and maintain scalable and reliable data pipelines to ingest, transform, and load diverse datasets from various sources, including structured and unstructured data, streaming data, and real-time feeds.
• Data Integration: Implement robust data integration processes to seamlessly integrate data from different sources, ensuring consistency, reliability, and data quality.
• Data Storage: Design and optimize data storage solutions, including relational databases, NoSQL databases, data lakes, and cloud storage services, to efficiently store and manage large volumes of data.
• Performance Optimization: Optimize data processing and query performance to enhance system scalability, reliability, and efficiency, leveraging techniques such as indexing, partitioning, caching, and parallel processing.
• Data Governance: Implement data governance frameworks to ensure data security, privacy, integrity, and compliance with regulatory requirements, including data encryption, access controls, and auditing.
• Monitoring and Maintenance: Monitor data pipelines and infrastructure components, proactively identify and address issues, and perform routine maintenance tasks to ensure system stability and reliability.
• Collaboration: Collaborate closely with cross-functional teams, including data scientists, architects, and domain experts, to understand requirements, gather insights, and deliver integrated solutions.
• Documentation: Create comprehensive documentation, including technical specifications, data flow diagrams, and operational procedures, to facilitate understanding, collaboration, and knowledge sharing.

Qualifications:

• Proven experience as a Data Engineer, with a track record of designing and implementing complex data pipelines and infrastructure solutions.
• Expertise in data modelling, ETL (Extract, Transform, Load) processes, and data warehousing concepts, with proficiency in SQL and scripting languages (e.g., Python)
• Strong hands-on experience with big data technologies and frameworks, such as Hadoop, Spark, Kafka, and Flink, as well as cloud platforms (e.g., AWS, Azure, GCP).
• Excellent analytical, problem-solving, and communication skills, with the ability to translate complex technical concepts into clear and actionable insights.
• Proven ability to work effectively in a fast-paced, collaborative environment, with a passion for innovation and continuous learning.

Salt is acting as an Employment Business in relation to this vacancy.