My client are a leading fintech.
Job Responsibilities:
- Architecting and designing data pipelines.
- Helping data analysts and data scientists in their day to day data requirements.
- Building a dynamic data ingestion framework which is usable for different data sources
- Building and maintaining data lake on AWS.
- Design and implementation of building ETL data pipeline using Pyspark.
- Exposing data on BI tools like AWS Quicksight / Tableau.
- Data modelling to ingest multiple data points from various sources.
Candidate Requirements:
- Big Data Ecosystems: Hadoop/HDFS, Spark, Airflow, , Hive, Flume, Pig, Sqoop, Kafka.
- Cloud Technologies: AWS (S3, EMR, EC2, Athena, Kinesis, Cloudwatch, Athena, Lambda), Snowflake Data warehouse (SaaS)
- Languages: Python, SQL, Unix Shell script, PL/SQL
- Database: Oracle, PostgreSQL and NoSQL like MongoDB.
- Reporting: AWS QuickSight, Tableau
- CI/CD tools: Git, Jenkins, Kubernetes, Docker, Jira, Confluence
Salt is acting as an Employment Agency in relation to this vacancy.
Job Information
Job Reference: JO-2306-335370
Salary: Negotiable
Salary per: annum
Job Duration:
Job Start Date: 05/07/2023
Job Industries: Project & Programme Management
Job Locations: UAE-Dubai
Job Types: Permanent