GCP Data Engineer

GCP Data Engineer – Bank – London

Day rate: £500 – £650 (inside IR35)

Duration: 6 months

Start: ASAP

Hybrid: 2 days per week

My new client is looking for a Data Engineer on a contract basis, you will be responsible for translating client requirements into design, architecting, and implementing GCP Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation & Consumption, Data Storage and Computation Frameworks, Performance Optimisation, Infrastructure, Automation & Cloud Computing, and Data Governance & Security.

The role requires a hands-on technologist with expertise in Big Data solution architecture with strong programming background in Java / Scala / Python.

Your Impact:

• Provide technical leadership and hands-on implementation role in the areas of data

engineering including data ingestion, data access, modelling, data processing, visualisation, design, and implementation.

• Lead a team to deliver high quality big data technologies-based solutions on GCP Cloud.

Manage functional & nonfunctional scope and quality.

• Help establish standard data practices like governance and address other non-functional

issues like data security, privacy, and quality.

• Manage and provide technical leadership to a data program implementation based on

the requirement using agile technologies.

• Participate in workshops with clients and align client stakeholders to optimal solutions.
• Consulting, Soft Skills, Thought Leadership, Mentorship etc.
• People management, contributing to hiring and capability building.

Your Skills & Experience:

• Overall 8+ years of IT experience with 5+ years in Data related technologies, and expertise of 1+years in data related GCP Cloud services and delivered at least 1 project as an architect.
• Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of end to end Big data solutions on GCP Cloud.
• Expert in programming languages like Java/ Scala and good to have Python
• Expert in at least one distributed data processing frameworks: like Spark (Core, Streaming , SQL), Storm or Flink etc.
• Expert in Hadoop eco-system with GCP cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI etc), distributed messaging and ingestion frameworks (Kafka,Pulsar, Pub/Sub etc) and good to know traditional tools like Informatica, Talend et
• Should have worked on any of NoSQL solutions like Mongo DB, Cassandra, HBase etc or Cloud based NoSQL offerings like DynamoDB , Big Table etc.
• Good Exposure in development with CI / CD pipelines. Knowledge of containerisation, orchestration and Kubernetes engine would be an added advantage.