Cloud Data Engineer DevOps

Key Responsibilities:

· Participate in all aspects of Data solution delivery life cycle (both on-prem data and public cloud technologies)

· Build, own, and manage data engineering pipelines, workflows and standardized practices

· Ensure Big Data practices integrate into overall data architectures and data management principles

· Complete end to end CI/CD data engineering steps (ex. code build, test, merge, provide feedback)

· Assist in the development of business cases used at management and executive levels for funding and scoping decisions

· Troubleshoot production issues within the Hadoop and Cloud environment

· Perform optimization of data workflow processes and applications

Basic Qualifications:

· Bachelor’s in computer science, or equivalent is required.

· 5+ years’ experience developing data pipelines and workflows, services and applications (Pub/Sub, Storage, Dataflow, Dataproc BQ, Airflow, Composer)

· 5+ years of CI/CD deployment, GitHub, building applications using Hadoop components (HDFS, Hive, Impala, Sqoop, Flume, Kafka, StreamSets, HBase, etc.)

· 5+ years of coding in Scala/Spark, Spark Streaming, Java, Python, and/or HiveQL

· 5+ years of experience working with/using traditional ETL tools & Data Warehousing architecture.

· Must be proficient in SQL/HiveQL and programming language (Java/Python)

· Must have experience in GCP.

Salt is acting as an Employment Agency in relation to this vacancy.