Data Engineer

Data Engineer

Salt are currently working with a leading retail brand looking for a Data Engineer on a 6 month contract based out of London.

The role will involve designing the database structure and building the tables within the Hadoop ecosystem to enable a visualisation specialist to build a category reporting suite within Power Bi. This will involve working with a mixture of internal customer, product and stores data and 3rd party external sources to build the required data structures

Accountabilities

• Design and build database and table structures which allow a Visualisation Analyst to work efficiently and build a Power Bi reporting interface with minimal data wrangling
• Enhance data within an analytical layer that allows Customer Insight analysts to create insight from data sources
• Create and document clear, elegant, and complete data solution designs to the point that it could be used by other members of the team for development
• Build, implement and maintain data solutions to structure disparate data sources into the Big Data platform using a defined best practice
• Produce operational ready code that is maintainable by onshore and offshore resources
• Produce standardised coding designs using industry best practices

Skills

• Personable, curious, intelligent, positive thinker, highly motivated, results driven, quick learner, great communicator
• Deep understanding of metadata, business glossary and data lineage functions for ETL, Data Warehousing and BI
• Data management, data governance, data cleansing and data quality methodologies
• Experience with at least one ETL tool (DataStage, Informatica, SAS DI etc) or advanced SQL
• Prior roles that demonstrate utilisation of high quality Agile development best practices.
• In depth knowledge of at least one scheduling tool (e.g. Control-M, Tidal, Cronacle etc.)
• Preferred – exposure to retail and customer data (including loyalty data use cases)
• Preferred – python development in a Big Data environment
• Preferred – experience of the Hadoop stack (i.e. HDFS, Sqoop, Map Reduce, Hive, Impala, HBase, Yarn, Oozie, Flume, Kerberos etc.)

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://welovesalt.com/privacy-policy/.