DV Cleared Data Platform Engineer

You will maintain and develop a big data platform for a UK critical national infrastructure customer. Comprised of Elasticsearch and data lakes built on a Linux estate, the platform supports a suite of cutting-edge cybersecurity and data science tools.

The team uses DevOps methodology to deliver continuous improvements that ensure the platform meets rapidly changing security requirements

You will work to an agile lifecycle model to ensure that capabilities are evolved using a structured methodology and are operationally supportable. This will be coupled with a continuous integration methodology to enforce regular testing of capability modules and their integration points against the ever-evolving platform ecosystem. It is required that the role holder will have experience with a wide range of technologies covering platform administration, core infrastructure technologies, big data applications and scripting.

KEY RESPONSIBILITIES

• Deliver outstanding service to our customers, building on our reputation for excellence in delivery
• Carry out design, development, integration and testing of applications and services
• To provide analytical and innovative input to projects and operational support tasks
• Work with various technical teams to identify detailed technical requirements considering data quality and integration.

REQUIRED SKILLS

• Linux operating systems skills (admin, patching, support)
• Knowledge of Code automation tools (Ansible)
• Knowledge of a wide range of cybersecurity topics
• Knowledge or experience of large scale ETL
• Experience of using scripting languages (Bash, PowerShell, Python)
• Experience in Large Data Platforms