Data Engineer

As a data engineer in the Analytics team, you will be the custodian on the movement and storage of data throughout the organisation. This includes maintaining pipelines and data warehouses. You will work with stakeholders across the organisation to source and model data for optimized storage and efficient retrieval.

WHAT YOU WILL BE DOING

Develop high quality software. You will research, design and implement high quality code with a great bias towards efficiency, maintainability and extensibility. Implement unit tests and support quality assurance procedures. Develop and maintain data pipelines. You will source and connect data from source systems to the data warehouse ensuring high levels of robustness, security and accuracy. You will build validations throughout the pipeline to ensure consistency in the transportation of data. Design, develop and maintain databases and architecture. You will work closely with various stakeholders to define the appropriate data models to support business users in using the data and engineering teams to supply data. You will ensure scalability and availability in the design and provide insight on the best ways to improve the architecture and storage. Collaboration. You will work closely with other engineers, product managers, business analysts, designers and various other stakeholders across the organization to understand the problem and provide insightful input in designing the best solution. Continuous improvement. Advocate for and introduce improvements to our development, testing, CI, automation and architecture. Improve the data team’s best practices and processes. YOu will also find ways to automate repetitive and manual tasks. Support deployed code. You will provide support and insight on deployed code to offer support and swift resolution to issues raised by various stakeholders. You will proactively find ways to prevent negative user experiences. Importantly, you need to be socially minded and should want to apply your creativity and skills to reimagining the way out-of-hospital healthcare can be delivered to all South Africans when enabled by technology.

KNOWLEDGE AND EXPERIENCE

● A thorough understanding of database and data warehousing principles including OLAP, Data Marts, Star Schema and Snowflake

● At least 2 years experience in object-oriented languages like Python, Java.

● Experience with stream-processing systems like Fivetran, Storm, Spark-Streaming.

● Experience with big data tools like Hadoop, Spark and Kafka.

● Experience with relational SQL and NoSQL databases like Postgres and Cassandra.

● Experience using cloud platforms like AWS and Azure.

● A familiarity with business intelligence tools like PowerBI and Tableau.

● You have worked and understand agile software development methodologies.

● Knowledge and interest in artificial intelligence, machine learning and predictive modelling is an advantage.

EDUCATION

● Undergraduate degree in Computer Science, Statistics, Applied Mathematics or related field.

● Cloud computing certifications will be an advantage

● Short courses to keep up to speed with modern development and big data tools and practices.

● A post-grad degree will be an advantage

Salt is acting as an Employment Agency in relation to this vacancy.