Big Data Administrator

Salt Talent Search is looking for Big Data Administrator for 12 months extendable contract role

Responsibilities:

As part of this team, you will: –

• Responsible for the monitoring and uptime of all production and Non-Production Big Data Stack.
• Lead efforts to develop and improve procedures for automated monitoring and proactive intervention, reducing any need downtime.
• Provide and drive architecture and the design of Big Data solutions
• Design and implement high performance systems supporting large volume real time and batched data processes
• Propose and design data architecture solutions for scalability, high availability, fault tolerance, and elasticity for various application needs.
• Develop ETL pipelines with robust monitoring and alarming
• Develop data models that are optimized for business usability and understanding
• Develop and optimize data tables using best practices for partitioning, compression, parallelization, etc.
• Optimize SQL and ETL solutions to solve various reporting requirements.
• Ensure implementation Data Governance and security best practices for Big Data environments
• Provide technical guidance to the team to grow as world class Big Data engineers.
• a successful Engineer will take steps on his or her own to isolate issues and resolve root cause through investigative analysis.
• The Engineer should be an independent problem-solver who is focused and capable of exhibiting deftness to handle multiple simultaneous competing priorities and deliver solutions in a timely manner.

Requirements:

• BS in Computer Science or related field.
• Overall 8+ years of relevant industry experience
• Good knowledge of big data technology landscape and concepts related to distributed storage/computing.
• Experience with big data frameworks (e.g., Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR).
• Experience with batch & ETL jobs to ingest and process data from multiple data sources.
• Experience with NoSQL databases (e.g., Cassandra, MongoDB, Neo4J, Elasticsearch, InfluxDB)
• Experience with querying tools (e.g., Hive, Spark SQL, Impala).
• Experience in real-time stream processing, using solutions such as Kafka, AWS Kinesis, Flume, and/or Spark Streaming.
• Experience in DevOps and DataOps principles (e.g., Infrastructure as code, automating different parts of the data pipeline).
• Monitor and evaluate Big Data stack performance and adjust configuration as appropriate
• Participate in disaster recovery design, testing and execution
• Provide subject matter expertise to team
• Experience working with Agile SCRUM teams
• Open to learn new Tools and technologies.
• Excellent oral and written communication in English

Manage your job search in the right direction by applying via the links below. Alternatively, you can reach out on vramaswamy@welovesalt.com for more details. ( CEI No: R1763696 | Licence No: 07C3147 )

Salt is acting as an Employment Business in relation to this vacancy.