{"id":70931,"date":"2022-04-07T06:04:35","date_gmt":"2022-04-07T05:04:35","guid":{"rendered":"http:\/\/welovesalt.com\/sg\/jobs\/%wpbb_job_industry%\/big-data-engineer\/"},"modified":"2022-06-06T12:23:59","modified_gmt":"2022-06-06T11:23:59","slug":"big-data-engineer-70931","status":"archive","type":"wpbb_job","link":"https:\/\/welovesalt.com\/sg\/jobs\/technology\/big-data-engineer-70931","title":{"rendered":"Big Data Engineer"},"content":{"rendered":"<p>SALT is hiring Big Data Engineer for a global technology client on a two-year convertable contract role.<\/p>\n<\/p>\n<p><strong>You will be responsible for<\/strong><\/p>\n<ul>\n<li>Responsible for the monitoring and uptime of all production and Non-Production Big Data Stack.<\/li>\n<li>Strive to improve the stability, security, efficiency, scalability, and availability of production systems by applying software engineering practices and by implementing monitors and alerts.<\/li>\n<li>Estimate Bigdata stack capacities; develop methods for monitoring capacity and usage.<\/li>\n<li>Lead efforts to develop and improve procedures for automated monitoring and proactive intervention, reducing any need downtime.<\/li>\n<li>Provide and drive architecture and the design of Big Data solutions<\/li>\n<li>Design and implement high performance systems supporting large volume real time and batched data processes<\/li>\n<li>Propose and design data architecture solutions for scalability, high availability, fault tolerance, and elasticity for various application needs.<\/li>\n<li>Develop ETL pipelines with robust monitoring and alarming<\/li>\n<li>Develop data models that are optimized for business usability and understanding<\/li>\n<li>Develop and optimize data tables using best practices for partitioning, compression, parallelization, etc.<\/li>\n<li>Optimize SQL and ETL solutions to solve various reporting requirements.<\/li>\n<\/ul>\n<p><strong>You should be coming from<\/strong><\/p>\n<p><\/p>\n<li>Overall 8+ years of relevant industry experience<\/li>\n<li>Good knowledge of big data technology landscape and concepts related to distributed storage\/computing.<\/li>\n<li>Experience with big data frameworks (e.g., Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR).<\/li>\n<li>Experience with batch &amp; ETL jobs to ingest and process data from multiple data sources.<\/li>\n<li>Experience with NoSQL databases (e.g., Cassandra, MongoDB, Neo4J, Elasticsearch, InfluxDB)<\/li>\n<li>Experience with querying tools (e.g., Hive, Spark SQL, Impala).<\/li>\n<li>Experience in real-time stream processing, using solutions such as Kafka, AWS Kinesis, Flume, and\/or Spark Streaming.<\/li>\n<li>Experience in DevOps and DataOps principles (e.g., Infrastructure as code, automating different parts of the data pipeline).<\/li>\n<li>Monitor and evaluate Big Data stack performance and adjust configuration as appropriate<\/li>\n<li>Participate in disaster recovery design, testing and execution<\/li>\n<p><\/p>\n<p>If this sounds like your ideal next move, I want to talk to you! Reach out to me at jvenkataraman@welovesalt.com or apply via the posting.<\/p>\n<\/p>\n<p>CEI No: R1659595 \/ Licence No: 07C3147<\/p>\n<p>Salt is acting as an Employment Business in relation to this vacancy.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/counter.adcourier.com\/anZlbmthdGFyYW1hbi40OTQwMy4xMjExM0BzYWx0LmFwbGl0cmFrLmNvbQ.gif\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>SALT is hiring Big Data Engineer for a global technology client on a two-year convertable contract role. You will be responsible for Responsible for the monitoring and uptime of all production and Non-Production Big Data Stack. Strive to improve the stability, security, efficiency, scalability, and availability of production systems by applying software engineering practices and&hellip;<\/p>\n","protected":false},"template":"","wpbb_job_industry":[59],"wpbb_job_location":[1004],"wpbb_job_type":[2],"wpbb_job_skill":[],"wpbb_job_locationType":[],"class_list":["post-70931","wpbb_job","type-wpbb_job","status-archive","hentry","wpbb_job_industry-technology","wpbb_job_location-singapore","wpbb_job_type-contract"],"acf":[],"_links":{"self":[{"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/wpbb_job\/70931","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/wpbb_job"}],"about":[{"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/types\/wpbb_job"}],"wp:attachment":[{"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/media?parent=70931"}],"wp:term":[{"taxonomy":"wpbb_job_industry","embeddable":true,"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/wpbb_job_industry?post=70931"},{"taxonomy":"wpbb_job_location","embeddable":true,"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/wpbb_job_location?post=70931"},{"taxonomy":"wpbb_job_type","embeddable":true,"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/wpbb_job_type?post=70931"},{"taxonomy":"wpbb_job_skill","embeddable":true,"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/wpbb_job_skill?post=70931"},{"taxonomy":"wpbb_job_locationType","embeddable":true,"href":"https:\/\/welovesalt.com\/sg\/wp-json\/wp\/v2\/wpbb_job_locationType?post=70931"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}