Job Description: To join our Enterprise Architecture team (System Architects, Enterprise Architects, Developers) with the responsibility of understanding the overall business needs and the requirements. With a deep passion for technology, the Big Data Engineer’s primary responsibility will be to have deep understanding and be able to manage all aspects of the complexity of the Big Data environment. [the_ad id="21943"] Job Responsibilities: Manage the security roles – AD as well as Sentry / Ranger and OS Understand all admin modules, ingestion pipeline as well as monitoring requirements Have excellent in-depth OS knowledge and handle any OS level scripting requirements Provide the necessary OS training / knowledge transfer to the Junior Administrators Mange the TCP proxy and any firewall port requirements Plan and provision new hardware as required.] Execute the BigData hybrid strategy e.g., seamless on premise and in the cloud cluster integration Setup the Kerberos dependencies and necessary configuration Create and manage users / groups Be able to perform installations from scratch Handle all key server integration and HA responsibilities Be able to perform troubleshooting e.g., identifying unhealthy / problematic modules in the context of an issue / problem resolution Handle partitioning and indexing requirements with the objective not to compromise performance Job Requirements: Good understanding of partitioning and sharding Good tooling experience with Chef, Ansible and cloud skills (e.g., AWS), MLOps / MLflow, NVIDIA CUDA, IfiniBand RDMA, splitting traffic between IP and InfiniBand stack and Cloudera CDP Good understanding of the JVM and multithreading Understanding (with some experience) highly distributed architecture. Qualification & Experience: Working experience with Python including coding, Python with Spark, and ML frameworks BSc Computer Science or equivalent 3-year IT qualification 3 years’ experience in a Chief Technology Office working on the Big Data environment Cloudera|Hortonworks|Linux (RedHat) Certification – advantageous Job Details: Company: Discovery Limited Vacancy Type: Full Time Job Location: Johannesburg, Gauteng, South Africa Application Deadline: N/A [the_ad id="21944"] Apply Here jobsrican.com
Jobsrican