| Urgently Looking for HADOOP ADMINISTRATOR - St Louis, MO - Day1Onsite at Remote, Remote, USA |
| Email: [email protected] |
| From: Peter Edward, Tekgence.com [email protected] Reply to: [email protected] Hi, HADOOP ADMINISTRATOR St Louis, MO - Day1Onsite Long term Project: What will they be working on Separating compute and storage - moving from Hadoop to Kubernetes based cluster. Need someone to do research analysis, need clear guidance and roadmap to complete this. Wants to start moving the applications mid next year. There are a lot of servers that are nearing end of life and going to be out of support by mid to end of next year. Needs this person to already have experience doing this. Very fast-tracked. Technical skills: 2-3 years of experience working on a project like this : Hadoop Kubernetes Kafka Object storage experience Preferred skills/nice to have - adds more value: Minio or Ceph Apache ozone Object storage technologies - S3 Spark, Scala, Hive, Base, Kudu Job summary Resource will be working closely with the architects. On solution and development team. Working with them to come up with a solution using Kubernetes and Object Storage like Minio/ Ceph/Apache Ozone etc.. Goal is to create pool of niche resources and build solution based on open source and continue to support and grow the team. Looking for someone who can be a heavy lifter. Roles & Responsibilities 7-8 years experience in Hadoop administration activities. Exposure in AWS Big data Deploy/maintain hadoop clusters, add/remove nodes using cluster monitoring tools, configuring the NameNode high availability and keeping a track of all the running hadoop jobs. Implementing, managing and administering the overall hadoop infrastructure. Takes care of the day-to-day running of Hadoop clusters Work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected. Capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster. Decide the size of the hadoop cluster based on the data to be stored in HDFS. Ensure that the hadoop cluster is up and running all the time. Monitoring the cluster connectivity and performance. Manage and review Hadoop log files. Backup and recovery tasks Resource and security management Troubleshooting application errors and ensuring that they do not occur again. Years of Experience: 10.00 Years of Experience Regards Peter Edward Tekgence, Inc 6655 Deseo Dr, #104, Irving, TX 75039 Phone: 469-498-0031 Email: [email protected] www.tekgence.com Women Owned(WBE) Certified Keywords: business intelligence sthree Missouri Texas |
| [email protected] View all |
| Fri Oct 20 02:57:00 UTC 2023 |