| Hadoop Admin and Developer Lead - St. Louis, MO at Remote, Remote, USA |
| Email: [email protected] |
| From: Riyas, Xforia Inc [email protected] Reply to: [email protected] Setup all the configurations- Core-Site, HDFS-Site, YARN-Site, and Map Red-Site. However, when working with popular Hadoop distributions like Hortonworks, Cloudera or MapR the configuration files are set up on startup and the Hadoop admin need not configure them manually. Performing all phases of software engineering including requirements analysis, application design, and code development and testing. Manage and review Hadoop log files. Backup and recovery tasks Resource and security management Troubleshooting application errors and ensuring that they do not occur again. Deploys Hadoop cluster, maintains clusters, and manages to add or remove nodes using cluster monitoring (Cloudera Manager) configuring the NameNode high availability and keeping a track of all the running Hadoop jobs. Takes care of the day-to-day running of Hadoop clusters Required knowledge and experience: 8+ years of overall experience in Information Technology and Systems (Sr. or Lead) Excellent knowledge of Development in Hadoop framework, Spark, Hive and Cloudera 7+ years of practical experience on enterprise platforms Experience with multiple large-scale Enterprise Hadoop environment builds and operations including design, capacity planning, cluster setup, security, performance tuning, and monitoring. Strong understanding of core Big Data Cloudera Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBase, Kudu, Sqoop, and Oozie. Strong understanding of Python, Java, and Scala language. Proficient operating systems (Linux), servers, and shell scripting (e.g. Bash, ksh, etc.) Skills Needed: Excellent leadership skills. Must have initiative and be a self - starter. Problem-Solving Skills and technical understanding to determine the causes of operating errors and be able to make decisions accordingly. Excellent communication skills. Being assertive to convey information effectively. Effective Time Management. Studies: Bachelor's degree in the field of Information Systems, Computer Science, Data Analytics, Physical Science, or related field. Hadoop Certifications (Desirable) |
| [email protected] View all |
| Wed Oct 26 22:29:00 UTC 2022 |