| Hadoop Platform Engineer - C2C - Onsite at Remote, Remote, USA |
| Email: [email protected] |
| From: Devan Mark, Maintec Technologies [email protected] Reply to: [email protected] Required Skills: Platform Engineering: Cluster Management: Expertise in design, implement, and maintain Hadoop clusters in large volume, including components such as HDFS, YARN, and MapReduce. Collaborate with data engineers and data scientists to understand data requirements and optimize data pipelines. Administration and Monitoring: Experience in administering and monitoring Hadoop clusters to ensure high availability, reliability, and performance. Experience in troubleshooting and resolving issues related to Hadoop infrastructure, data ingestion, data processing, and data storage. Security Implementation: Experience in Implementing and managing security measures within Hadoop clusters, including authentication, authorization, and encryption. Backup and Disaster Recovery: Collaborate with cross-functional teams to define and implement backup and disaster recovery strategies for Hadoop clusters. Performance Optimization: Experience in optimizing Hadoop performance through fine-tuning configurations, capacity planning, and implementing performance monitoring and tuning techniques. Automation and DevOps Collaboration: Work with DevOps teams to automate Hadoop infrastructure provisioning, deployment, and management processes. Technology Adoption and Recommendations: Stay up to date with the latest developments in the Hadoop ecosystem. Recommend and implement new technologies and tools that enhance the platform. Documentation: Experience in documenting Hadoop infrastructure configurations, processes, and best practices. Technical Support and Guidance: Provide technical guidance and support to other team members and stakeholders. Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience). Strong experience in designing, implementing, and administering Hadoop clusters in a production environment. Proficiency in Hadoop ecosystem components such as HDFS, YARN, MapReduce, Hive, Spark, and HBase. Experience with cluster management tools like Apache Ambari or Cloudera Manager. Solid understanding of Linux/Unix systems and networking concepts. Strong scripting skills (e.g., Bash, Python) for automation and troubleshooting. Knowledge of database concepts and SQL. Experience with data ingestion tools like Apache Kafka or Apache NiFi. Familiarity with data warehouse concepts and technologies. Understanding of security principles and experience implementing security measures in Hadoop clusters. Strong problem-solving and troubleshooting skills, with the ability to analyze and resolve complex issues. Excellent communication and collaboration skills to work effectively with cross-functional teams. Relevant certifications such as Cloudera Certified Administrator for Apache Hadoop (CCAH) or Hortonworks Certified Administrator (HCA) are a plus. Devan Mark Sr. US It Recruiter Maintec Technologies Inc. 8801 Fast Park Drive, Ste. 301, Raleigh, NC 27617 Phone:+ 19193710850 Email:[email protected]|www.maintec.com LinkedIn:https://www.linkedin.com/in/devan-mark-752102142/ Keywords: information technology North Carolina |
| [email protected] View all |
| Fri Feb 23 00:08:00 UTC 2024 |