| Big Data Administrator or Hadoop Admin at Houston, Texas, USA |
| Email: [email protected] |
| From: Syed Anwer, ConvexTech Inc [email protected] Reply to: [email protected] Job Title: Big Data Administrator or Hadoop Admin Experience Required: 3-5 years Location: Houston, TX (Onsite) NEED ONLY H1B OR USC OR GC OR H4 EAD OR GC EAD Job Summary: As a Big Data Administrator, you will be responsible for managing our Big Data infrastructure and tools within the Cloudera ecosystem. You will play a critical role in our data team, ensuring the high availability, performance, and security of our data solutions. Key Responsibilities: Install, configure, and maintain Cloudera Big Data clusters across multiple environments, ensuring optimal performance and resource utilization. Perform cluster maintenance tasks such as patching, upgrades, and migrations, applying best practices for minimal downtime. Ensure high availability and manage the performance of data services like Kafka, HDFS, HBASE, Hive, and Impala. Architect, develop, and maintain scalable data pipelines, ensuring seamless data integration and flow across the organization. Administer and manage cloud-native Big Data technologies and container orchestration systems, with a focus on Kubernetes (Openshift or equivalent). Implement and manage security and compliance measures, applying Cloudera Ranger, Ranger KMS, KTS, and Atlas tools to protect data integrity. Optimize Cloudera Data Services for data engineering, data warehousing, and machine learning in collaboration with the respective teams. Monitor system performance actively, tune system settings, and carry out capacity planning to meet service level agreements (SLAs). Write and maintain advanced scripts in Shell, Basic Java/Scala/Python for automation and routine task management. Plan and execute system backups and recovery strategies to maintain data safety and high service availability. Coordinate with IT infrastructure and development teams to align Big Data systems with organizational goals. Keep up-to-date with the latest Big Data technologies and contribute to knowledge sharing and team training. Document system configurations, maintain standard operating procedures, and manage version control for infrastructure changes. Liaise with software vendors for technical support, ensuring service standards and levels are maintained. Responsible for the implementation, management, and troubleshooting of Kerberos authentication protocol within the big data ecosystem to ensure secure access control across all nodes and services. This includes configuring Kerberos principals, keytab files, and managing Kerberos tickets. You will also be expected to keep the Kerberos infrastructure updated and secure, and work closely with the security team to audit and improve authentication measures regularly. Ensure the confidentiality, integrity, and availability of data by implementing industry-standard encryption methods. This includes configuring TLS (Transport Layer Security) for data in transit to protect data as it travels across the network, and managing encryption for data at rest to prevent unauthorized access. The role also involves regular audits, developing, and maintaining security policies, and procedures for data encryption, as well as performing vulnerability assessments and remediation. Technical Qualifications: Proficiency in the Cloudera suite, including Kafka, HDFS, HBASE, KUDU, Zookeeper, HIVE, Impala, NIFI, SPARK, FLINK, Oozie, Yarn, Atlas, Ranger, RangerKMS, and KTS. Experience with Cloudera ECS and Cloudera Data Services such as Cloudera Data Engineering, Cloudera Data Warehouse, and Cloudera Machine Learning. Familiarity with container orchestration systems like Kubernetes (Openshift or equivalent). Strong background in Linux system administration and shell scripting. Basic programming skills in Java, Scala, or Python. Experience with graph databases like Neo4j is a plus. Knowledge of cloud-native Big Data technologies and architectural principles. In-depth knowledge and hands-on experience in configuring and managing Kerberos authentication for a secure big data environment. Proficiency in setting up Kerberos realms, troubleshooting Kerberos authentication issues, and performing regular security checks and configuration audits. Strong understanding of encryption protocols and standards for securing data. Experience with configuring TLS/SSL for data in transit across distributed networks and implementing encryption solutions for data at rest, using technologies like Hadoops encryption zones or third-party encryption tools. Familiarity with key management practices and security compliance requirements for data protection. Education: Bachelors degree in Computer Science, Information Technology, or a related field. Certifications: Cloudera Certified Administrator is preferred. Kubernetes certification is advantageous. Soft Skills: Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Proactive attitude with a willingness to take initiative. Phone: 214-295-3794 Email: [email protected] Keywords: information technology green card Texas |
| [email protected] View all |
| Thu Nov 30 23:17:00 UTC 2023 |