| Need Profiles :: Hadoop Developer or Admin - Mclean, VA or San Antonio, TX (Onsite) Contract to hire at Mclean, Virginia, USA |
| Email: [email protected] |
| From: Ashish Kumar, Themesoft Inc [email protected] Reply to: [email protected] Dear Team, Hope you are doing well ! My name is Ashish Kumar and Im from Themesoft Inc. I hope this email finds you well. I am reaching out to you because I came across your profile and I believe that you have excellent candidates to be a great fit for a job opportunity we currently have available with one of our clients. Need profiles for the below Position: 1 Work Location (with City, State & Zip Code) San Antonio, Texas, 78251 (ONSITE ONLY) Job Title/Role Hadoop Admin Please share the Detailed Job Description Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. This is not intended to be an all-inclusive list of job duties and the position will perform other duties as assigned. Hands-on experience on Cloudera installation, configuration, debugging, tuning and administration. Collaborate and assist developers in successful implementation of their code, monitor and fine tune their process for optimum resource utilization on cluster, ability to automate run time process Must have prior Cloudera Hadoop (CDP) cluster deployment experience from the scratch. Hands-on experience on Cloudera, working with data delivery teams to setup new Hadoop users. This includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive. Exposure to Data Science collaborative tools such as data science workbench, Jupyter hub etc Competency in Red Hat Linux administration (security, configuration, tuning, troubleshooting, and monitoring). Expert knowledge on Active Directory/LDAP security integration with Cloudera Big Data platform. Performance tuning of Cloudera clusters and Spark (PySpark, SparkQL,) and MapReduce routines. Optimize clusters for future workloads. Hands-on experience on node management, monitoring and response, support processes creation, upgrades, and patches, logging configuration and managing user rights and space quota. Working knowledge of Networks, Linux OS, and Unix Shell Scripting. Strong hands-on experience in implementation of security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation etc. Experience with setting up and configuring the YARN queues using the YARN queue manager and Authorization through Apache sentry. Important role is to keep the cluster performing well and dependable Perform periodic updates to cluster and keeping the stack current Familiarity with Clouderas BDR tool to perform and monitor backups of critical data and able to restore data when in need Exposure to AWS, or any Cloud Platform Exposure to Snowflake (Nice to have) Need profiles for the below Position: 2 Work Location (with City, State & Zip Code) Mclean, VA or San Antonio, TX (Onsite) Job Title/Role Hadoop Developer Experience level required (Years) 7+ years Please share the Detailed Job Description Responsibilities: Responsible for regular communication with others involved in the development process Implement, test, and bug-fix functionality Responsibility for design and implementation of software projects Provide support to end users Design, build, and maintain efficient and reliable Data Lake solutions. Perform data analysis independently and provide end-to-end problem resolution Required Skills: 7+ years in data engineer role 3+ years of experience with Hadoop/Spark/Snowflake Design and implement high profile data ingestion pipelines from various sources using Spark and hadoop technologies Extensive knowledge in Spark, Hive, Sqoop, Hbase and Snowflake Experience in cloudera, CDP hadoop distribution Experience in shell script, Scala, Python is must Proficiency in writing complex SQL statements using Hive, SnowSQL and RDBMS standards demonstrable Experience in designing and implementing modern data warehouse/data lake solution with understanding of best practices Experience in troubleshooting and fixing real time production jobs in spark and Hadoop Good to have AWS cloud knowledge and S3,IAM,EMR, etc. Customer-focused attitude and desire to interface directly with end-user clients Excellent verbal and written communication skills Education: Bachelors in Computer science or in similar field Keywords: access management sthree Texas Virginia |
| [email protected] View all |
| Tue Sep 26 20:00:00 UTC 2023 |