| AWS DevOps Engineer Infrastructure Management with Big Data (HDFS) at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2287581&uid= From: Arun Kumar, Siri Info Solutions [email protected] Reply to: [email protected] Hello Hope you are doing well!! Greeting from Siri Info Solutions INC. I am Arun kumar with Siri Info Solutions INC. We Siri Info Solutions INC is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients Job Title: AWS DevOps Engineer Infrastructure Management with Big Data (HDFS) Location: RTP / Research Triangle Park, NC / San Jose, CA Day 1 Onsite Duration: Long term contract Must Have: AWS, DevOps, Infrastructure Management, Big Data, HDFS Nice to Have: Telecom Domain, and Ex Cisco Experience Job Summary: We are seeking a skilled AWS DevOps Engineer with expertise in Infrastructure Management and Big Data (HDFS) to join our team. The ideal candidate will be responsible for designing, deploying, and maintaining cloud infrastructure on AWS, optimizing big data workflows, and ensuring seamless CI/CD pipeline implementations. This role requires a deep understanding of AWS services, Hadoop Distributed File System (HDFS), containerization, and automation tools. Key Responsibilities: AWS Cloud & Infrastructure Management Architect, deploy, and maintain scalable and secure AWS cloud infrastructure for big data applications. Configure and optimize AWS services such as EC2, S3, IAM, RDS, Lambda, VPC, ECS, EKS, Route 53, CloudFront, and CloudFormation. Monitor system performance, cost optimization, and security compliance using AWS CloudWatch, CloudTrail, and GuardDuty. Big Data & HDFS Management Deploy, configure, and manage HDFS clusters in a cloud-based environment. Implement data replication, backup, recovery, and disaster recovery (DR) strategies for HDFS. Optimize Hadoop ecosystem components such as YARN, Spark, Hive, HBase, Kafka, and Flink for efficient big data processing. CI/CD & Automation Develop and maintain CI/CD pipelines using Jenkins, GitLab CI/CD, or AWS CodePipeline. Automate infrastructure provisioning using Terraform, CloudFormation, and Ansible. Implement containerization and orchestration solutions with Docker and Kubernetes (EKS). Security & Compliance Enforce IAM policies, role-based access control (RBAC), and encryption for data security. Conduct periodic vulnerability assessments and ensure compliance with industry standards like ISO, SOC2, and GDPR. Implement logging, monitoring, and alerting using tools like ELK Stack, Prometheus, and Grafana. Performance Optimization & Troubleshooting Optimize HDFS performance by tuning block sizes, replication factors, and data locality strategies. Troubleshoot and resolve infrastructure, networking, and application issues in a distributed system. Work closely with data engineers and developers to enhance scalability, reliability, and efficiency of data pipelines. Required Skills & Qualifications: Cloud Technologies: AWS (EC2, S3, Lambda, RDS, VPC, EKS, CloudFormation). Big Data: HDFS, Hadoop, Spark, Hive, Kafka, HBase, Flink. Automation & IaC: Terraform, Ansible, CloudFormation, Kubernetes, Docker. CI/CD Tools: Jenkins, GitLab CI/CD, AWS CodePipeline. Monitoring & Security: Prometheus, Grafana, ELK Stack, AWS CloudWatch, IAM security best practices. Scripting & Development: Python, Bash, or Power for automation. Networking: VPC, Subnetting, Route 53, Load Balancers, Security Groups, VPNs. Version Control: Git, Bitbucket, or GitHub. Best Regards, Arun Kumar | Senior Technical Recruiter SIRI INFO SOLUTIONS INC Email id : [email protected] Keywords: continuous integration continuous deployment access management sthree California Idaho North Carolina AWS DevOps Engineer Infrastructure Management with Big Data (HDFS) [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2287581&uid= |
| [email protected] View All |
| 05:32 AM 26-Mar-25 |