| Lead AWS Data Engineer || Nashville, Tennessee Onsite || Any Visa at Nashville, Tennessee, USA |
| Email: [email protected] |
| From: jatin parashar, Vyze Inc [email protected] Reply to: [email protected] Job Description Title: Lead AWS Data Engineer Location: Nashville, Tennessee Onsite Duration: 6 months with extensions Moi: Video Must LinkedIn Visa: Any Key Responsibilities: Technical Leadership and Direction: Lead the technical vision and strategy for the development and deployment of complex systems and applications in a cloud environment. Establish and enforce best practices for software development, architecture design, and operational efficiency. Provide mentorship and guidance to team members, encouraging a culture of technical excellence and ownership. Architectural Design and Evolution: Design and evolve the technology architecture to meet current and future business needs, ensuring scalability, performance, and security. Conduct thorough evaluations of architectural decisions and promote a consistent focus on quality and efficiency. Collaborate with cross-functional teams to integrate various components of the system architecture, ensuring seamless operation and interoperability. Hands-On Development and Code Contributions: Actively contribute to the codebase, including backend development, data engineering, and DevOps practices. Develop and deploy application code using SQL, Python, and Apache Spark, ensuring high-quality and maintainable solutions. Implement data pipelines and ETL processes to handle large volumes of data efficiently. Cloud Platform Expertise: Utilize AWS services to design, deploy, and manage scalable and secure cloud solutions. Key services include AWS Glue, Athena, Lambda, Secrets Manager, Redshift, Redshift Spectrum, PostgreSQL, CloudFormation, Step Functions, S3, EC2, and Boto3. Ensure optimal use of cloud resources, cost management, and performance tuning. Data Pipeline and ETL Development: Design and implement robust data pipelines to support data integration, transformation, and analysis. Develop ETL processes to efficiently handle and process data within a Snowflake environment and other cloud-based data warehouses. Version Control and CI/CD: Manage version control processes and branching techniques using tools such as Artifactory, Jenkins, and Bitbucket. Oversee continuous integration and continuous deployment (CI/CD) practices to automate build, test, and deployment workflows. Collaboration and Communication: Lead and participate in technical discussions and decision-making processes, ensuring alignment with business objectives and technical requirements. Communicate effectively with stakeholders, including technical teams, product managers, and executives, to convey complex technical concepts and decisions. Operational Efficiency and Improvement: Continuously assess and improve operational processes, focusing on automation, reliability, and performance. Develop and implement strategies to enhance system reliability, reduce downtime, and optimize resource utilization. Quality Assurance and Best Practices: Establish quality metrics and standards for code and system architecture, ensuring adherence to industry best practices. Conduct regular code reviews, architectural reviews, and performance assessments to maintain high-quality deliverables. Qualifications: Experience: 12 to 15 years of experience in software development, with a significant portion in AWS architecture and cloud-based solutions. Technical Skills: Extensive experience with AWS services, SQL, Python, Apache Spark, ETL processes, and data pipeline development. Cloud Platform Expertise: Proficient in using AWS services such as Glue, Athena, Lambda, Secrets Manager, Redshift, Redshift Spectrum, PostgreSQL, CloudFormation, Step Functions, S3, EC2, and Boto3. Data Engineering: Strong background in developing data pipelines and ETL processes, with experience in Snowflake environments. Version Control and CI/CD: Skilled in using version control tools (Artifactory, Jenkins, Bitbucket) and implementing CI/CD practices. Architectural Design: Proven ability to design and evolve technology architecture, with a focus on scalability, performance, and security. Leadership: Demonstrated experience leading technical teams, providing mentorship, and fostering a culture of technical excellence. Communication: Excellent verbal and written communication skills, with the ability to convey complex technical concepts to diverse audiences. Problem-Solving: Strong analytical and problem-solving skills, with the ability to address complex technical challenges and develop innovative solutions. Preferred Qualifications: Certifications: AWS Certified Solutions Architect Professional or equivalent. Advanced Degrees: Masters degree in Computer Science, Engineering, or a related field. Industry Experience: Experience in industries such as finance, healthcare, or retail is a plus. Keywords: continuous integration continuous deployment sthree Lead AWS Data Engineer || Nashville, Tennessee Onsite || Any Visa [email protected] |
| [email protected] View all |
| Sat Sep 21 03:03:00 UTC 2024 |