| Sr. ETL Developer at Remote, Remote, USA |
| Email: [email protected] |
| From: Vicky, istaffx [email protected] Reply to: [email protected] AWS Glu, ETL and development skills are main skills required- Job Description Global Commerce & InformationInc. is seeking a Sr. ETL Developer with strong systems, software, and AWS cloud experience to support a major mainframe systems modernization initiative for federal customer. Based in DevOps framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding and unit testing. Primary Responsibilities: Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue based on Apache Spark. Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing. Extend standard ETL tool capabilities using combination of Java and Python routines, including microservices and web service invocations. Implement overall solution comprising of ETL jobs (Core), Lambda, Spring Cloud Microservices, Kafka, Java and Python. Develop and integrate custom developed software solutions to leverage automated deployment technologies. Develop, prototype and deploy solutions in AWS Cloud. Coordinate closely with mainframe resources to ensure requirements are clearly understood. Analyze (though proof of concept, performance, and end-to-end testing) and effectively coordinate the infrastructure/service needs working with the architecture and Data Center teams. Closely work with the architecture team to review the design and ETL code. Use industry leading DevOps tools such as Jenkins, Ansible and AWS CloudFormation. Communicate key project data to team members and build team cohesion and effectiveness. Leverage Atlassian tool suite like JIRA and Confluence to track activities. Identify and apply best practices and standard operating procedures. Create innovative solutions to meet the technical needs of customers. Basic Qualifications: Experience working in the software development lifecycle, with strong experience on ETL based development. Experience working with relational database like PostgreSQL. Experience working with programming languages (Java and Python preferred) and Linux bash scripting Experience with development using Amazon Web Services (AWS). Well versed with using issue/problem tracking systems (Jira preferred) Candidate must have bachelor's with 8-12 years of prior relevant experience or master's with 6-10 years of prior relevant experience. Keywords: |
| [email protected] View all |
| Tue Dec 19 19:55:00 UTC 2023 |