Need Sr. ETL Glue Developer - Windsor Mill, MD - Remote with occasional travel at Windsor, New York, USA |
Email: [email protected] |
From: Nikhil, CCIT INC [email protected] Reply to: [email protected] Role Sr. ETL Glue Developer Location Windsor Mill, MD - Remote with occasional travel Duration: Long Term Contract Only USC and GC Job Description Seeking a Sr. ETL Glue Developer with strong systems, software, and AWS cloud experience to support a major mainframe systems modernization initiative for federal customer. Based in DevOps framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding, unit testing and support testing in higher environments. Primary Responsibilities: Re-engineer mainframe batch jobs to equivalent ETL batch processes, preferably using Cloud-Native tools like AWS Glue. Leverage serverless cloud services to prepare (extract and transform) and load large numbers of datasets for data processing. Extend standard ETL tool capabilities using Python routines, including microservices invocations. Implement overall solution comprising of Glue ETL jobs (Core), Lambda, Step Functions, REST API calls and Python. Develop and integrate custom developed software solutions to leverage automated deployment technologies. Coordinate closely with mainframe resources to ensure requirements are clearly understood. Analyze (though proof of concept, performance, and end-to-end testing) and effectively coordinate the infrastructure/service needs working with the architecture and Data Center teams. Closely work with the architecture team to review the design and ETL code. Use industry leading DevOps tools such as CodeCommit, CodeBuild, CodePipeline and AWS CloudFormation. Communicate key project data to team members and build team cohesion and effectiveness. Leverage Atlassian tool suite like JIRA and Confluence to track activities. Identify and apply best practices and standard operating procedures. Create innovative solutions to meet the technical needs of customers. Basic Qualifications: Experience working in the software development lifecycle, with strong experience on ETL based development. Working experience on AWS Glue and Glue studio. Experience working with relational database like PostgreSQL. Experience working with programming language Python/PySpark Experience working in a fast-paced development environment with drive to completion. Experience with development using Amazon Web Services (AWS). Well versed with using version control systems (CodeCommit, CodeBuild, CodePipeline preferred) Well versed with using issue/problem tracking systems (Jira preferred) Candidate must have bachelors with 8-12 years of prior relevant experience or masters with 6-10 years of prior relevant experience. Preferred Qualifications: Familiarity working with multiple file formats, and knowledge on COBOL COPYBOOK and EBCDIC character format is strongly desired. Prior experience working mainframe modernization. Prior experience with Java and Linux bash scripting Thanks & Regards Nikhil Pathania [email protected] Keywords: green card Maryland |
[email protected] View all |
Tue Dec 19 21:42:00 UTC 2023 |