| aws data engineer || need local PA with dl || 100% interview at Remote, Remote, USA |
| Email: [email protected] |
| From: hanshika, vyze [email protected] Reply to: [email protected] Job Description - **BACKFILL ROLE**FAST MOVING ROLE**Role: AWS Data Engineer Work location: HARRISBURG (US:17102), PA - LOCAL ONLY Background and Drug Screen: MANDATORY JOB DESCRIPTION:Job Summary. Primary Responsibilities: Designs and develops ETL solutions using data warehouse design best practices for Next Generation Analytics platform. Analyze data requirements, complex source data, and data models, and determine the best methods in extracting, transforming, and loading the data into the data staging, warehouse, and other system integration projects. Analyze business requirements and outline solutions. Have a deep working knowledge of on-prem & cloud ESB architecture to address the clients requirements for scalability, reliability, security, and performance. Provide technical assistance in identifying, evaluating, and developing systems and procedures. Document all ETL and data warehouse processes and flows. Develop and deploy ETL job workflow with reliable error/exception handling and rollback. Manage foundational data administration tasks such as scheduling jobs, troubleshooting job errors, identifying issues with job windows, assisting with Database backups, and performance tuning. Design, Develop, Test, and Adapt ETL code & jobs to accommodate changes in source data and new business requirements. Create or update technical documentation for transition to support teams. Develop automated data audit and validation processes. Provides senior technical leadership to design, architecture, integration, and support the entire data sourcing platform with a focus on high availability, performance, scalability, and maintainability. Manage automation of file processing as well as all ETL processes within a job workflow. Develop, Contribute, and adhere to the development of standards and sound procedural practices. Proactively communicate innovative ideas, solutions, and capabilities over and above the specific task request. Effectively communicate status, workloads, and offers to assist other areas. Collaboratively work with a team and independently. Continuously strive for high-performing business solutions. Perform and coordinate unit and system integration testing. Participate in design review sessions and ensure all solutions are aligned to pre-defined architectural specifications. Ensure data quality throughout the entire ETL process, including audits and feedback loops to sources of truth. Primary skills are as below: 6+ years of Data Engineering experience in ETL design, development, optimization & testing using PL/SQL on Oracle. 3+ years of experience in cloud-related database design like Redshift, Databricks, or Snowflake. Others- Nice to have: 3+ years of experience with AWS tools such as S3, EC2, ECS, EKS, Sage Maker, Aurora, Redshift, RDS, Lambda Functions AMI, ELB, ALB, NLB, VPC, Auto Scaling configurations, DMS, Amazon FW, API Gateway, ELB, IAM, CloudTrail, and CloudFront. Understanding of ETL pipeline and workflow management tools such as Airflow, AWS Glue, Amazon Kinesis, or AWS Step Functions. Understanding of AWS cloud computing services such as Lambda functions, ECS, Batch, and Elastic Load Balancer, and other compute frameworks such as Spark, EMR, and Dask. Understanding of container strategies using Docker, Fargate, and ECR. Experience with modern software development methodologies such as Agile, source control, CI/CD, project management, and issue tracking with JIRA. 3+ years of experience in developing flows using batch, real-time, and streaming processes to personalize experiences for our customers. 2+ years of experience with CI/CD tools like Jenkins, GIT, Java, and Shell scripting Keywords: continuous integration continuous deployment sthree procedural language Pennsylvania aws data engineer || need local PA with dl || 100% interview [email protected] |
| [email protected] View all |
| Tue May 14 22:48:00 UTC 2024 |