| Job Description - AWS Data Engineer - Harrisburg, PA (Onsite) at Harrisburg, Pennsylvania, USA |
| Email: [email protected] |
| Greetings, This is Sparsh with Empower Professionals. We have received below roles from our clients, please check and let me know if you are interested. Please share latest version of your resume to move forward. Role: AWS Data Engineer Locations: Harrisburg, PA (Onsite) Duration: 12+ Months Contract Note: Candidate needs to be in the office 5 Days every week. Local or candidates from nearby states only. Primary Responsibilities: Designs and develops ETL solutions using data warehouse design best practices for Next Generation Analytics platform. Analyze data requirements, complex source data, and data models, and determine the best methods in extracting, transforming, and loading the data into the data staging, warehouse, and other system integration projects. Analyze business requirements and outline solutions. Have a deep working knowledge of on-prem & cloud ESB architecture to address the clients requirements for scalability, reliability, security, and performance. Provide technical assistance in identifying, evaluating, and developing systems and procedures. Document all ETL and data warehouse processes and flows. Develop and deploy ETL job workflow with reliable error/exception handling and rollback. Manage foundational data administration tasks such as scheduling jobs, troubleshooting job errors, identifying issues with job windows, assisting with Database backups, and performance tuning. Design, Develop, Test, and Adapt ETL code & jobs to accommodate changes in source data and new business requirements. Create or update technical documentation for transition to support teams. Develop automated data audit and validation processes. Provides senior technical leadership to design, architecture, integration, and support the entire data sourcing platform with a focus on high availability, performance, scalability, and maintainability. Manage automation of file processing as well as all ETL processes within a job workflow. Develop, Contribute, and adhere to the development of standards and sound procedural practices. Proactively communicate innovative ideas, solutions, and capabilities over and above the specific task request. Effectively communicate status, workloads, and offers to assist other areas. Collaboratively work with a team and independently. Continuously strive for high-performing business solutions. Perform and coordinate unit and system integration testing. Participate in design review sessions and ensure all solutions are aligned to pre-defined architectural specifications. Ensure data quality throughout the entire ETL process, including audits and feedback loops to sources of truth. Primary skills are as below: 6+ years of Data Engineering experience in ETL design, development, optimization & testing using PL/SQL on Oracle. 3+ years of experience in cloud-related database design like Redshift, Databricks, or Snowflake. Others- Nice to have: 3+ years of experience with AWS tools such as S3, EC2, ECS, EKS, Sage Maker, Aurora, Redshift, RDS, Lambda Functions AMI, ELB, ALB, NLB, VPC, Auto Scaling configurations, DMS, Amazon FW, API Gateway, ELB, IAM, CloudTrail, and CloudFront. Understanding of ETL pipeline and workflow management tools such as Airflow, AWS Glue, Amazon Kinesis, or AWS Step Functions. Understanding of AWS cloud computing services such as Lambda functions, ECS, Batch, and Elastic Load Balancer, and other compute frameworks such as Spark, EMR, and Dask. Understanding of container strategies using Docker, Fargate, and ECR. Experience with modern software development methodologies such as Agile, source control, CI/CD, project management, and issue tracking with JIRA. 3+ years of experience in developing flows using batch, real-time, and streaming processes to personalize experiences for our customers. 2+ years of experience with CI/CD tools like Jenkins, GIT, Java, and Shell scripting. Thanks & Regards Sparsh Gupta Technical Recruiter | Empower Professionals ...................................................................................................................................... [email protected] | Direct: 732-356-8008 Ex-351 | Fax: 732-356-8009 100 Franklin Square Drive Suite 104 | Somerset, NJ 08873 www.empowerprofessionals.com linkedin.com/in/sparsh-gupta-b97778271 Certified NJ and NY Minority Business Enterprise (NMSDC) -- Keywords: continuous integration continuous deployment sthree information technology procedural language New Jersey New York Pennsylvania Job Description - AWS Data Engineer - Harrisburg, PA (Onsite) [email protected] |
| [email protected] View all |
| Wed Mar 27 19:35:00 UTC 2024 |