| AWS Data Engineer in IL at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=548164&uid= From: Avinash, StackNexus [email protected] Reply to: [email protected] Snowflake with AWS Data Engineer (Onsite) Chicago, IL Role Description Title : AWS Data Engineer Primary Responsibilities: As a AWS Data Engineer, primary responsibilities will be Design, develop and support AWS based data lake and data warehouse solution Develop process flows using Python, DataFrames, Pyspark for Data ingestion, validation, enrichment and extraction services. Experience with Python modules such as Pandas/Unit test and SonarQube Writing effective, scalable code and testing code in Python Experience automating code testing and pipelines Develop and support batch and real-time data pipelines built using AWS Serverless services Develop and configure S3, Athena, Lambda, Glue, Dynamo DB, Kinesis and SQS related components. Develop framework to perform Extract, transform, and load data from a wide variety of SQL and No-SQL data sources Perform unit testing and Integration testing using SonarQube and implement quality validation rules defined by Stake holders Work hand in hand with Data Modelers, Data Developers, and Business SMEs to ensure the data needs and business rules are accurately captured, understood and delivered. Experience in DevOps: GIT, pipeline deployment like: Azure DevOps pipelines, Jenkins, GitLab, CircleCi, etc. Nice to have Snowflake: Snowpark, procedures, tasks, views Keywords: sthree database Illinois http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=548164&uid= |
| [email protected] View All |
| 06:13 PM 21-Aug-23 |