| Urgent Need | AWS Data Engineer| Initial Remote at Torrance, California, USA |
| Email: [email protected] |
| From: Satya Prakash, Envision Tech Sol. [email protected] Reply to: [email protected] Hi Hope you are doing great!! Please find the requirement below , If you find yourself comfortable with the requirement please reply back with your updated resume and I will get back to you or I would really appreciate if you can give me a call back at my contact number 315-275-5700. Role- AWS Data Engineer/Lead Duration- Long term Contract Location: Torrance, CA(Initial Remote) Job Description 1. Do you have worked on Glueworkflow with ETLPipeLine 2. Do you have knowledge in CloudFormation through Yaml 3. Have done job tuning for pyspark along with aws glue 4. Do you have worked on EMR for transient cluster with tuning of correct number of node and type of task & core node used for processing of large files in S3(json,csv etc) 5. Have you ever worked on Event bridge to trigger EMR cluster, mail notification ,glue job etc 6. Do you have worked in AWS Redshift (stored procedure ,partitioning) with performance tuning 7. Do you have knowledge of scheduling tools Apache Airflow or Step function 8. Can you proposed effective solution for aws tools & services used for etl pipeline in terms of cost and performance 9. Do you have excellent communication skills to handle client and offshore team with clear technical and conceptual concepts 10. Do you have excellent problem-solving ability through aws tools and services Roles & responsibilities: Acts as a single point of contact for data migration to AWS projects for customer Provides innovative and cost-effective solution using AWS, Spark, python & customer suggested toolset Optimizes the use of all available resources Develops solutions to meet business needs that reflect a clear understanding of the objectives, practices and procedures of the corporation, department and business unit As a leader in the Cloud Engineering you will be responsible for the overseeing development Learn/adapt quickly to new Technologies as per the business need Develop a team of Operations Excellence, building tools and capabilities that the Development teams leverage to maintain high levels of performance, scalability, security and availability Skills: The Candidate must have 3-5 yrs of experience in PySpark & Python Hands on experience on AWS Cloud platform especially S3, lamda, EC2, EMR Experience on spark scripting Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses. Strong experience with relational databases and data access methods, especially SQL. Knowledge of Amazon AWS architecture and design Thanks and Regards Satya Prakash Email : [email protected] Direct : 3152755700 EXT 112 Keywords: sthree California |
| [email protected] View all |
| Wed Jan 25 17:25:00 UTC 2023 |