| AWS Data Engineer - Malvern, PA (Day 1 Onsite) - Need local candidate to Pennsylvania - 10+ years at Malvern, Pennsylvania, USA |
| Email: [email protected] |
| From: Laxmi Kumari, Smart IT Frame [email protected] Reply to: [email protected] Dear Vendor, Please help me with some appropriate profiles for the below closable job position. Role: AWS Data Engineer Location: Malvern, PA (Day 1 Onsite) Duration: Long Term Job Description: We are seeking a skilled Data Engineer with expertise in Python, PySpark, and AWS services related to data management and processing. Experience with Apache Iceberg is a plus. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines and ensuring data is efficiently managed and accessible for analysis. Key Responsibilities: Develop, maintain, and optimize scalable data pipelines using Python and PySpark. Utilize AWS data services (e.g., S3, Redshift, Glue, EMR) to support data storage, processing, and analytics needs. Implement and manage data workflows and ETL processes to ensure data availability and quality. Work with Apache Iceberg (preferred) or other data lake formats to manage large datasets, ensuring efficient storage and retrieval. Collaborate with cross-functional teams to understand data requirements and provide data solutions. Monitor, troubleshoot, and improve data pipelines for reliability and performance. Maintain documentation for data processes, structures, and pipeline configurations. Qualifications: Proficiency in Python and PySpark for data processing. Strong experience with AWS data services (S3, Redshift, Glue, EMR, etc.). Familiarity with Apache Iceberg or similar data lake technologies (preferred but not required). Experience in building and maintaining ETL/ELT pipelines. Ability to troubleshoot and optimize data workflows. Excellent communication skills and a collaborative attitude. Thanks and Regards Laxmi Kumari Talent Acquisition Group Email : [email protected] Smart IT Frame LLC. Keywords: sthree information technology Pennsylvania AWS Data Engineer - Malvern, PA (Day 1 Onsite) - Need local candidate to Pennsylvania - 10+ years [email protected] |
| [email protected] View all |
| Wed Nov 06 22:47:00 UTC 2024 |