| Data Engineer with Pyspark - Columbus, OH (Day 1 Onsite and Hybrid) - CTS at Columbus, Ohio, USA |
| Email: [email protected] |
| From: Maneesh, Centraprise [email protected] Reply to: [email protected] Job Title: Data Engineer with Pyspark Location: Columbus, OH (Day 1 Onsite and Hybrid) Job Type: Contract Must Have 11+ Years of Experience.. Job Summary: Seeking a highly skilled Data Engineer with 6-8 years of experience in PySpark and AWS. Roles & Responsibilities: 1. Collaborate with cross-functional teams to understand data requirements and establish seamless connections with external vendors. 2. Develop and implement robust data acquisition strategies, ensuring data quality, integrity, and security. 3. Lead the design and implementation of data cleansing and transformation process to align vendor data with internal standards and structures. 4. Utilize internal tools and SDKs for efficient data integration and processing, focusing on scalability and performance optimization. 5. Implement and manage agents for monitoring, logging, and automation within AWS environments. 6. Work with Amazon SNS for efficient notification and communication workflows. 7. Work with other AWS services, including S3, Athena, and Glue, to optimize data storage, querying, and processing. 8. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. 9. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs. If interested, please fill the below details and revert with your updated resume. Candidate Full Name Current Location Phone Email ID Skype ID Linked in ID Passport number Total Years of Experience Education Visa Status Willing to relocate Rate Last 4 Digits of SSN#: Availability to start on the project Previously worked with Cognizant (Y/N) If Yes Provide the CTS Emp ID Interview Availability with the time Zone Thanks & Regards Maneesh Sanghi| US IT Recruiter Centraprise Corp Desk/Direct: 848-271-1949 Ext 1039 3 Ethel Rd, #304, Edison, NJ 08817 [email protected] Keywords: sthree information technology Idaho New Jersey Ohio |
| [email protected] View all |
| Sat Feb 17 01:27:00 UTC 2024 |