Data Engineer @ Columbus, OH 3 days onsite at Columbus, Ohio, USA |
Email: [email protected] |
Need Profiles with active LinkedIn and Locals Hi, My name is Balaji and I'm an IT recruiter at Trident Consulting. Trident Consulting is seeking a "Data Engineer" for one of our clients in "Columbus, OH 3 days onsite" A global leader in business and technology services Role: Data Engineer with Pyspark and AWS Only Locals Location: Columbus, OH 3 days onsite Type: Contract Exp: 6 8 Yrs Job Summary: Seeking a highly skilled Data Engineer with 6-8 years of experience in PySpark and AWS. Roles & Responsibilities: Collaborate with cross-functional teams to understand data requirements and establish seamless connections with external vendors. Develop and implement robust data acquisition strategies, ensuring data quality, integrity, and security. Lead the design and implementation of data cleansing and transformation process to align vendor data with internal standards and structures. Utilize internal tools and SDKs for efficient data integration and processing, focusing on scalability and performance optimization. Implement and manage agents for monitoring, logging, and automation within AWS environments. Work with Amazon SNS for efficient notification and communication workflows. Work with other AWS services, including S3, Athena, and Glue, to optimize data storage, querying, and processing. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs. About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract and full-time roles. Trident's commitment is to deliver the best and brightest individuals in the industry for our clients' toughest requirements. Some of our recent awards include: 2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area Sincerely yours, Balaji K Trident Consulting 6101 Bollinger Canyon Road Suite 330, CA 94583 Phone: (925) 488-1999 Ext.427 Email: [email protected] https://www.tridentconsultinginc.com/Consultants/ Keywords: sthree information technology California Ohio |
[email protected] View all |
Fri Feb 16 20:32:00 UTC 2024 |