| Data Integration Engineer or Analyst || Columbus-OH || L2 F2F at Columbus, Ohio, USA |
| Email: [email protected] |
| From: moiz, Conflux Systems INC. [email protected] Reply to: [email protected] Job Role: Data Integration Engineer/Analyst Location: Columbus-OH Local and border state candidates only Experience: 8+ Years Client: Mphasis/JPMC Note: In-person Interview Mandatory Passport number mandatory Job description: Seeking a skilled and motivated Data Integration Engineer to be part of the existing dynamic team. The primary responsibility of this role is to lead the end-end process of acquiring, cleansing, transforming, and storing data from external vendors to AWS. The successful candidates will leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Responsibilities: Collaborate with cross-functional teams to understand data requirements and establish seamless connections with external vendors Develop and implement robust data acquisition strategies, ensuring data quality, integrity, and security. Lead the design and implementation of data cleansing and transformation process to align vendor data with internal standards and structures Utilize internal tools and SDKs for efficient data integration and processing, focusing on scalability and performance optimization Implement and manage agents for monitoring, logging, and automation within AWS environments Work with Amazon SNS for efficient notification and communication workflows Work with other AWS services, including S3, Athena, and Glue, to optimize data storage, querying, and processing. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs. Skills and Qualifications: Bachelors degree in Computer Science, Information Technology, or related filed. In-depth knowledge and hands-on experience with ASW services, including SNS, S3, Athena, Glue, and Lambda Expertise in data cleansing, transformation, and enrichment techniques Experience in deploying and managing Apache Kafka Proficient in programing language Java Excellent communication and collaboration skills Strong problem-solving skills and meticulous attention to detail. Keywords: sthree Ohio |
| [email protected] View all |
| Thu Feb 22 00:57:00 UTC 2024 |