| Sure Shot Closer: Data Engineer - Hybrid based on assignment or needs at Remote, Remote, USA |
| Email: [email protected] |
| From: srini, plenium corporation [email protected] Reply to: [email protected] Data Engineer Project Project Identifier: MDT SR6 Project Name : Maryland Total Human-services Integrated NetworK Client : Maryland Department of Human Services Location : Hybrid based on assignment/needs Interview Type : Phone/Video Interview Duration of the Contract : 1 Year with Possible extension for 5 more years Anticipated Start Date : September 18th, 2023 Minimum US Experience : 3 Years Visa Requirements : At least 6 months of valid work authorization (Citizen, GC, EAD, H-1B, OPT-EAD, H4-EAD) Background: Plenium Corporation supporting the management, design, development, testing, and implementation of this strategic Information Technology (IT) program. MD THINK is an innovative, cloud-based platform and solution enabling multiple State agencies to share and manage data in one convenient place. MD THINK modernizes all the major health and human services systems in the State of Maryland and integrates multiple state health and human services programs and applications that support the most vulnerable citizens. Duties/Responsibilities: Designing, implementing, and maintaining batch and streaming data pipelines between various SQL sources, including Aurora and SQL Server, and a target data lake in S3, as well as enterprise data stored in Redshift/Snowflake. Expertise in AWS cloud services, such as Kinesis, S3, Lake Formation, Glue, and Step Functions, to build scalable, reliable, and high-performance data pipelines that enable seamless data integration and empower data-driven insights. Design end-to-end data pipelines that efficiently extract, transform, and load data from SQL sources (Aurora, SQL Server) to the target data lake in S3 and the enterprise data in Redshift/Snowflake. Implement both batch and real-time streaming data integration solutions using AWS Kinesis and other relevant technologies. Develop data transformation processes using AWS Glue or other ETL tools to harmonize, cleanse, and enrich data for analytical use. Oversee the setup and configuration of the data lake in S3, applying AWS Lake Formation best practices for data organization, cataloging, and access control. Ensure adherence to data governance and security standards across the data pipelines, guaranteeing data privacy and compliance. Continuously monitor and optimize the performance of the data pipelines, addressing bottlenecks and ensuring efficient data processing and delivery. Implement error handling mechanisms and robust data monitoring to identify and resolve data pipeline issues proactively. Establish and maintain data cataloging and lineage information using AWS Glue Data Catalog to enable data discoverability and traceability. Create comprehensive technical documentation, including design specifications, data flow diagrams, and operational guides. Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver reliable data solutions. Ensure data governance principles are implemented throughout the data pipelines to maintain data quality and integrity. Educational Qualification: Bachelor's Degree from an accredited college or university with a major in Computer Science, Information Systems, Engineering, Business, or other related scientific or technical discipline. General Experience: At least six (6) years of experience working on AWS cloud-based batch and streaming data pipelines. Strong proficiency in AWS cloud services, including Kinesis, S3, Lake Formation, Glue, and Step Functions. In-depth knowledge of SQL databases, such as Aurora and SQL Server, and data lakes in S3, as well as enterprise data in Redshift/Snowflake. Hands-on experience with ETL tools, data transformation, and data integration techniques. Familiarity with data governance, data privacy, and security best practices in AWS environments. Strong problem-solving skills and the ability to troubleshoot complex data pipeline issues. Excellent communication and teamwork skills to collaborate effectively with cross-functional teams. AWS certifications, such as AWS Certified Data Analytics - Specialty or AWS Certified Big Data - Specialty, are advantageous. Please provide me below information: 1)NAME(FIRST NAME,LAST NAME): 2) Date of Birth: 3) PHONE NUMBER: 4)EMAIL : 5)CURRENT LOCATION: 6) Work Authorization Type : 7) Highest Qualification(year and name of the university): 8) US EXPERIENCE (Years) : 9)send me rate : 10)send me updated resume,visa copy and DL copy and Commitment letter (attached) immediately Thank You Srini Director, Recruiting Phone: 301-291-7336 EX :1000| Fax: 206-203-3731 [email protected] | Silver Spring, MD _______________________________________ Plenium America | www.plenium.com Talent Acquisition | IT Consulting | Software Development Equal Opportunity Employer | E-Verified Company | Teamwork | Ethics | Efficiency | Talent | Hard work202 Keywords: sthree information technology green card Maryland |
| [email protected] View all |
| Fri Sep 01 23:17:00 UTC 2023 |