| need-Certified Cloud Data Engineer -Madison, WI (Must be Local to WI) at Madison, Wisconsin, USA |
| Email: [email protected] |
| From: Padma Charan Jayasingh, Vyze Inc [email protected] Reply to: [email protected] Hello, Hope you are doing great. Kindly go through the below job description and share me your consultants updated profile: Tittle: Certified Cloud Data Engineer Duration: 12 months Location: Madison, WI (Must be Local to WI) Visa: No H1B & CPT MOI: Skype Job Summary: Collaborate with data engineering and development teams to design, develop, test, and maintain robust and scalable ELT/ETL pipelines using SQL scripts, Redshift stored procedures, and other AWS tools and services. Collaborate with our engineering and data teams to understand business requirements and data integration needs, translate them into effective data solutions, that yield top-quality outcomes. Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness. Employ AWS DMS and other services for efficient data ingestion from on-premises databases into Redshift. Design and implement ETL processes, encompassing Changed Data Capture (CDC) and Slow Changing Dimension (SCD) logics, to seamlessly integrating data from diverse source systems. Provide expertise in Redshift database optimization, performance tuning, and query optimization. Design and implement efficient orchestration workflows using Airflow, ensuring seamless coordination of complex ETL processes. Integrate Redshift with other AWS services, such as AWS DMS, AWS Glue, AWS Lambda, Amazon S3, Airflow, and more, to build end-to-end data pipelines. Perform data profiling and analysis to troubleshoot data-related challenges / issues and build solutions to address those concerns. Proactively identify opportunities to automate tasks and develop reusable frameworks. Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git. Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions. REQUIRED SKILLS: 12+ years of experience with AWS stack including: 10+ years working with and personally implementing solutions involving the following concepts: Proficient in SQL and Redshift for data manipulation. Hands-on experience with AWS services like DMS, S3, Glue, Redshift, and Airflow. Strong ETL knowledge and data modeling skills. Skilled in complex ETL scenarios and data integration. Expertise in AWS DMS for on-prem to cloud data migration. Proficient in Python for Airflow DAGs and operators. Oracle to Redshift script conversion experience. Familiar with Git for version control. Adept at identifying and optimizing Redshift queries. Strong problem-solving skills with data accuracy focus. Collaborative, agile team player with technical communication skills. Proven track record of on-time, high-quality data solutions. Experience in large-scale data environments. Extensive Redshift and AWS experience for scalable solutions. AWS data engineering or database certifications are a plus. Glue, Spark, Python, and Redshift. CDC (Change Data Capture), SCD (Slowly Changing Dimensions), and surrogate keys. Thanks and Regards. Padma Charan Jayasingh Technical Recruiter Vyze INC(An E- VerifiedCompany) Email: [email protected] Hangouts: padmacharan.vyzeinc 25179 Methley Plum Place, Aldie, VA 20105 www.vyzeinc.com Disclaimer: This communication, along with any documents, files or attachments, is intended only for the use of the addressee and may contain confidential information. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of any information contained in or attached to this communication is strictly prohibited, To remove your email address permanently from future mailings, please send REMOVE to [email protected] . Keywords: sthree golang Virginia Wisconsin |
| [email protected] View all |
| Wed Sep 27 06:48:00 UTC 2023 |