| Lead Data Engineer - No GC, H1B, OPT and CPT at Remote, Remote, USA |
| Email: [email protected] |
| From: shaik mohammed, www.abidisolutions.com [email protected] Reply to: [email protected] Job Title: Lead Data Engineer Location: Hybrid in Charlotte, NC Visa: all visa is workable except GC, H1B, OPT and CPT Duration: 6-months contract to hire (No GC, H1B, OPT and CPT) Must Haves: 10+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses 2+ years of experience working as a lead and developing/mentoring other engineers Strong experience in Azure cloud and all azure services to include ADF, Databricks, Synapse, etc Strong proficiency in SQL, Python and PySpark programming languages Experience in implementing CI/CD pipelines for automating build, test, and deployment processes Solid understanding of data modelling concepts, data warehousing architectures, and data management best practices Plusses: Must have retail experience Relevant certifications (e.g., Azure, Databricks, Snowflake) would be a plus If they have snowflake or fabric Day-2-Day: A client in Charlotte, NC is looking for Lead Data Engineer to join their team. As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering the organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities. Responsibilities are shown below: Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization. Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks. Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud. Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business. Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis. Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions. Implement data modelling techniques to design and optimize data schemas, ensuring data integrity and performance. Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure. Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions. Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets. Keywords: continuous integration continuous deployment green card North Carolina Lead Data Engineer - No GC, H1B, OPT and CPT [email protected] |
| [email protected] View all |
| Tue Aug 13 20:25:00 UTC 2024 |