| Need local to Charlotte, NC -- Lead Data Engineer at Charlotte, North Carolina, USA |
| Email: [email protected] |
| Circle K, lead data engineer, hybrid in Charlotte, NC, 6-month contract, up to $70/hourly. Top Skills - Must Haves needs to be in charlotte and retail domain experience azure databricks JIRA confluence SAFe Agile Powershell Python Sql Data Data warehouse snowflake data modeling power bi Top Skills' Details Senior Data Engineer 8+ years of data engineering with 2 years of Lead and/or Architecture experience Microsoft Azure, Python, SQL, Databricks, Snowflake Can apply knowledge of data modeling Retail domain experience Secondary Skills - Nice to Haves Job Description Our client is seeking an experienced senior level Lead Data Engineer On site 2x a week in Charlotte NC. 6 month CTH - will sponsor if needed when convert to full time As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities. Responsibilities: Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization. Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks. Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud. Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business. Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis. Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions. Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance. Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure. Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions. Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets. Qualifications: Bachelors or masters degree in computer science, Engineering, or a related field. Prefer someone who has worked in a large retail domain Proven experience (8+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses. Strong understanding of data modeling 2 years or architecture experience and leading a data team Strong proficiency in SQL, Python and Spark programming languages. Strong experience with cloud platforms such as AWS, Azure, or GCP is a must. Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks. Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc. Experience in implementing CI/CD pipelines for automating build, test, and deployment processes. Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices. Excellent communication and leadership skills, with the ability to effectively collaborate with cross-functional teams and drive consensus on technical decisions. Relevant certifications (e.g., Azure, databricks, snowflake) would be a plus. Additional Skills & Qualifications Communication, problem solving, collaboration, documentation, global enterprise experience, go-getter, team lead Employee Value Proposition (EVP) Our clients is one of the world leading gas station and convenience store brands. Client is a global leader in convenience and mobility, operating in 25 countries and territories, with more than 14,400 stores, of which approximately 10,800 offer road transportation fuel. It is one of the largest independent convenience store operators in the United States and it is a leader in the convenience store industry and road transportation fuel retail. Work Environment Hybrid - on site in Charlotte NC 2 days a week Business Drivers/Customer Impact Enterprise data initiatives Why is the position open(provide details) Enterprise data initiatives -- Keywords: continuous integration continuous deployment business intelligence information technology golang North Carolina Need local to Charlotte, NC -- Lead Data Engineer [email protected] |
| [email protected] View all |
| Wed May 29 23:33:00 UTC 2024 |