Data Engineer-Charlotte, NC (hybrid) - C2C-(only local) at Charlotte, North Carolina, USA |
Email: [email protected] |
From: sudharsan.s, Vysystems [email protected] Reply to: [email protected] Hi , We do have Openings for Data Engineer-Charlotte, NC (Onsite/hybrid) - C2C Hire mode : Contract Location :Charlotte, NC (Onsite/hybrid) "Direct Client *" Please let me know your interest. Job Description: MUST skill - Python Data Stack , Python Web services , ADF , Databricks , Azure , sql, Knowledge in PriceFX will be an added advantage Collaborate with cross-functional teams to understand the existing pricing system's intricacies and pain points, identifying areas for improvement. Design and implement a robust data movement strategy from diverse sources to the new "PriceFx" ecosystem using Azure Data Factory. Develop and optimize ETL pipelines using Azure Data Factory to ensure seamless and reliable data integration. Leverage Azure Databricks for data processing, transformation, and analysis, driving insights that fuel the pricing decision-making process. Architect and implement PYTHON-based API extensions, with a focus on scalability, performance, and security. Work closely with data scientists and analysts to develop algorithms and models that enhance the accuracy of pricing calculations. Collaborate with the development team to ensure Python/Flask-based APIs are seamlessly integrated into the overall ecosystem. Provide technical leadership, mentoring, and guidance to team members, fostering a culture of innovation and excellence. Stay updated with the latest industry trends and technologies related to Azure, data engineering, and pricing analytics. Any Airflow experience would also be a plus as there might be some solutioning involved there and a lot of our existing ETL lives there. Required Qualifications: Solid experience with the Azure ecosystem, particularly Azure Data Factory and Azure Databricks. Proficiency in designing and implementing ETL pipelines for data movement and transformation. Strong Python programming skills, including experience with Flask or similar frameworks for API development. Deep understanding of pricing analytics and the automotive industry's pricing dynamics is a strong plus. Familiarity with cloud-based data storage solutions and data lakes. Excellent problem-solving skills and the ability to dissect complex issues to find optimal solutions. Strong communication skills to collaborate effectively with both technical and non-technical stakeholders. Experience with version control systems and collaborative development workflows. Proven track record of delivering high-quality solutions on time and within scope. Keywords: North Carolina |
[email protected] View all |
Fri Aug 25 20:44:00 UTC 2023 |