Lead Data Engineer Remote at Remote, Remote, USA |
Email: [email protected] |
From: Aniket Dhakar, Technocraft Solutions [email protected] Reply to: [email protected] Lead Data Engineer Location- Remote USA Responsibilities As the Lead Data Engineer, you will: Lead the design of new data capabilities and infrastructure related to accessing and using MA, third party, and partner data to power Mastercard data products and solutions. Design required new data pipes, data transfers, and compliance related infrastructure to enable that use of the data in the cloud. Identify data-related capabilities and infrastructure requirements resulting from new and evolving product constructs and how those requirements can be developed cloud natively. Understand the Data and Services business strategy, information infrastructure and data needs for both new and existing products and services across various product initiatives. Collaborate with relevant data management, data governance and technical teams to enable long term viability of information assets and enterprise requirements. Develop a horizontal technology roadmap in conjunction with Data Strategy & Management team input to enable technology solutions for managing data that meet the needs of multiple business stakeholder groups. Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation. Skills Must have Hands-on experience with technologies such as Python, Databricks, AWS, Java, Pyspark, Spark, Kafka, and SQL. You are curious about and motivated by the future trends in data, AI/ML, analytics, and digital experience Experience in data product development, analytical models, and model governance Experience in anonymizing data and managing the use of data Experience in data hygiene procedures, identity resolution capabilities or data management a plus Exceptional interpersonal skills with proven experience in relationship building and partnering. Must work well in both team and individual settings and must be able to work with a geographically dispersed team. Strong analytic capabilities and written and oral communication skills. Attention to detail is a must. Strong project management skills and a demonstrated ability to understand complex information product constructs Familiarity with industry best practices for collection and use of data Motivated self-starter with ability to excel at multi-tasking in a fast-paced environment, outstanding English written and verbal communication skills Nice to have Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts Experience in working with Cloud APIs (e.g., Azure, AWS) Experience participating in complex engineering projects in an Agile setting e.g. Scrum Keywords: artificial intelligence machine learning Massachusetts Lead Data Engineer Remote [email protected] |
[email protected] View all |
Tue Sep 10 18:42:00 UTC 2024 |