| Lead Data Engineer Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Anubhav Verma, Technocraft solution [email protected] Reply to: [email protected] Role: Sr data engineer Remot Project description We are seeking a talented and motivated Senior Data Engineer to join our data engineering team. In this role, you will play a critical part in designing, developing, and optimizing data pipelines and solutions that enable efficient data processing and analysis. As a Senior Data Engineer, you will collaborate with cross-functional teams to drive data-driven decision-making and contribute to the continuous improvement of our data infrastructure. Responsibilities Role: Design, develop, and maintain new data capabilities and infrastructure for utilizing Mastercard, third-party, and partner data to enhance Mastercard's data products and solutions Create new data pipelines, data transfers, and compliance-oriented infrastructure to facilitate seamless data utilization within cloud environments Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions Work with large datasets, ensuring data quality, accuracy, and performance Implement data transformation, integration, and validation processes to support analytics and reporting needs Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes Document data processes, data lineage, and technical specifications for future reference Participate in code reviews, ensuring adherence to coding standards and best practices Collaborate with DevOps teams to automate deployment and monitoring of data pipelines Additional tasks as required Skills Must have Bachelor's or Master's degree in Computer Science, Engineering, or a related field Proven experience in data engineering, with a strong track record of designing and implementing data solutions Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.) In-depth understanding of data warehousing concepts, cloud platforms (AWS, Azure, GCP), and data modeling techniques Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools Passion for and engagement with emerging trends in data, AI/ML, analytics, and digital experiences Experience in data product development, analytical models, and model governance Experience in anonymizing data and managing the use of data Experience in data hygiene procedures, identity resolution capabilities or data management a plus Ability to create strategies and plans that define how information can be utilized to support an organization's overall business strategy, and how that information and data is organized, and governed inside an organization Strong project management skills and a demonstrated ability to understand complex information product constructs Familiarity with industry best practices for collection and use of data Outstanding problem-solving skills and the ability to navigate complex data challenges Effective communication and collaboration skills to work with both technical and non-technical stakeholders Experience with agile methodologies and DevOps practices Nice to have Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts Experience in working with Cloud APIs (e.g., Azure, AWS) Experience participating in complex engineering projects in an Agile setting e.g. Scrum Thanks and Regards, Anubhav verma Talent Acquisition Technocraft Solutions LLC Direct: 9725440408 Email: [email protected] www.technocraftsol.com | Technocraft Solutions LLC 3974 Brown Park Drive, Suite F Hilliard, Ohio-43026 Keywords: artificial intelligence machine learning Lead Data Engineer Remote [email protected] |
| [email protected] View all |
| Tue Sep 10 02:46:00 UTC 2024 |