| Urgent requirements of Lead And Sr. Data Engineer remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Sumit katiyar, Technocraft solution [email protected] Reply to: [email protected] Lead Data Engineer Long term Location: Remote USA Project description As a Lead Data Engineer, you will lead design and development of enhanced data services and cloud enablement for Data and Services. You will push the limits of the state of the art with best-in-class data product enablement in the cloud and will design the roadmap develop data & analytics solutions that sit atop vast datasets. Your will enable a frictionless customer and developer experience, exposing data components for direct to customer use or as components for new product constructs. You will have the opportunity to create high performance analytic and ML solutions based on data sets measured in the billions of transactions and front-end visualizations to unleash the value of big data. Responsibilities As the Lead Data Engineer, you will: Lead the design of new data capabilities and infrastructure related to accessing and using MA, third party, and partner data to power Mastercard data products and solutions. Design required new data pipes, data transfers, and compliance related infrastructure to enable that use of the data in the cloud. Identify data-related capabilities and infrastructure requirements resulting from new and evolving product constructs and how those requirements can be developed cloud natively. Understand the Data and Services business strategy, information infrastructure and data needs for both new and existing products and services across various product initiatives. Collaborate with relevant data management, data governance and technical teams to enable long term viability of information assets and enterprise requirements. Develop a horizontal technology roadmap in conjunction with Data Strategy & Management team input to enable technology solutions for managing data that meet the needs of multiple business stakeholder groups. Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation. Skills Must have Hands-on experience with technologies such as Python, Databricks, AWS, Java, Pyspark, Spark, Kafka, and SQL. You are curious about and motivated by the future trends in data, AI/ML, analytics, and digital experience Experience in data product development, analytical models, and model governance Experience in anonymizing data and managing the use of data Experience in data hygiene procedures, identity resolution capabilities or data management a plus Exceptional interpersonal skills with proven experience in relationship building and partnering. Must work well in both team and individual settings and must be able to work with a geographically dispersed team. Strong analytic capabilities and written and oral communication skills. Attention to detail is a must. Strong project management skills and a demonstrated ability to understand complex information product constructs Familiarity with industry best practices for collection and use of data Motivated self-starter with ability to excel at multi-tasking in a fast-paced environment, outstanding English written and verbal communication skills Nice to have Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts Experience in working with Cloud APIs (e.g., Azure, AWS) Experience participating in complex engineering projects in an Agile setting, e.g. Scrum 2. Sr data engineer Long term Remote Project description We are seeking a talented and motivated Senior Data Engineer to join our data engineering team. In this role, you will play a critical part in designing, developing, and optimizing data pipelines and solutions that enable efficient data processing and analysis. As a Senior Data Engineer, you will collaborate with cross-functional teams to drive data-driven decision-making and contribute to the continuous improvement of our data infrastructure. Responsibilities Role: Design, develop, and maintain new data capabilities and infrastructure for utilizing Mastercard, third-party, and partner data to enhance Mastercard's data products and solutions Create new data pipelines, data transfers, and compliance-oriented infrastructure to facilitate seamless data utilization within cloud environments Identify existing data capability and infrastructure gaps or opportunities within and across initiatives and provide subject matter expertise in support of remediation Collaborate with technical team and business stakeholders to understand data requirements and translate them into technical solutions Work with large datasets, ensuring data quality, accuracy, and performance Implement data transformation, integration, and validation processes to support analytics and reporting needs Optimize and fine-tune data pipelines for improved speed, reliability, and efficiency Implement best practices for data storage, retrieval, and archival to ensure data accessibility and security Troubleshoot and resolve data-related issues, collaborating with the team to identify root causes Document data processes, data lineage, and technical specifications for future reference Participate in code reviews, ensuring adherence to coding standards and best practices Collaborate with DevOps teams to automate deployment and monitoring of data pipelines Additional tasks as required Skills Must have Bachelor's or Master's degree in Computer Science, Engineering, or a related field Proven experience in data engineering, with a strong track record of designing and implementing data solutions Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks (Spark, Hadoop, etc.) In-depth understanding of data warehousing concepts, cloud platforms (AWS, Azure, GCP), and data modeling techniques Strong knowledge of SQL and NoSQL databases, as well as data integration and transformation tools Passion for and engagement with emerging trends in data, AI/ML, analytics, and digital experiences Experience in data product development, analytical models, and model governance Experience in anonymizing data and managing the use of data Experience in data hygiene procedures, identity resolution capabilities or data management a plus Ability to create strategies and plans that define how information can be utilized to support an organization's overall business strategy, and how that information and data is organized, and governed inside an organization Strong project management skills and a demonstrated ability to understand complex information product constructs Familiarity with industry best practices for collection and use of data Outstanding problem-solving skills and the ability to navigate complex data challenges Effective communication and collaboration skills to work with both technical and non-technical stakeholders Experience with agile methodologies and DevOps practices Nice to have Experience with performance Tuning of Database Schemas, Databases, SQL, ETL Jobs, and related scripts Experience in working with Cloud APIs (e.g., Azure, AWS) Experience participating in complex engineering projects in an Agile setting e.g. Scrum Regards Sumit Katiyar Recruiting Manager Technocraft Solutions LLC. [email protected] Keywords: artificial intelligence machine learning Massachusetts Urgent requirements of Lead And Sr. Data Engineer remote [email protected] |
| [email protected] View all |
| Tue Sep 10 19:48:00 UTC 2024 |