| Lead Data Engineer - Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Sandeep, msys inc [email protected] Reply to: [email protected] Title: Lead Data Engineer - Remote Location: Remote Length: Long term Restriction: W2 or C2C Send resume to: [email protected] Description: **** Webcam interview; *** Long term project *** Initial remote due to covid then onsite Job Description: Our client is looking for a Lead Data Engineer who is enthusiastic about developing high-quality software solutions within an agile environment. Your role will involve designing, building, and maintaining scalable data pipelines and architectures that adhere to clean code principles and company standards. You should excel in analyzing data requirements, crafting robust solutions, and implementing systems to fulfill business needs. A deep understanding of the Software Development Life Cycle (SDLC) is essential, alongside the ability to navigate complex data ecosystems and dependencies. Your performance as a Lead Data Engineer will directly impact the data infrastructure and solutions delivered by the customer. If you are a graduate with 8-10 years of professional experience, eager to advance your career in solving data engineering challenges within a rapidly growing software and services company that offers a dynamic work environment, we encourage you to apply. Your Key Accountabilities: Participate in Sprint planning and day to day Sprint task assignment. Leading team of Developers on all the SDLC stages. Good troubleshooting skills with use of Code/Logs Insights tools. Participate in daily scrum. Contribute to technical design artifacts. Identifying areas for code refactoring in existing programs and fine tuning the code. R&D on new features and technical innovations. Participate in Sprint reviews/customer demos. Train junior developers with technical skills and mentor them. Provide regular status updates to Managers and Stakeholders. Skills: An ideal candidate should have a good academic background with 8-10 years of overall experience with at least 3+ years in a leadership role. Experience in managing big data projects using Azure Data Factory, Azure Data Lake Storage, Azure Databricks etc. Preference for knowledge / experience in Azure DevOps, CI/CD process. Preference for experience in ETL/ELT data technologies. Preference for experience in product development and product implementation for multiple customers. Knowledge of machine learning concepts and experience with integrating ML models into data pipelines. Strong project management experience in either Data projects or Insurance domain across all phases of SDLC. Strong experience in Agile methodology (Scrum Framework). Strong analytical and problem-solving skills. Strong experience working in a customer facing role. Excellent verbal and written communication skills. Must have managed medium-large sized teams with diverse skillset and experience groups. Domain exposure in P&C Insurance. Good to have. Primary Skill: Experience: 10+ Years Databricks, PySpark, Data Factory, Azure Data Lake Storage, SQL, XML/JSON, SparkSQL, Azure Synapse/Azure SQL Data Warehouse Secondary Skill: COSMOS DB, Power BI Keywords: cprogramm continuous integration continuous deployment machine learning business intelligence database rlang wtwo Lead Data Engineer - Remote [email protected] |
| [email protected] View all |
| Fri Jul 12 03:34:00 UTC 2024 |