| Lead Data Engineer - Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Srikanth, Shrive Technologies [email protected] Reply to: [email protected] Role: Lead Data Engineer Remote Must Have: AWS Platform Snowflake ETL Tools - Informatica Power center Required; Informatica IICS, Fivetran, Dbt labs, AWS Airflow Nice to have Python, SQL Required Familiarity with: Cloud Technologies - AWS services like Lambda, SQS/SNS, EMR, Cloud watch, RDS. EKS Compute Technologies Spark/Hadoop Streaming Technologies Kafka, AWS Kinesis API Technologies MuleSoft, AWS Gateway API CI/CD Atlassian Bitbucket and Bamboo Build tools - Apache ANT and Maven RESPONSIBILITIES: Lead data warehouse development activities for a team, leading more than one project in parallel. Assign data warehouse development tasks to team of 1-6 developers (Onsite/Offshore). Be a subject-matter expert (SME) in Data Warehouse domain and relevant business function. Work with minimal supervision and provide status updates and escalation to leadership as appropriate. Provides application support as part of an on-call rotation to work on resolving outages and user questions. Review project objectives and determine best technology to apply. Design and build large scale datasets for a wide range of consumer needs. Build, test and implement highly efficient data pipelines using a variety of technologies. Develop best practice standards for solution design and data structures. Analyze new data sources to understand quality, availability, and content. Write technical design documentation. Conducts peer code reviews. Create and executes unit tests. Supports QA team during testing. Mentor less experienced members of the development team. Keywords: continuous integration continuous deployment quality analyst |
| [email protected] View all |
| Tue Dec 13 00:37:00 UTC 2022 |