| Need - Data Engineer Lead - remote at Remote, Remote, USA |
| Email: [email protected] |
| From: pradeep, shrive technologies [email protected] Reply to: [email protected] Role : Lead Data Engineer Location : Rosemont, IL ( Remote ) EXP : 10 + Must Have: AWS Platform Snowflake ETL Tools - Informatica Power center Required; Informatica IICS, Fivetran, Dbt labs, AWS Airflow Nice to have Python, SQL Required Job Description : Cloud Technologies - AWS services like Lambda, SQS/SNS, EMR, Cloud watch, RDS. EKS Compute Technologies Spark/Hadoop Streaming Technologies Kafka, AWS Kinesis API Technologies MuleSoft, AWS Gateway API CI/CD Atlassian Bitbucket and Bamboo Build tools - Apache ANT and Mav Lead data warehouse development activities for a team, leading more than one project in parallel. Assign data warehouse development tasks to team of 1-6 developers (Onsite/Offshore). Be a subject-matter expert (SME) in Data Warehouse domain and relevant business function. Work with minimal supervision and provide status updates and escalation to leadership as appropriate. Provides application support as part of an on-call rotation to work on resolving outages and user questions. Review project objectives and determine best technology to apply. Design and build large scale datasets for a wide range of consumer needs. Build, test and implement highly efficient data pipelines using a variety of technologies. Develop best practice standards for solution design and data structures. Analyze new data sources to understand quality, availability, and content. Write technical design documentation. Conducts peer code reviews. Create and executes unit tests. Supports QA team during testing. Mentor less experienced members of the development team. Knowledge/Skills/Abilities: Experience overseeing other developers. Proven ability to model data for reporting and analytics needs. Proven ability to design and implement applications using best practices. Proven ability to analyze and understand existing processes and code. Works and communicates effectively with all levels of management. Excellent written, verbal, and people skills. Must work well within team-oriented environments. Proven ability to work in Agile development methodology. Keywords: continuous integration continuous deployment quality analyst |
| [email protected] View all |
| Tue Dec 13 15:59:00 UTC 2022 |