Lead Data Engineer at Los Angeles CA onsite role at Remote, Remote, USA |
Email: [email protected] |
From: Kumar, GB Tech Inc [email protected] Reply to: [email protected] Hi All, Immediate Hire Please share the resume for below requirement, Submit only 10 years with lead experience resumes The role will collaborate with a cross-functional team to provide data solutions with engineering, marketing, merchandising, and executive teams. * Contribute to technology selection and strategy for big data solutions * Build, test, and operate stable, scalable data pipelines that cleanse, structure, and integrate disparate data sets into a readable and accessible format for end-user-facing reports, data sciences, and ad-hoc analyses * Create data pipelines to handle data ingestion in a way that is both rapidly available and fault tolerant * Support AI/Machine Learning Initiatives to drive value for consumers and internal stakeholders * Review and contribute to technical documentation * Knowledge sharing and coaching * Lead the onboarding of new data engineers Required : * Bachelors degree in Computer Science, Engineering, or a related technical field (Or equivalent knowledge/experience) * A minimum of 5 years of Object Oriented Programming (OOP) and/or functional programming experience/education * Familiarity with Cloud Big Data Solutions (EMR, Redshift, Big Query, Azure Data Pipelines, Azure Datawarehouse, etc.) * Familiarity with Apache Suite for Big Data Architecture (Spark, Akka, Cassandra, Kafka) * Strong experience in data engineering and data pipeline development in a cloud-based environment, preferably using services such as FiveTran, AWS Glue, and Redshift Spectrum. * Knowledge of Python programming language * Familiarity with Lambda Architecture concepts and tooling options * Proficiency in SQL and experience working with relational databases and data warehousing concepts. * Hands-on experience with dbt (Data Build Tool) or similar data transformation and engineering tools. * Familiarity with data governance, data security, and compliance practices. * Solid understanding of data modeling and database design principles. * Experience with performance tuning and optimization of data pipelines and database queries. * Ability to thrive in a fast-paced environment and master frequently changing technologies and techniques Keywords: artificial intelligence active directory |
[email protected] View all |
Tue Aug 22 19:29:00 UTC 2023 |