| Data Engineer min 12 + at Remote, Remote, USA |
| Email: [email protected] |
| From: Dinesh, sktecinc [email protected] Reply to: [email protected] Job role ; Data Engineer min 12 + Location : LA , CA Job description ; The role will collaborate with a cross-functional team to provide data solutions with engineering, marketing, merchandising, and executive teams. * Contribute to technology selection and strategy for big data solutions * Build, test, and operate stable, scalable data pipelines that cleanse, structure, and integrate disparate data sets into a readable and accessible format for end-user-facing reports, data sciences, and ad-hoc analyses * Create data pipelines to handle data ingestion in a way that is both rapidly available and fault tolerant * Support AI/Machine Learning Initiatives to drive value for consumers and internal stakeholders * Review and contribute to technical documentation * Knowledge sharing and coaching * Lead the onboarding of new data engineers Required : * Bachelors degree in Computer Science, Engineering, or a related technical field (Or equivalent knowledge/experience) * A minimum of 5 years of Object Oriented Programming (OOP) and/or functional programming experience/education * Familiarity with Cloud Big Data Solutions (EMR, Redshift, Big Query, Azure Data Pipelines, Azure Datawarehouse, etc.) * Familiarity with Apache Suite for Big Data Architecture (Spark, Akka, Cassandra, Kafka) * Strong experience in data engineering and data pipeline development in a cloud-based environment, preferably using services such as FiveTran, AWS Glue, and Redshift Spectrum. * Knowledge of Python programming language * Familiarity with Lambda Architecture concepts and tooling options * Proficiency in SQL and experience working with relational databases and data warehousing concepts. * Hands-on experience with dbt (Data Build Tool) or similar data transformation and engineering tools. * Familiarity with data governance, data security, and compliance practices. * Solid understanding of data modeling and database design principles. * Experience with performance tuning and optimization of data pipelines and database queries. * Ability to thrive in a fast-paced environment and master frequently changing technologies and techniques -- -- Thanks & Regards.. Dinesh Sr. IT Recruiter SK Tech [email protected] Keywords: artificial intelligence active directory information technology California Louisiana |
| [email protected] View all |
| Mon Aug 21 23:59:00 UTC 2023 |