| GCP Data Engineer || Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Shubham, USC Group [email protected] Reply to: [email protected] Title: Data Engineer (With Strong GCP) Location: Remote Experience: 8 years Primary skills- Python, SQL Coding skills, Big Query, Dataflow, Pyspark, Airflow, Kafka Job Description: 5+ years experience as a data warehouse engineer/architect designing and deploying data systems in a startup environment Mastery of database and data warehouse methodologies and techniques from transactional databases to dimensional data modeling, to wide deformalized data marts Deep understanding of SQL-based Big Data systems and experience with modern ETL tools Expertise in designing data warehouses using Google Big Query Experience developing data pipelines in Python Firm believer of data driven decision making, and extensive experience developing for high/elastic scalable, 24x7x365 high availability digital marketing or ecommerce systems Hands-on experience with data compute, storage, and security components and using Cloud Platform (preferably GCP) provided Big Data technologies Hands-on experience with real time streaming processing as well as high volume batch processing, and skilled in Advanced SQL, GCP BigQuery, Apache Kafka, Data-Lakes, etc. Hands-on Experience in Big Data technologies - Hadoop, Hive and Spark, and in an enterprise-scale Customer Data Platform (CDP) Experience in at least one programming language (Python strongly preferred), cloud computing platforms (e.g., GCP), big data tools such as Spark/PySpark, columnar datastores (BigQuery preferred), DevOps processes/tooling (CI/CD, GitHub Actions), infrastructure as code frameworks (Terraform), BI Tools (e.g. DOMO, Tableau, Looker,), pipeline orchestration (eg. Airflow) Fluency in data science/machine learning basics (model types, data prep, training process, etc.) Experience using version control systems (Git strongly preferred) Experience with data governance and data security Strong analytical, problem solving and interpersonal skills, have a hunger to learn, and the ability to operate in a self-guided manner in a fast-paced rapidly changing environment Keywords: continuous integration continuous deployment business intelligence |
| [email protected] View all |
| Wed Jan 31 20:43:00 UTC 2024 |