| Solution Architect with GCP Exp || El Segundo, CA (Remote) at El Segundo, California, USA |
| Email: [email protected] |
| From: Naren, Shrive Technologies [email protected] Reply to: [email protected] Greetings from Shrive Technologies !! Shrive Technologies is an IT Development & IT Staffing firm with more than a decade of experience in providing IT Staffing Solutions & Services. Our expertise is in sourcing and deploying highly skilled IT Specialists into mainstream and niche technologies to meet clients Temporary, Permanent & SOW project needs. Role: Solution Architect with GCP Exp Location: El Segundo, CA (Remote) Duration: Long term Mandatory skills: GBQ, GCP, Python and ETL Job Description: Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (GCP) data sets and building data pipelines. - Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG etc.). - Python Programming Expert PySpark, Pandas - Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling) - Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting and languages (YAML, Python). - Experience in DBT to create the lineage in GCP. Optional - Worked in Dev-Sec-Ops (CICD) environment. - Design and develop the ETL ELT framework using BigQuery, Expertise in Big Query concepts like Nested Queries, Clustering, Partitioning, etc. - Experience in Data Integration, Data Transformation, Data Quality and Data Lineage tools. - Should be able to automate the data load from Big Query using APIs or scripting language. - E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management. - E2E Solution Design skills Prototyping, Usability testing and data visualization literacy. - Experience with SQL and NoSQL modern data stores. Keywords: information technology California Solution Architect with GCP Exp || El Segundo, CA (Remote) [email protected] |
| [email protected] View all |
| Sat Nov 16 02:10:00 UTC 2024 |