| Data Engineer || Scottsdale, AZ (Locals to Arizona only /Onsite) at Scottsdale, Arizona, USA |
| Email: [email protected] |
| Hi, Hope you are doing great! We have an urgent requirement open fo r " Data Engineer " position with one of our CLIENT AT Scottsdale, AZ (Onsite) Please mention the CURRENT LOCATION and VISA of the consultant while sharing the resume Position : Data Engineer Location : Scottsdale, AZ (Onsite) Duration: Long term contract Job Description: JOB SUMMARY PRINCIPAL DUTIES A solid experience and understanding of considerations for large scale solutioning and operationalization of data warehouses data lakes and analytics platforms on GCP is a must Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times Design build and test scalable data ingestion pipelines perform end to end automation of ETL process for various datasets that are being ingested Determine best way to extract application telemetry data structure it send to proper tool for reporting Kafka Splunk Handson experience with data cataloging metadata management tools Collibra Dataplex Alation Create reports to monitor usage data for billing and SLA tracking Work with business and cross functional teams to gather and document requirements to meet business needs Provide support as required to ensure the availability and performance of ETLELT jobs Provide technical assistance and cross training to business and internal team members Collaborate with business partners for continuous improvement opportunities Requirements JOB SPECIFICATIONS Education Bachelors Degree in Computer Science Information Technology Engineering or related field Experience Skills Qualifications: 6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics 4 years of experience with one of the leading public clouds 4 years of experience in design and build of salable data pipelines that deal with extraction transformation and loading 4 years of experience with Python with working knowledge on Notebooks 2 years of experience with Kafka PubSub Docker Kubernetes 2 years hands on experience on GCP Cloud data implementation projects Dataflow DataProc Cloud Composer Big Query Cloud Storage GKE Airflow etc At least 2 years of experience in Data governance and Metadata Management Ability to work independently solve problems update the stakeholders Analyze design develop and deploy solutions as per business requirements Strong understanding of relational and dimensional data modeling Experience in DevOps and CICD related technologies Excellent written verbal communication skills including experience in technical documentation and ability to communicate with senior business managers and executives -- Keywords: rlang information technology wtwo Arizona Data Engineer || Scottsdale, AZ (Locals to Arizona only /Onsite) [email protected] |
| [email protected] View all |
| Tue Nov 05 21:22:00 UTC 2024 |