| Immediate need Lead Data Engineer with using GCP cloud Platform Remote Role at Remote, Remote, USA |
| Email: [email protected] |
| From: Shobhana Kulhade, Sydata Inc [email protected] Reply to: [email protected] Immediate need Lead Data Engineer with using GCP cloud Platform Remote Role Lead Data Engineer with using GCP cloud Platform. Remote Role 6+ Months Rate $65/hr on C2C Skills: GCP cloud platform GCS, Big Query, Streaming (pub/sub), data proc and data flow Python, PYSpark, Kafka, SQL, shell scripting & Stored procs Data warehouse, distributed data platforms and data lake Database definition, schema design, Looker Views, Models CI/CD pipeline Proven track record in scripting code in Python, PySpark and SQL Job Description : Should have overall 15+ years with Lead skill Ability to design and develop a high performance data pipeline framework from scratch Data ingestion across systems Data quality and curation Data transformation and efficient data storage Data reconciliation, monitoring and controls Support reporting model and other downstream application needs Skill in technical design documentation, data modeling and performance tuning applications Lead and manage a team of data engineers, contribute towards code reviews, and guide the team in designing and developing convoluted data pipelines adhering to the defined standards.Be hands on, performs POCs on the open source licensed tools in the market and share recommendations. Provide technical leadership and contribute to the definition, development, integration, test, documentation and support across multiple platforms (GCP, Python, HANA)Establish a consistent project management framework and develop processes to deliver high quality software, in rapid iterations, for the business partners in multiple geographies Participate in a team that designs, develops, troubleshoots, and debugs software programs for databases, applications, tools etc.Experience in balancing production platform stability, feature delivery and reduction of technical debt across a broad landscape of technologies. Skill in the following platform, tools and technologies GCP cloud platform GCS, Big Query, Streaming (pubsub), data proc and data flow Python, PySpark, Kafka, SQL, shell scripting Stored procs Data warehouse, distributed data platforms and data lake Database definition, schema design, Looker Views, Models CICD pipeline Proven track record in scripting code in Python, PySpark and SQL Excellent structured thinking skills, with the ability to break down multi-dimensional problems Ability to navigate ambiguity and work in a fast-moving environment with multiple stakeholders Good communication skills and ability to coordinate and work with cross functional teams. To be responsible for providing technical guidance to a team of developers, enhancing their technical capabilities and increasing productivity. To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure succeful delivery of complex projects. To ensure process compliance in the assigned module, and participate in technical discussionsorreview as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations). To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure and closure of escalations. Thanks & Regards: Shobhana Kulhade Sr. IT Recruiter Sydata Inc Email: [email protected] 6494 Weathers Place Suite#100 San Diego, California, 92121 Website: www.sydatainc.com Notice: This email contains confidential or proprietary information which may be legally privileged. It is intended only for the named recipient (s). If an addressing or transmission error has misdirected the email, please notify the author by replying to this message by "REMOVE" Keywords: continuous integration continuous deployment information technology Immediate need Lead Data Engineer with using GCP cloud Platform Remote Role [email protected] |
| [email protected] View all |
| Fri Oct 25 21:42:00 UTC 2024 |