| Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Himanshu, Innovyt [email protected] Reply to: [email protected] Position :: Data Engineer Location :: Remote Duration :: 12 Months+ Key things Python, spark, AWS,Pyspark Years exp 13-15+ Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability Provide technical support and usage guidance to the users of our platforms services. Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services. Qualifications Experience building and optimizing data pipelines in a distributed environment Experience supporting and working with cross-functional teams Proficiency working in Linux environment 4+ years of advanced working knowledge of SQL, Python, and PySpark 2+ years of experience with using a broad range of AWS technologies Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline Experience with platform monitoring and alerts tools Keywords: |
| [email protected] View all |
| Mon Oct 02 21:38:00 UTC 2023 |