| Hot Requirements : Spark Developer Remote EST No GC at Remote, Remote, USA |
| Email: [email protected] |
| From: Princy Jain, Maintec [email protected] Reply to: [email protected] Job Title: Spark Developer Location: Remote (EST Time Zone consultants only) Long Term Position Objective: You will work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for the data and analytics platform that allows users to, access data catalogs, request compute resources, and manage data access controls for an enterprise data and analytics platform Responsibilities: Building, iterating, and testing scalable, resilient back-end capabilities for a cloud-based developer platform that supports data analytics capabilities at scale Support the self-service provisioning capabilities of a large, bring-your-own-data platform that provides high-end data analytics capabilities to a wide variety of technical users (developers, analysts) Participating in Agile processes including daily standups, demos, retrospectives, and sprint planning Working closely with leadership to gather and implement business requirements Working closely with designers and engineers to gather and implement product, front-end, and back-end requirements Providing support, maintenance, and enhancements to the existing application Provide Subject Matter expertise to the user community in best-practices for configuring clusters, designing jobs and controlling costs of data pipelines Guide customer in pricing feature sets based on the user communitys usage patterns and data processing requirements Collaborating with product managers, engineers, and QA on the team to communicate and clarify designs and requirements Requirements Education and Experience: Bachelor's Degree or equivalent in experience in Engineering, Computer Science, or related field 7+ years of experience in software application development, particularly in an agile development environment including but not limited to daily scrum, iteration reviews, Kanban/Lean, continuous integration and test-driven development 3+ years of experience in AWS cloud data architecture Qualifications: 7+ years of software engineering experience 5+ years of experience with Spark processing large datasets and optimizing data pipelines Experience with Node.js, Rust, java Python Experience optimizing cloud costs Deep understanding of APIs, and familiarity with JSON, Web APIs, REST APIs, JSON-RPC, XML-RPC, RESTful practices, and GraphQL Experience with Docker containerization and deployments Experience in relational and non-relational databases like SQL, MySQL, NoSQL, PostgreSQL, MongoDB or similar Experience with benchmarking, monitoring, and performance engineering applications with tools such as Grafana, Sentry, New Relic and Prometheus Knowledge of AuthN and AuthZ systems, including Active Directory, Okta, and AWS IAM Policies/Roles using attribute-based access controls Knowledge of automated end-to-end and unit tests and testing platforms Experience with implementing Observability solutions with platforms such a NewRelic/Dynatrace to implement JVM metrics tracking and python application tracking for microservice applications Experience implementing complex pipelines and solving challenging problems in Github Actions Pipelines, Github Runner provisioning, execution, configuration and upgrade Experience with implementing, managing and streamlining a release process with focus on code quality and code coverage Strong verbal and nonverbal communication skills Strong documentation and problem-solving skills Preferred Qualifications: Databricks Experience preferred Team leadership or product owner experience a plus Experience with Git and DevOps Experience with Kubernetes Some experience with DevOps tools Terraform desired Keywords: quality analyst javascript Hot Requirements : Spark Developer Remote EST No GC [email protected] |
| [email protected] View all |
| Thu Aug 08 01:22:00 UTC 2024 |