| PySpark Developers - Capital One at Remote, Remote, USA |
| Email: [email protected] |
| Job Title: PySpark Developer (AWS) Location: Richmond, VA or McLean, VA (Hybrid) Client: CapitalOne Rate: $50/hr on c2c Experience Level: 5+ years (flexible) Role Overview: We are seeking a skilled PySpark Developer with experience in AWS to work on a large-scale regulatory reporting application. This application supports seven regulatory reporting use cases, which for other banks would typically require seven separate applications due to the scale. The role involves pulling data from all systems across the organization, performing large transformations, and preparing regulatory reports for daily submission to the Federal Reserve. Key Responsibilities: Data Engineering & Pipelines: Develop and maintain robust PySpark pipelines, handling the full lifecycle of data pipelining. Code Quality & Testing: Write high-quality code with a focus on test automation, achieving 99.5% test coverage for the application. Developers must be capable of writing their own unit tests. Regulatory Reporting: Work on a critical downstream application that supports multiple regulatory reporting use cases, involving significant data transformation. Collaboration: Collaborate with team members during the 45-minute live coding and problem-solving interview. Technical Requirements: Core Skills: Strong data engineering skills. Proficiency in PySpark for data pipelining. Experience in writing clean, efficient, and maintainable code. AWS Expertise: Experience with AWS services, particularly EMR and Hadoop. Testing: Ability to write comprehensive unit tests with a focus on high test coverage (99.5%). Nice to Have: Experience with Databricks. Interview Process: One-step interview with two team members, involving 45 minutes of live coding and problem-solving. -- Keywords: information technology Virginia PySpark Developers - Capital One [email protected] |
| [email protected] View all |
| Thu Aug 29 02:45:00 UTC 2024 |