| Need Senior Python Lead with AWS and PySpark at Charlotte, North Carolina, USA |
| Email: [email protected] |
| From: ayush, Scalable Systems [email protected] Reply to: [email protected] Senior Python Lead with AWS and PySpark Location: Charlotte, NC / Malvern, PA Experience: 10+ years overall, 4+ years as lead Compensation: Competitive salary + benefitsJob Description We are seeking a highly skilled and experienced Senior Python Developer to join our team and contribute to a critical project involving the processing of large datasets. In this role, you will be responsible for developing scalable code and endpoints to handle massive data volumes using Python, SQL, and AWS tools. Key Responsibilities: Develop Scalable Solutions: Design, develop, and implement scalable code and endpoints to efficiently process and analyze large datasets using Python, SQL, and AWS technologies. Leverage AWS: Utilize AWS resources and best practices for distributed computing, scalable run-time processing, and CI/CD to optimize performance and reliability. Data Engineering: Write complex parallel streams and filters to refine data for effective client search, ensuring accurate and relevant results. Business Alignment: Understand the business context, customer journey, and project goals to deliver solutions that drive business value. Technical Leadership: Provide technical guidance, mentorship, and support to team members. Production Support: Maintain and support the production environment to ensure system uptime and performance. Required Skills and Experience: Python Proficiency: Strong programming skills in Python, including extensive experience with libraries and frameworks. PySpark Expertise: Proven hands-on experience with PySpark for large-scale data processing. AWS Mastery: Deep knowledge of AWS services, including S3, EC2, DynamoDB, SNS, SQS, CloudWatch, and Lambda. SQL Proficiency: Strong SQL skills for data manipulation and analysis. ETL Experience: Proven experience with ETL (Extract, Transform, Load) processes. DevOps and CI/CD: Hands-on experience with DevOps practices, version control (Git, SVN), and CI/CD pipelines. Problem Solving: Ability to analyze complex problems, develop innovative solutions, and implement them effectively. Communication: Excellent communication and collaboration skills to work effectively with cross-functional teams. Preferred Qualifications: Experience with OpenSearch, FastAPI, Docker, Airflow, and Terraform. Mainframe experience. Experience with data visualization tools. If you are a passionate Python developer with a strong background in AWS and PySpark, we encourage you to apply! Keywords: Python, PySpark, AWS, AWS Glue, ETL, data engineering, cloud computing, distributed computing, CI/CD, SQL, data analysis, problem solving, technical leadership. Keywords: continuous integration continuous deployment sthree North Carolina Pennsylvania Need Senior Python Lead with AWS and PySpark [email protected] |
| [email protected] View all |
| Wed Jul 31 01:38:00 UTC 2024 |