| Python Developer with PySpark Expertise || Wilmington DE, / Plano TX || Long-Term Contract at Wilmington, Delaware, USA |
| Email: [email protected] |
| Hi, Hope you are doing great. I have the below urgent requirement with my Global consulting partner. Please have a look at the below-mentioned detailed Job description and let me know your interest at your earliest. H1B only || PPN Must || Locals Only || Must have 10+ years of experience Role: Python Developer with PySpark Expertise Location: Wilmington DE, / Plano TX Job Type: Long-Term Contract Note: its an onsite role Job Description: We are seeking a highly skilled Python Developer with strong expertise in PySpark to join our dynamic team. The ideal candidate will have a deep understanding of Python programming, Big Data processing, and distributed computing using Apache Spark. This role involves designing, developing, and optimizing data processing pipelines and working closely with data engineers, data scientists, and other stakeholders to deliver high-quality, scalable solutions. Key Responsibilities: Design, develop, and maintain scalable data processing pipelines using Python and PySpark. Collaborate with data engineers and data scientists to integrate and process large datasets. Optimize and tune PySpark jobs for performance and efficiency. Work with various data sources (e.g., Hadoop, S3, databases) and formats (e.g., Parquet, Avro, JSON). Implement best practices for data processing, including code reviews, testing, and documentation. Troubleshoot and resolve issues related to PySpark jobs and data pipelines. Contribute to the overall architecture and design of the data processing platform. Stay updated with the latest trends and advancements in Big Data technologies. Required Skills and Qualifications: Bachelors degree in Computer Science, Engineering, or a related field (or equivalent experience). Strong proficiency in Python programming language. Extensive experience with PySpark and Apache Spark. Solid understanding of distributed computing concepts and Big Data processing. Experience with Hadoop ecosystem, including HDFS, Hive, and HBase. Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their Big Data services. Experience with data serialization formats like Parquet, Avro, and JSON. Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment. Excellent communication skills and ability to work effectively in a team. Preferred Qualifications: Experience with other Big Data tools such as Kafka, Flink, or Storm. Knowledge of CI/CD pipelines and DevOps practices. Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes. Experience with version control systems like Git. www.compunnel.com Mohd Anas Senior Recruiter e: [email protected] o: (+1) 609-606-9010 ext.1774 m: (+1) 609-779-1219 103 Morgan Lane, Ste. 102 Plainsboro, NJ 08536, USA. [We are an E-Verify and Equal Employment Opportunity Employer with adherence to EEO policy] Disclaimer: This message is intended solely for the addressee. It is confidential and may be legally privileged. Unauthorized use is strictly prohibited and may be unlawful. If you have received this message by mistake, please return the email to the sender by way of notification and immediately delete it from your computer. -- Keywords: continuous integration continuous deployment sthree information technology Delaware New Jersey Texas Python Developer with PySpark Expertise || Wilmington DE, / Plano TX || Long-Term Contract [email protected] |
| [email protected] View all |
| Wed Aug 28 21:35:00 UTC 2024 |