Need Bigdata Developer in Dallas, TX or Reston, VA at Dallas, Texas, USA |
Email: [email protected] |
From: Sumit Kumar, Siri InfoSolutions Inc [email protected] Reply to: [email protected] Role: Bigdata Developer with Pyspark Location: Dallas, TX / Reston, VA (onsite) Type: Contract Rate: $45-48/hr on c2c Responsibilities Design, develop, and maintain PySpark jobs for data ingestion, transformation, and analysis Work with large and complex datasets to extract, clean, and transform data for various analytical purposes Optimize PySpark applications for performance and scalability Develop unit tests for Spark transformations and helper methods Work with data scientists and business analysts to understand data requirements and translate them into technical solutions Configure and manage PySpark environments on distributed computing clusters (e.g., YARN, Mesos) Experience with cloud platforms (AWS, GCP, Azure) a plus Experience with CI/CD pipelines for deploying Spark applications a plus Qualifications 3+ years of experience in Big Data Strong proficiency in Python and PySpark Solid understanding of distributed computing concepts (MapReduce, Spark) Experience with Apache Spark ecosystem (SQL, Streaming, MLlib) Excellent problem-solving and analytical skills Strong communication and collaboration skills Thanks and Regards, Sumit Kumar Phone: +1 732 645 8383 : [email protected], URL: www.siriinfo.com Siri InfoSolutions Inc. 3 Ethel Rd, Suite # 302, Edison NJ 08817 Disclaimer: We respect your online privacy. If you would like to be removed from our mailing list please reply with "Remove" in the subject and we will comply immediately. We apologize for any inconvenience caused. Please let us know if you have more than one domain. The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient, be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. We are an equal opportunity employer with a diverse workforce. Note : Any resume submitted by Siriinfo is presented with the understanding that the candidate is being considered for your direct end-client (end-client is the company where the work will be performed). If there is any other company involved between the end-client and your company, please do not submit this resume without our written approval. If you submit the resume to another third party, Siriinfo reserves the right to work with the third party directly. Keywords: continuous integration continuous deployment information technology New Jersey Texas Virginia Need Bigdata Developer in Dallas, TX or Reston, VA [email protected] |
[email protected] View all |
Tue Jul 02 02:46:00 UTC 2024 |