| Python PySpark Developer - Pittsburgh, PA - Fulltime Role at Pittsburgh, Pennsylvania, USA |
| Email: [email protected] |
| From: Nora West, W3Global [email protected] Reply to: [email protected] Hello, Job Title: Python PySpark Developer - FullTime role Location: Pittsburgh, PA Experience require 8+ years Job Description 4+ years working experience in data integration and pipeline development. 2+ years of Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems Strong real-life experience in python development especially in pySpark in AWS Cloud environment. Design, develop test, deploy, maintain and improve data integration pipeline. Experience in Python and common python libraries. Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc. Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools. Databricks or Apache Spark Experience is a plus. Responsibilities Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate enterprise systems in our Enterprise Data Platform. Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities. Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts. Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements. -- Thanks & Regards, Nora West Recruiter E: [email protected] LinkedIn : https://www.linkedin.com/in/j-pooja-nora-west-609474191/ US: 1701 Legacy Dr, Suite#1000, Frisco, Texas - 75034 CA: 18 King Street East, Suite 1400 Toronto, ON M5C 1C4 Keywords: sthree California Pennsylvania Python PySpark Developer - Pittsburgh, PA - Fulltime Role [email protected] |
| [email protected] View all |
| Sat Aug 24 01:06:00 UTC 2024 |