| Immediate need Python PySpark Big Data Engineer in Atlanta, GA 30308 at Atlanta, Georgia, USA |
| Email: [email protected] |
| From: Shobhana Kulhade, Sydata Inc [email protected] Reply to: [email protected] Immediate need Python PySpark Big Data Engineer in Atlanta, GA 30308 Python PySpark Big Data Engineer Atlanta, GA 30308 06 Months Rate: $55/hr on C2C Do you have a preferred interview schedule: 8AM EST to 12 PM EST Performance Expectations: Making sure all deliverables are on time as estimated with good quality and less rework. Implementing custom automation solutions. Technical Hiring Criteria (Must Haves) Top 3 Required skills: Pyspark, Kafka, Spark streaming, Unix scripting. Years of experience in each of the must-have skills: 4+ years of experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming Must have Big Data engineering experience and must demonstrate an affinity for working with others to create successful solutions. Will work on NS Big Data Platforms (Cloudera). Must be a very good communicator, and have some experience working with business areas to translate their business data needs and data questions into project requirements. Will participate in all phases of the Data Engineering life cycle and will independently and collaboratively write project requirements, architect solutions and perform data ingestion development and support duties. Deep knowledge of troubleshooting and tuning spark applications, Spark streaming jobs and improving performance. Hands on experience in writing Spark jobs and Spark streaming jobs using Python or Scala. Hands on experience on fetching the live stream data(Low to High frequency) from different sources(like files,XML,JSON,CSV,database,logs) using Spark Streaming and Apache Kafka Knowledge of Unix/Linux platform and shell scripting is a must Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka Experience with data ingestion from Message Queues (Tibco, IBM, etc.) and different file formats across different platforms like JSON, XML, CSV Must have Big Data engineering experience and must demonstrate an affinity for working with others to create successful solutions Must be a very good communicator, and have some experience working with business areas to translate their business data needs and data questions into project requirements. will participate in all phases of the Data Engineering life cycle and will independently and collaboratively write project requirements, architect solutions and perform data ingestion development and support duties Thanks & Regards: Shobhana Kulhade Sr. IT Recruiter Sydata Inc Email: [email protected] 6494 Weathers Place Suite#100 San Diego, California, 92121 Website: www.sydatainc.com Notice: This email contains confidential or proprietary information which may be legally privileged. It is intended only for the named recipient (s). If an addressing or transmission error has misdirected the email, please notify the author by replying to this message by "REMOVE" Keywords: information technology Georgia |
| [email protected] View all |
| Mon Aug 21 19:24:00 UTC 2023 |