| ETL or Pyspark or Big Data Engineer at NYC NY at NYC, New York, USA |
| Email: [email protected] |
| From: PAVAN, vdart inc [email protected] Reply to: [email protected] Job title: ETL / Pyspark / Big Data Engineer Location: NYC, NY Full time Need onsite Job Description: Preparing HLD and LLD document with ETL methodology transformation rules for data pipelines. Extensive experience on Spark, PySpark and Hive SQL Scripts. Knowledge on Sqoop and Impala Involves in build and unit test of data pipeline ETL's. Provide support and bug fixes during trial validation runs and UAT. Performs ETL code packaging, sequencing and validations of same SIT and UAT support. Conduct code reviews and provide improvement guidelines Extensive experience on Spark, PySpark and Hive SQL Scripts. Coding and development, unit test the ETL code changed/developed. Provide support and bug fixes during trial validation runs and UAT. Performs ETL code packaging, sequencing and validations of same. Involves peer review of ETL code artifacts. Support for Production Deployment Participate in Unit and System Testing and approve deliverable Regards Pavan VDart Inc Ph: (470) 251-2584 Ext:1866 Email: [email protected] Website: https://vdart.com Confidentiality Notice The information contained in this message may be privileged and confidential and protected from disclosure. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer |
| [email protected] View all |
| Wed Nov 02 23:59:00 UTC 2022 |