| Immediate need Python PySpark Data Lake Engineer - Day 1 Onsite in San Francisco, CA 94111 at Francisco, Indiana, USA |
| Email: [email protected] |
| From: Shobhana Kulhade, Sydata Inc [email protected] Reply to: [email protected] Immediate need Python PySpark Data Lake Engineer - Day 1 Onsite in San Francisco, CA 94111 Python PySpark Data Lake Engineer - Day 1 Onsite San Francisco, CA 94111 06-12 Months Rate: $55/hr on C2C Responsibilities Develop and maintain scalable data pipelines and build out new integrations to support continuing increases in data volume. Design, develop and maintain Python, PySpark and SQL based Data Platform including DataLake and Analytics Data Warehouse etc. Build and maintain scalable ELT/ETL workflows to transform and integrate data into Data Platform. Perform in all parts of the software development lifecycle (e.g., coding, testing, development). Monitor and support production data pipelines if required Resolve any defects or raise support tickets to third party vendor. Performs other related duties, as assigned. Embody the values and passions that characterize Levi Strauss & Co., with empathy to engage with colleagues from a wide range of backgrounds Minimum Qualifications: Strong experience working with a variety of relational SQL and NoSQL databases Experience with at least one cloud provider solution (AWS, GCP, Azure) Strong experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. Ability to work in Linux environment & familiarity with Data as a Service (APIs) Strong knowledge of data pipeline and workflow management tools (Airflow, Cron preferred) Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation Experience creating ETL processes that prepare data for consumption appropriately Experience in setting up, maintaining and optimizing databases for production usage in reporting, analysis and ML applications Working in a collaborative environment and interacting effectively with technical and non-technical team members equally well Relevant working experience with Docker and Kubernetes preferred Ability to work with ML frameworks preferred Thanks & Regards: Shobhana Kulhade Sr. IT Recruiter Sydata Inc Email: [email protected] 6494 Weathers Place Suite#100 San Diego, California, 92121 Website: www.sydatainc.com Notice: This email contains confidential or proprietary information which may be legally privileged. It is intended only for the named recipient (s). If an addressing or transmission error has misdirected the email, please notify the author by replying to this message by "REMOVE" Keywords: cplusplus machine learning information technology California Colorado |
| [email protected] View all |
| Tue Aug 15 20:51:00 UTC 2023 |