| Hadoop PySpark Technical Lead at Pittsburgh, Pennsylvania, USA |
| Email: [email protected] |
| Hi, Greetings of the day! I have an urgent requirement below, please go through JD and let me know if you are comfortable or have any profile. Kindly revert me back with your updated resume as well. Job Title: Hadoop PySpark Technical Lead Location: Pittsburgh, PA (Work from Office) Duration: Long Term Contract Qualifications: Experience level : 10+ years Skill set- Cloudera Data Platform , PySpark, python ,Hive-Map Reduce, Linux /Unix, Impala , Big Data Technologies, Cloud Technologies Roles and responsibilities: Understand requirements/use cases and build efficient ETL solutions using Apache Spark, python, Kafka, Hive targeting Cloudera Data Platform Requirement/use case analysis and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates. Work closely with Data analyst/modeler, Business User to understand the data requirement. Convert requirements to high-level , low-level design and, source-to- target documents. Responsible to design , develop and schedule data pipelines which handle large volume of data within SLA. Work with solution architect, Technical Managers, Admins to understand SLAs, limitations of systems and provide efficient solutions. Expertise in processing large volume of data aggregation using spark , must know different performance improvement technique and should lead teams on optimization. Responsible to develop efficient data ingestion and data governance framework as per specification. Performance improvement of existing spark-based data ingestion, aggregation pipelines to meet SLA. Work proactively, independently with global teams to address project requirements, articulate issues/challenges with enough lead time to address project delivery risks. Plan production implementation activities , execute change requests and resolve issues in production implementation. Plan and execute large data migration, history data rebuild activities Code reviews/optimization, test case reviews . Demonstrate troubleshooting skill in resolving technical issues, bugs. Demonstrate ownership and initiative. Ability to bring-in best practices /solutions which best fit for client problem and environment. Thanks & Regards, Pradeep Sharma Email: [email protected] "Scalable Systems is an Equal Opportunity Employer. We are committed to creating an inclusive environment for all employees and do not discriminate based on race, color, religion, sex, national origin, age, disability, or any other legally protected status." Keywords: golang Pennsylvania Hadoop PySpark Technical Lead [email protected] |
| [email protected] View all |
| Wed Oct 23 20:16:00 UTC 2024 |