| Hiring for Hadoop PySpark Technical Lead || Pittsburgh, PA at Pittsburgh, Pennsylvania, USA |
| Email: [email protected] |
| Job Title: Hadoop PySpark Technical Lead Location: Pittsburgh, PA Duration: Long Term JD: Role Description: Experience level : 10+ yearsSkill set- Cloudera Data Platform , PySpark, python ,Hive-Map Reduce, Linux /Unix, Impala , Big Data Technologies, Cloud TechnologiesRoles and responsibilitiesUnderstand requirements/use cases and build efficient ETL solutions using Apache Spark, python , Kafka, Hive targeting Cloudera Data PlatformRequirement/use case analysis and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates.Work closely with Data analyst/modeler, Business User to understand the data requirement. Convert requirements to high-level , low-level design and, source-to- target documents.Responsible to design , develop and schedule data pipelines which handle large volume of data within SLA. Work with solution architect, Technical Managers, Admins to understand SLAs , limitations of systems and provide efficient solutions.Expertise in processing large volume of data aggregation using spark , must know different performance improvement technique and should lead teams on optimization.Responsible to develop efficient data ingestion and data governance framework as per specification.Performance improvement of existing spark-based data ingestion, aggregation pipelines to meet SLA.Work proactively, independently with global teams to address project requirements, articulate issues/challenges with enough lead time to address project delivery risks.Plan production implementation activities , execute change requests and resolve issues in production implementation.Plan and execute large data migration, history data rebuild activitiesCode reviews/optimization, test case reviews . Demonstrate troubleshooting skill in resolving technical issues, bugs.Demonstrate ownership and initiative. Ability to bring-in best practices /solutions which best fit for client problem and environment. Best Regards! Raj | Account Manager | US Operations | Realtek Consulting LLC : [email protected] | Web: www.realtekconsulting.net Mobile: :+1 (330) 422-6405 US Address: 90 East Halsey Road Ste# 326, Parsippany NJ 07054 Offices: New York | New Jersey | London | Stockholm | Netherlands | South Australia | Chennai | Noida -- Keywords: information technology New Jersey Pennsylvania Hiring for Hadoop PySpark Technical Lead || Pittsburgh, PA [email protected] |
| [email protected] View all |
| Wed Oct 23 18:46:00 UTC 2024 |