PySpark Tech Lead-Chicago, IL Day 1 Onsite at Chicago, Illinois, USA |
Email: basavaraj@centraprise.com |
UID: d797f56b871949e4849c03adc80ded4f Hi Team, Greetings from Centraprise, Role: - PySpark Tech Lead Location Chicago, IL Day 1 Onsite LinkedIn & Passport Number Is Must for all VISAs We are seeking a Technical Lead with 10 to 12 years of experience Required Skills :Technical Skills : ,Cloudera HUE, PySpark,Spark Pyspark,Cloudera Data Platform,Apache Iceberg Responsibilities :- Lead the design and implementation of data solutions using Cloudera HUE and Cloudera Data Platform- Oversee the integration of Apache Iceberg and Spark into existing data workflows- Provide technical guidance and mentorship to junior team members on PySpark best practices- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions- Ensure data quality and integrity through rigorous testing and validation processes- Develop and maintain documentation for data architectures and workflows- Optimize data processing pipelines for performance and efficiency- Conduct code reviews to ensure adherence to coding standards and best practices- Troubleshoot and resolve complex technical issues related to data processing- Stay updated with the latest advancements in data technologies and incorporate them into projects- Drive innovation by exploring new tools and techniques in the research and development domain- Communicate effectively with stakeholders to gather requirements and provide project updates- Contribute to the overall success of the company by delivering high-quality data solutions that drive business value Qualifications Possess strong expertise in Cloudera HUE and Cloudera Data Platform- Demonstrate proficiency in Apache Iceberg and Spark- Have extensive experience with PySpark for data processing- Show a solid understanding of data architecture and data engineering principles- Exhibit excellent problem-solving skills and attention to detail- Have a background in research and development is a plus- Display strong communication and collaboration skills- Be able to work effectively in a hybrid work model- Have a proactive approach to learning and staying current with industry trends- Be capable of mentoring and guiding junior team members- Demonstrate the ability to deliver high-quality solutions within deadlines- Show a commitment to continuous improvement and innovation- Possess a strong sense of ownership and accountability for project outcomes Appreciate your time. Thanks & Regards Basavaraj | Talent Acquisition Associate Centraprise Corp 33 Wood Avenue South, Suite 600, Iselin NJ 08830 Desk : 848-209-8309 Email: basavaraj@centraprise.com Connect me on LinkedIn: linkedin.com/in/basavaraj-n-methre-720b55223 Donate Red || Save Blue || Spread Green Please call me in EST time only[09:30 AM EST 06:00 PM EST] -- Keywords: access management information technology Illinois New Jersey PySpark Tech Lead-Chicago, IL Day 1 Onsite basavaraj@centraprise.com |
basavaraj@centraprise.com View All |
07:54 PM 06-Jan-25 |