| Lead Python / PySpark Developer / Owings Mills, Maryland (MD) / at Owings Mills, Maryland, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2427943&uid=2a8da0f887b0407c8f4100751e979259 **Job Title:** Lead PySpark Developer **Location:** Owings Mills, Maryland (MD) **Responsibilities:** * Lead the design, development, and implementation of large-scale data processing pipelines using PySpark and related Big Data technologies. * Provide technical leadership and guidance to a team of PySpark developers, ensuring code quality, performance, and adherence to best practices. * Architect scalable and efficient data solutions on cloud platforms (e.g., AWS, Azure, GCP). * Collaborate with data scientists, data engineers, and business stakeholders to understand data requirements and translate them into technical designs. * Optimize existing PySpark applications for performance and efficiency. * Implement data ingestion, transformation, and storage solutions for various data sources. * Develop and maintain ETL/ELT processes using PySpark, SQL, and other relevant tools. * Ensure data quality and implement data governance policies. * Monitor and troubleshoot data pipelines and system performance. * Stay up-to-date with the latest advancements in PySpark, Big Data technologies, and cloud computing. * Mentor and coach junior developers, fostering their technical growth. * Participate in code reviews and ensure adherence to coding standards. * Contribute to the development of data architecture and data modeling strategies. **Qualifications:** * Bachelor's or Master's degree in Computer Science, Engineering, or a related field. * 12+ years of experience in software development with a strong focus on Big Data processing. * Proven experience in leading technical teams and mentoring developers. * Deep understanding of Apache Spark architecture and its components. * Strong proficiency in Python and PySpark for data manipulation and analysis. * Extensive experience with SQL and relational databases. * Experience with NoSQL databases (e.g., Cassandra, MongoDB) is a plus. * Solid understanding of data warehousing concepts and data modeling techniques. * Experience with cloud platforms (e.g., AWS, Azure, GCP) and their Big Data services (e.g., EMR, Databricks, Dataflow). * Familiarity with data integration and ETL/ELT tools. -- teamware solution | Exec. Talent Acquisition [email protected] INDIA | NORTH AMERICA | MIDDLE EAST Keywords: Maryland Lead Python / PySpark Developer / Owings Mills, Maryland (MD) / [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2427943&uid=2a8da0f887b0407c8f4100751e979259 |
| [email protected] View All |
| 01:27 AM 15-May-25 |