| Job Opening || BigdataDeveloper (Onsite) 10 to 15+ years Experience || at Raleigh, North Carolina, USA |
| Email: [email protected] |
| From: Vivek, Smartitframe [email protected] Reply to: [email protected] Note: Need local candidates from NC, and CA. Role: Bigdata Developer Location Raleigh, NC or Foster City, CA (Onsite Hybrid) Experience: 10 to 15 yrs, Need strong Python, Spark , DataBricks and Super strong in AWS ( All these skills are mandatory ) Job Description: We are currently seeking a skilled Big Data Engineer with expertise in Python to join our team. In this role, you will be responsible for designing, developing, and maintaining scalable big data solutions using Python-based technologies. While experience with Hadoop is not required, familiarity with other big data frameworks and tools such as Apache Spark, Apache Kafka, and Apache Flink is highly desirable. The ideal candidate will have a strong background in software engineering, data processing, and distributed computing. Responsibilities: Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical specifications. Design and develop scalable and efficient data processing pipelines using Python-based frameworks and libraries. Implement data ingestion, transformation, and storage solutions for large volumes of structured and unstructured data. Optimize data processing workflows for performance, reliability, and cost-effectiveness. Work with DevOps teams to deploy and manage big data infrastructure in cloud or on-premises environments. Develop monitoring and alerting mechanisms to ensure the health and performance of big data systems. Troubleshoot and debug issues in production environments, and implement timely solutions. Stay updated with emerging technologies and best practices in big data, distributed computing, and software engineering. Provide technical guidance and support to junior engineers and team members. Document design decisions, codebase, and operational procedures to facilitate knowledge sharing and collaboration Keywords: California North Carolina |
| [email protected] View all |
| Thu Mar 07 02:02:00 UTC 2024 |