| Urgent Req- Core Spark & Scala Developer || Jersey City, NJ or Tampa, FL (Onsite) || Contract at Tampa, Florida, USA |
| Email: [email protected] |
| ONLY REPLY TO [email protected] TO REVIEW PROFILE. Do not share Data Engineers profile. Hi Professional I hope youre doing well! My name is Abhay and I'm an IT Recruiter at Diverse Lynx. I have an urgent position for the following role. If interested, please share your resume at [email protected] or call me at 732-452-1006 Ext 618 Core Spark & Scala Developer - Onsite (Jersey City, NJ or Tampa, FL) About the Role: We are seeking a highly motivated and experienced Big Data Developer to join our team in either Jersey City, NJ or Tampa, FL. In this role, you will play a crucial part in designing, developing, and maintaining big data solutions using Apache Spark and Scala to extract valuable insights from our data. You will collaborate with data engineers, data scientists, and business stakeholders to design, develop, and implement scalable data pipelines and applications. Responsibilities: Develop and maintain big data applications using Spark and Scala for processing and analyzing large datasets. Design and implement scalable data pipelines using Spark to ingest, transform, and load data from various sources (e.g., relational databases, message queues, log files). Utilize Spark libraries (e.g., Spark SQL, MLlib) to perform data cleansing, transformation, feature engineering, and potentially machine learning tasks. Work closely with data engineers to optimize Spark jobs for performance and efficiency on on-premise physical clusters. Collaborate with data scientists to understand their analytical needs and translate them into production-ready Spark applications. Write clean, maintainable, and well-documented code adhering to best practices. Participate in code reviews and knowledge-sharing sessions with the team. Stay updated on the latest advancements in big data technologies (Spark, Scala). Qualifications: Essential Skills: 5+ years of experience in software development with a focus on big data technologies. Proven experience developing big data applications using Apache Spark and Scala. Strong understanding of distributed computing frameworks and concepts (MapReduce, functional programming). Experience with data ingestion techniques (e.g., Kafka, Flume) is a plus. Familiarity with relational databases (e.g., MySQL, PostgreSQL) and SQL querying. Experience working with data pipelines and data warehousing concepts. Experience working with on-premise physical clusters for big data deployments. Excellent problem-solving and analytical skills. Ability to work independently and as part of a team. Strong communication and collaboration skills. Desirable Skills: Experience with cloud platforms (AWS, Azure, GCP) for deploying Spark applications (a plus). Knowledge of machine learning libraries (e.g., MLlib, TensorFlow) is a plus. Experience with containerization technologies (Docker, Kubernetes). Experience with DevOps tools and methodologies (CI/CD pipelines). Experience working in an Agile development environment. Best Regards, Abhay Singh IT Recruiter Diverse Lynx LLC. Email: [email protected] | URL: http://www.diverselynx.com LinkedIn ID: https://www.linkedin.com/in/abhaysingh-chauhan/ Diverse Lynx LLC|300 Alexander Park|Suite #200|Princeton, NJ 08540 -- Keywords: continuous integration continuous deployment information technology wtwo Florida Idaho New Jersey |
| [email protected] View all |
| Thu Mar 14 00:23:00 UTC 2024 |