| Urgent Requirement For || : Engineer Highly Skilled Position || On C2C at Englewood Cliffs, New Jersey, USA |
| Email: [email protected] |
| From: Sam Sharma, Systray Technology [email protected] Reply to: [email protected] Job Title: Engineer - Highly Skilled Location : Englewood Cliffs, NJ (onsite) Contract Duration: Contract until 05/31/2025 Work Hours: 9AM - 6PM Qualifications: Embrace a builder mentality to push the business forward 8+ years experience in a software developer role 4+ years of experience as a data engineer Proficient with AWS, Python and Pyspark Experience with EMR, S3, SNS, Kafka, Databricks, Athena, Kinesis, Lambda and Airflow Experience with distributed data technologies (e.g. Spark) Proficient with Linux environment Passion for media and news B.S. degree in Computer Science, Information Technology, or equivalent experience Responsibilities: Create new ingest batch/streaming pipelines from the ground up or maintain existing pipelines. Recommend tools/tech stack which will improve the effectiveness of existing pipelines or reduce the over all operating cost of the existing pipelines Possess an in-depth understanding of the data structures and governance Deep understanding of modern cloud computing platforms and concepts (AWS preferred) Work with modern schema-less big data storage solutions Work closely with machine learning and data science teams to create scale and efficiency Work closely with DevOps to foster a culture of collaboration Demonstrate critical thinking for potential roadblocks; comprehend a bigger picture of the business and effectively communicate these issues to stakeholders Work closely with internal stakeholders to implement solutions that adhere to solution designs and schema Work in an agile software development team create new batch/streaming ingest data pipelines from the ground up, and/or expand upon those created by other team members. Act as a lead, identifying and assigning new work for other engineers. Test and create automated unit/integration tests for your code, ensuring every function, service, and object is compatible with your teams work and with the many systems within the Group system portfolio. Act as a development leader, help to formulate best practices and setting up toolsets and procedures for the team, leveraging internally available tools and communicating with other internal development & product teams. Stay up-to-date on new development and platform technologies, make recommendations for the right tool for the job, and take the lead in setting up those tools and training other developers on them. Create documentation for developers as well as business users to help them understand your products. Maintain cloud-based platforms and environments of supported applications, troubleshooting and patching functional issues and data issues in lower or production environments when necessary. Keywords: sthree New Jersey Urgent Requirement For || : Engineer Highly Skilled Position || On C2C [email protected] |
| [email protected] View all |
| Wed Jul 03 21:18:00 UTC 2024 |