| SR DATA ENGINEER||100% Remote|6+ Months at Remote, Remote, USA |
| Email: [email protected] |
| From: Shivani, kpg99 [email protected] Reply to: [email protected] Hi, Hope you are doing well. My name is Shiv ani Saini and I'm an IT recruiter at KPG99. Kindly go through the below JD and let me know your interest. Also share with me your updated resume with contact details. Position : SR DATA ENGINEER Location : 100% Remote Duration : 6+ Months Contract No H1B, and Need E-Commerce Candidateds in current project. Job Description: The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependencies, and functionality. Working closely with data engineers to develop a migration strategy for converting pipelines from the current framework to the target framework. Designing, building, and testing new data pipelines in the target framework, ensuring they meet or exceed existing performance and reliability standards. Debugging and troubleshooting issues that arise during the migration process, working collaboratively with cross-functional teams to resolve them quickly. Communicating progress, challenges, and timelines to stakeholders on a regular basis. Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Nice-to-Haves Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framework fluency Thanks & Regards Shivani Saini Technical Recruiter [email protected] Direct--609-662-6116 KPG99,INC 3240 E STATE ST EXT Hamilton, NJ 08619 www.kpgtech.com LinkedIn ID https://www.linkedin.com/in/shivani-saini-1397311a2/ Keywords: information technology golang Idaho New Jersey |
| [email protected] View all |
| Tue Mar 05 02:49:00 UTC 2024 |