Immediate need Lead Terraform ETL Data Engineer in Hybrid Jersey City, NJ at Remote, Remote, USA |
Email: [email protected] |
From: Shobhana Kulhade, Sydata Inc [email protected] Reply to: [email protected] Immediate need Lead Terraform ETL Data Engineer in Hybrid Jersey City, NJ Lead Terraform ETL Data Engineer Location: Hybrid Jersey City, NJ Long Term Contract Job Description: Position Overview: As a Lead Data Engineer, you will be a critical member of our data engineering team responsible for designing, building, and optimizing data pipelines and infrastructure. Your primary focus will be on leveraging your Java/python skills to create scalable and efficient data solutions, contributing to the accessibility and reliability of data for various business needs. Key Responsibilities: Strong documentation Skills: Coding: Proficiency in Java. Cluster Computing Frameworks: Proficiency in Spark and Spark SQL. AWS data Services: proficiency in lake formation, glue ETL (OR) EMR, S3, Glue Catalog, Athena, Kinesis (OR) MSK, Airflow (OR) Lambda + Step functions + Event Bridge Data De/Serialization: Expertise in atlest 2 of the formats: Parquets, iceberg, AVRO JSON_LE DevOps: Linux Scripting, Jenkins, Git, CI/CD, Jira TDD AWS Data Security: Good Understanding of security concepts such as Lake formation, IAM, Service roles, Encryption, KMS Secrets management IAC: Terraform Qualifications: Minimum 9+ years of experience as a Data Engineer and Analyst on any cloud platforms. Expertise in Terraform and other IaC based services is a must. Strong understanding of cloud-based services and delivery models. Hands-on experience with network configuration, Kubernetes, and container orchestration. Familiarity with DevOps practices and CI/CD solutions. Experience with Orchestration frameworks (Airflow) and Serverless/Fa Thanks & Regards: Shobhana Kulhade Sr. IT Recruiter Sydata Inc Email: [email protected] 6494 Weathers Place Suite#100 San Diego, California, 92121 Website: www.sydatainc.com Notice: This email contains confidential or proprietary information which may be legally privileged. It is intended only for the named recipient (s). If an addressing or transmission error has misdirected the email, please notify the author by replying to this message by "REMOVE" Keywords: continuous integration continuous deployment sthree information technology Delaware New Jersey |
[email protected] View all |
Tue Jan 30 23:49:00 UTC 2024 |