Job opening || Data Engineer || Onsite || Contract at Charlotte, North Carolina, USA |
Email: [email protected] |
From: iyyappan, Smartitframe [email protected] Reply to: [email protected] Dear, Greetings from Smart IT Frame, Hope you are doing well!!! Smart IT Frame specializes in enabling you with your most critical line of resources. Whether its for permanent staffing, contract staffing, contract-to-hire or executive search, we understand the importance of delivering the most suitable talent; on time and within budget. With our Core focus in emerging technologies, we have provided global technology workforce solutions in North America, Canada & India. We take pride in delivering specialized talent, superior performance, and seamless execution to meet the challenging business needs of customers worldwide. Job Title: Data Engineer Location: Charlotte, NC Duration: Contract Required Skills: AWS Big Data Job Summary: We are looking for a highly capable Data Engineer who has experience in building end-to-end systems. Roles & Responsibilities: Experience on implementation of Data Lakes using Cloud (AWS or GCP), Hands-on with Big Data and related technologies including Spark, Kafka, ELK. Define and setup development, test, release, deployment, and support processes for DevOps/DataOps operations Perform fit gap analysis and recommend appropriate DataOps processes and technologies for data pipelines/applications Design and develop CI/CD automation frameworks to support data pipeline development & deployment Manage & automate code deployment across environments and enable automated end-end data validations Setup automated continuous data monitoring processes and alerts/notifications related to data quality issues Establish and enforce standards & best practices across data pipeline development life cycle Create reusable & automation frameworks related to Infrastructure provisioning/Continuous Integration/Continuous Deployment & Continuous Testing Mentor and guide data engineering teams on DataOps processes & frameworks Technical/Process Skills a. Data Lake/Datawarehouse architecture & Data engineering design principlesb. Agile implementation & DataOps processes expertisec. GitHub, AWS Tech Stack (S3, Glue, Redshift, CodeCommit, CodeBuild, CodePipeline, Airflow, CloudFormation etc.), Jenkins, Snowflaked. Advanced SQL skills to analyze data in Data Lakes/Warehousese. Comfortable with programming language (Python preferred). Keywords: continuous integration continuous deployment sthree information technology North Carolina |
[email protected] View all |
Tue Jul 25 01:48:00 UTC 2023 |