| Data Engineer at Newark, New York, USA |
| Email: [email protected] |
| Title: Data Engineer Client: Prudential Location: need only local candidate Newark, NJ ( Client may call for f2f as well ) Visa: USC or Green Card Holder Years of experience: 7+ years Interview: Phone, Video and/or In-person Interview Contract: 6-12 months with possible extension Qualifications: * Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience * Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises * Programming experience with Python, Shell scripting and SQL * Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc. * Solid experience implementing solutions on AWS based data lakes. * Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch * Serverless application development using AWS Lambda * Experience in AWS data lake/data warehouse/business analytics * Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS * Knowledge of ETL/ELT * End-to-end data solutions (ingest, storage, integration, processing, access) on AWS * Architect and implement CI/CD strategy for EDP * Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred) * Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift * Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift * Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case * AWS Solutions Architect or AWS Developer Certification preferred * Good understanding of Lakehouse/data cloud architecture Responsibilities: * Designing, building and maintaining efficient, reusable, and reliable architecture and code. * Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS ,etc.) * Ensure the best possible performance and quality of high scale data engineering project Keywords: continuous integration continuous deployment sthree New Jersey |
| [email protected] View all |
| Thu Sep 05 02:23:00 UTC 2024 |