Data Engineer + AWS---Contract//Irvine, CA (Onsite) at Irvine, California, USA |
Email: [email protected] |
Data Engineer + AWS Location: Irvine, CA, Onsite Long term Contract Job Description: We are seeking a talented and experienced Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in utilizing the AWS Suite of services to design, build, and maintain scalable data pipelines and infrastructure. Key Responsibilities: Design, implement, and maintain scalable data pipelines and workflows leveraging AWS services such as AWS Lambda, AWS Glue, AWS CloudWatch, AWS Athena, AWS Redshift, and Amazon S3. Develop and optimize ETL processes to support data transformation, data enrichment, and data integration across various data sources. Ensure data quality, integrity, and reliability throughout the data pipelines. Collaborate with cross-functional teams including data scientists, business analysts, and software engineers to understand data requirements and support their analytical needs. Monitor and troubleshoot performance issues in data pipelines, and implement solutions to optimize data processing and query performance. Implement security and compliance best practices in data management and storage on AWS. Keep up-to-date with AWS services and industry best practices to recommend and implement improvements in data engineering processes. Key Skills and Qualifications: Bachelor's degree in Computer Science, Engineering, or related field. Proven experience as a Data Engineer or similar role, with expertise in designing and building data pipelines and ETL processes. Strong proficiency in using the AWS Suite including AWS Lambda, AWS Glue, AWS CloudWatch, AWS Athena, AWS Redshift, Amazon S3, AWS Cloud9, and SageMaker. Experience with data modeling, database design, and data warehousing principles. Proficiency in programming languages such as Python, Java, or Scala for scripting and data manipulation. Familiarity with DevOps practices and CI/CD pipelines for automated deployment and testing. Excellent analytical and problem-solving skills with a strong attention to detail. Good communication skills and ability to collaborate effectively in a team environment. Preferred Qualifications: AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics Specialty). Experience with big data technologies such as Apache Spark or Hadoop. Knowledge of machine learning concepts and frameworks. Thanks & Regards Rohit Patil Recruitment Lead [email protected] -- Keywords: continuous integration continuous deployment sthree information technology California Data Engineer + AWS---Contract//Irvine, CA (Onsite) [email protected] |
[email protected] View all |
Fri Jul 19 01:19:00 UTC 2024 |