| Local Candidates No H1B/ OPT/ CPT Senior Data Engineer , Fulton, MD 12+years at Fulton, New York, USA |
| Email: [email protected] |
| Role : Sr Data Engineer Work location: Fulton,MD 20759 (Try for nearby candidate) Relocation is fine. No H1/OPT/CPT Role Description: At a high level, the candidate must be hands on data engineer with ability to lead the work which includes working directly with client, understand their requirements, design & develop the solution. Communication and ability to collaborate effectively. Technical requirements: Data Pipeline Development: Design, implement, and manage robust data pipelines using Python, PySpark, SQL to efficiently extract, transform, and load data from diverse sources (Batch & Streaming) AWS Expertise: Demonstrate expertise in core AWS services such as AWS DMS, AWS Glue, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, Amazon EMR, AWS IAM, AWS LAMBDA etc., and apply them to build scalable and reliable data solutions. Data Modeling: Develop and maintain efficient data models to support analytical and reporting needs. Database Management: Administer databases using AWS services like Amazon RDS or Amazon Redshift, focusing on schema design, performance optimization, and monitoring. Data Warehousing: Utilize Amazon Redshift or Amazon Snowflake to create high-performing analytical databases that empower data-driven decision-making. ETL Best Practices: Implement industry best practices for ETL processes, including data validation, error handling, and data quality checks. Performance Optimization: Optimize query performance through continuous tuning of databases and leveraging AWS's scalability capabilities. Monitoring and Logging: Establish robust monitoring and logging mechanisms using AWS CloudWatch, Amazon CloudTrail, or comparable tools to ensure pipeline reliability. Thanks & Warm Regards, Alok Singh | Technical Recruiter TekNavigators Staffing Alok @tek-staffing.com tek-staffing.com -- Keywords: sthree information technology Maryland |
| [email protected] View all |
| Thu Jan 04 01:48:00 UTC 2024 |