| ETL ( Python & SQL Server) Developer with AWS Data Engineer exp ( AWS Glue Redshift) Hybrid work State of MD at Remote, Remote, USA |
| Email: [email protected] |
| From: kalyani, dazzlon [email protected] Reply to: [email protected] ETL ( Python & SQL Server) Developer with AWS Data Engineer exp ( AWS Glue / Redshift) Hybrid work - State of MD ETL Developer Job Description Highly skilled ETL developer whose responsibilities include designing, building, automating, and maintaining sophisticated programs that extract, convert, and load data into the Provider Management Module (PMM). Responsibilities for ETL Developer 1. Data Architecture and Modeling: Design and implement robust, scalable data models to support PMM application, analytics and business intelligence initiatives. Optimize data warehousing solutions and manage data migrations in the AWS ecosystem, utilizing Amazon Redshift, RDS, and DocumentDB services. 2. ETL Development: Develop and maintain scalable ETL pipelines using AWS Glue and other AWS services to enhance data collection, integration, and aggregation. Ensure data integrity and timeliness in the data pipeline, troubleshooting any issues that arise during data processing. 3. Data Integration: Integrate data from various sources using AWS technologies, ensuring seamless data flow across systems. Collaborate with stakeholders to define data ingestion requirements and implement solutions to meet business needs. 4. Performance Optimization: Monitor, tune, and manage database performance to ensure efficient data loads and queries. Implement best practices for data management within AWS to optimize storage and computing costs. 5. Security and Compliance: Ensure all data practices comply with regulatory requirements and department policies. Implement and maintain security measures to protect data within AWS services. 6. Team Collaboration and Leadership: Lead and mentor junior data engineers and team members on AWS best practices and technical challenges. Collaborate with UI/API team, business analysts, and other stakeholders to support data-driven decision-making. 7. Innovation and Continuous Improvement: Explore and adopt new technologies within the AWS cloud to enhance the capabilities of the data platform. Continuously improve existing systems by analyzing business needs and technology trends. Qualifications for ETL Developer Bachelors degree in Computer Science, Computer Engineering or similar. Minimum 5 + years ETL coding experience Proficiency in programming languages such as Python and SQL for data processing and automation Experience with distributed computing frameworks like Apache Spark or similar technologies Experience with AWS data environment, primarily Glue, S3, DocumentDB, Redshift, RDS, Athena, etc. Experience with data warehouses/RDBMS like Redshift and NoSQL data stores such as DocumentDB, DynamoDB, OpenSearch, etc Experience in building data lakes using AWS Lake Formation Experience with workflow orchestration and scheduling tools like AWS Step Functions, AWS MWAA, etc.. Strong understanding of relational databases (including tables, views, indexes, table spaces) Experience with source control tools such as GitHub and related CI/CD processes Ability to analyze a companys data needs Strong problem-solving skills Experience with the SDLC and Agile methodologies Thanks & Regards ; kalyani Sr.US IT Recruiter Dazzlon Inc. Email: [email protected] Keywords: continuous integration continuous deployment user interface sthree information technology Maryland ETL ( Python & SQL Server) Developer with AWS Data Engineer exp ( AWS Glue Redshift) Hybrid work State of MD [email protected] |
| [email protected] View all |
| Mon May 20 21:59:00 UTC 2024 |