| AWS Data Engineer 10+ MUST at Remote, Remote, USA |
| Email: [email protected] |
| From: Rahul Reddy, Headwaytek [email protected] Reply to: [email protected] Role: AWS Data Engineer Years of Experience: 10+ years Location: Remote (should be comfortable working in Pacific time) A successful candidate will work alongside our existing full-time Data Engineer and will help build a new data pipeline that is a near replica of an existing data pipeline. We have two different backend applications, and currently have a data pipeline that connects one of the backends to a data visualization tool we used called Sisense. The goal will be to build a similar pipeline connecting the second backend to the same data visualization tool, Sisense. So obviously at the very base level we need python and SQL. We use terraform to manage the infrastructure. We use Airflow to orchestrate the pipelines and airflow functions to write different parts of the pipeline. Airflow function I believe is the most important part of the tech stack. We use AWS services like SQS, Lambda, DynamoDB, S3, Redshift. We also run our airflow as a container on AWS using ECS and ECR but arent an important part of the tech stack. Familiarity with tools such as dbeaver and periscope would help a lot. Best practices of data warehousing would be a plus to have. In terms of specific technical skills, languages & tools, we are looking for someone comfortable with: Hivemind Apache Airflow AWS DynamoDB AWS Redshift AWS SQS Keywords: sthree AWS Data Engineer 10+ MUST [email protected] |
| [email protected] View all |
| Wed Oct 30 00:12:00 UTC 2024 |