| Need for Data Engineer with Python Coding exp and AWS at Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: sivaji, Headway Tek Inc [email protected] Reply to: [email protected] Data Engineer with (Hands on Python Programming & coding, Data Engineer on AWS, Algorithms, Data Structures) Complete Remote Note- Python coding hands on required and Data Engineer with AWS JD- We have two different backend applications, and currently have a data pipeline that connects one of the backends to a data visualization tool we used called Sisense. The goal will be to build a similar pipeline connecting the second backend to the same data visualization tool, Sisense. So obviously at the very base level we need python and SQL. We use terraform to manage the infrastructure. We use Airflow to orchestrate the pipelines and airflow functions to write different parts of the pipeline. Airflow function I believe is the most important part of the tech stack. We use AWS services like SQS, Lambda, DynamoDB, S3, Redshift. We also run our airflow as a container on AWS using ECS and ECR but arent an important part of the tech stack. Familiarity with tools such as dbeaver and periscope would help a lot. Best practices of data warehousing would be a plus to have. In terms of specific technical skills, languages & tools, we are looking for someone comfortable with: Hivemind Apache Airflow AWS DynamoDB AWS Redshift AWS SQS Keywords: sthree Need for Data Engineer with Python Coding exp and AWS at Remote [email protected] |
| [email protected] View all |
| Wed Nov 06 23:52:00 UTC 2024 |