| Urgent hiring DataETL Engineer Technical Lead C2C OR W2 Scottsdale, AZ Onsite at Scottsdale, Arizona, USA |
| Email: [email protected] |
| From: vishnu, Sibitalent [email protected] Reply to: [email protected] Position:- LEAD Data Engineer With ETL Employment:- C2C OR W2 Location:- Scottsdale, AZ (Onsite) Job description:- Must Exp Stream Sets experience strong skills in Python programming, experience with cloud platforms (such as AWS, Azure, or GCP), and proficiency in containerization technologies like Kubernetes and Docker Responsibilities: 12+ years Design, develop, and maintain ETL pipelines to extract data from various sources, transform it according to business requirements, and load it into target data warehouses or databases. Collaborate with cross-functional teams to gather requirements, understand data sources, and define data transformation logic. Implement scalable and efficient ETL solutions within cloud environments, leveraging platform services and infrastructure as code. Optimize ETL processes for performance, reliability, and cost-effectiveness, considering factors like data volume, frequency, and latency requirements. Monitor and troubleshoot ETL pipelines to ensure data integrity, timely execution, and error handling. Stay up-to-date with emerging technologies and best practices in ETL, cloud computing, and data engineering, and propose innovative solutions to enhance the overall data ecosystem. Document ETL workflows, data mappings, and system configurations to facilitate knowledge sharing and maintainability. Provide technical guidance and support to junior team members, fostering a collaborative and learning-oriented environment. Requirements: Proven experience in software development with expertise in Python programming language. Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including services like S3, EC2, Azure Data Factory, Google BigQuery, etc. Strong understanding of ETL concepts, methodologies, and best practices. Proficiency in containerization technologies such as Kubernetes and Docker. Experience with scripting languages for automation and orchestration tasks (e.g., Bash, PowerShell). Familiarity with relational databases (e.g. PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra). Excellent problem-solving skills with a focus on delivering high-quality solutions in a fast-paced environment. Effective communication skills with the ability to collaborate with cross-functional teams and articulate technical concepts to non-technical stakeholders. Preferred Qualifications: Master's degree in Computer Science, Engineering, or related field. Experience with data warehousing technologies and concepts (e.g., Snowflake, Redshift, star schema). Knowledge of data governance, security, and compliance standards in cloud environments. Certification in relevant cloud platforms (e.g., AWS Certified Developer, Azure Developer Associate, Google Cloud Professional Developer). Familiarity with agile development methodologies and DevOps practices. Contributions to open-source projects or active participation in developer communities. Vishnu yadav Email : [email protected] Web: www.sibitalent.com Keywords: sthree information technology wtwo Arizona Urgent hiring DataETL Engineer Technical Lead C2C OR W2 Scottsdale, AZ Onsite [email protected] |
| [email protected] View all |
| Fri May 10 22:50:00 UTC 2024 |