| Snowflake Engineer at Snowflake, Arizona, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1152839&uid= From: Utsav (IT Resource Manager), ChabezTech [email protected] Reply to: [email protected] **Senior Azure Data Engineer - Snowflake** **Duration:** Long term **Job Responsibilities:** - Design, develop, and implement robust and scalable data solutions using Azure technologies, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics. - Proficiency in programming languages like Spark (with either Python or Scala), SQL. - Experience with databases like Sql Server, Teradata, Snowflake, Synapse. - Good understanding of data engineering principles, data modeling, data warehousing, and ETL/ELT processes, including data testing, validation, and reconciliation. - Hands-on experience with data integration and data transformation frameworks, tools, and methodologies. - Experience with version control systems like Git, GitHub, etc. - Collaborate with cross-functional teams and business teams to understand business requirements and translate them into technical designs and solutions. - Build and maintain data pipelines, data integrations, and data transformations to enable efficient data processing, storage, and retrieval. - Optimize data infrastructure and solutions for performance, scalability, and cost-efficiency, ensuring high availability and reliability. - Conduct data profiling, data validation, and data cleansing activities to ensure data integrity and accuracy. - Mentor and provide technical guidance to junior data engineers, freshers/interns, fostering knowledge sharing and skills development within the team. **Good to have:** - Experience with version control systems, CI/CD pipelines, and automated testing frameworks. - Knowledge in streaming technologies, pipelines, and frameworks like Kafka, EventHub, Azure Stream Analytics. **Snowflake Responsibilities:** 1. **Snowflake Database Management:** - Explain the process of creating and managing database schemas in Snowflake. - Discuss strategies for optimizing Snowflake databases and queries to ensure efficient data processing. 2. **Snowflake Modeling:** - Describe a specific instance where you implemented Slowly Changing Dimension (SCD) in Snowflake. Discuss challenges faced and how they were overcome. - Explain how you handle surrogate key assignment and change data capture in Snowflake modeling. 3. **ELT/ETL Pipelines with Snowflake:** - Provide an example of a complex ELT/ETL pipeline developed using Python and Snowflake Snow SQL. - Discuss how you ensure the reliability and scalability of data movements in ELT/ETL pipelines. 4. **Snowflake Integration with Other Tools:** - Explain the process of integrating Snowflake with Tableau for creating interactive dashboards and reports. - Discuss collaboration with cross-functional teams, including data scientists and analysts, to deliver data solutions. 5. **Continuous Integration and Deployment (CI/CD):** - Discuss the use of Azure DevOps for continuous integration and deployment of data pipelines related to Snowflake. - Describe a scenario where CI/CD improved the efficiency of Snowflake-related projects. 6. **Data Archiving and Retention:** - Discuss strategies employed for data archiving using Azure Blob Storage in conjunction with Snowflake's Time Travel feature. - Explain how you determine appropriate data retention policies for different types of data in Snowflake. 7. **Snowflake Staging:** - Explain the role of Snowflake stages in loading data efficiently into Snowflake tables. - Provide an example of a challenging data loading scenario and how you optimized it using Snowflake stages. **Technical Skillset:** *Azure Stack:* - Azure Cloud Services, Azure DevOps, Security (Azure Active Directory, RBAC, NSG), Networking, Encryption. *Snowflake:* - Data Warehousing, SQL and Query Optimization, Data Integration, Security in Snowflake, Snowflake SnowSQL. *DevOps and CI/CD:* - CI/CD Tools, Version Control, Containers and Orchestration. *Security and Encryption:* - TLS Networking, Encryption/Decryption. *Data Frameworks and Solution Design:* - Data Frameworks, Solution Design, Logical Thinking, Problem Solving. Thanks & Regards Utsav Manager ChabezTech LLC 4 Lemoyne Dr #102, Lemoyne, PA 17043, USA Email: [email protected] | www.chabeztech.com Keywords: continuous integration continuous deployment information technology Pennsylvania http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1152839&uid= |
| [email protected] View All |
| 11:39 PM 23-Feb-24 |