| SAP HANA & Snowflake Data Engineer at Snowflake, Arizona, USA |
| Email: [email protected] |
| From: venkat, InsourceTechsolutions [email protected] Reply to: [email protected] Job Description: We are looking for a versatile SAP HANA & Snowflake Data Engineer with 5-8+ years of overall IT software development experience. This role demands a balance of expertise in SAP HANA Development and Snowflake Data Engineering, with a strong passion for delivering high-quality, performance-driven solutions. The ideal candidate will have in-depth knowledge of both SAP HANA architecture and Snowflake, using their technical skill set to deliver cutting-edge solutions for our data and analytics needs. Primary Responsibilities: SAP HANA Development (50% of Role): HANA Ecosystem Development: o Build and optimize data solutions utilizing the native SAP HANA Ecosystem and components. o Architect and develop high-performance SAP HANA solutions, focusing on data models, views, table functions, and procedures that efficiently process large data volumes. o Leverage the latest features of HANA v2.0, applying advanced data warehousing and analytics techniques to meet complex business requirements. Performance Optimization: o Conduct in-depth performance analysis and optimization of SAP HANA models, ensuring maximum efficiency and scalability. o Utilize Explain/Viz Plan Analysis to diagnose and resolve performance bottlenecks. Technologies & Tools: o Work with tools like SAP HANA Studio, WebIDE, Smart Data Integration (SDI), Smart Data Quality (SDQ), and BODS to build robust HANA solutions. o Implement advanced HANA features, such as XS Classic and Advanced Development, HANA Rules Framework, and Agile Data Prep. o Integrate with UI5 and SAP Analytics Cloud to create rich user experiences and dashboards. Snowflake Data Engineering (50% of Role): Data Pipeline Development: o Design, develop, and maintain scalable data pipelines in Snowflake, enabling efficient data ingestion, transformation, and storage. This includes building pipelines for structured, semi-structured, and unstructured data. o Leverage DBT (Data Build Tool) to define and execute complex data transformations within Snowflake. This includes creating modular SQL scripts for transforming raw data into clean, usable datasets that align with business needs. Experience in defining reusable DBT models to enforce data standards and improve productivity is crucial. o Develop, manage, and optimize ETL/ELT workflows using Matillion. This includes configuring Matillion jobs to handle data extractions, loading, and transformations while ensuring pipeline reliability, scalability, and performance. You will be expected to create complex workflows, manage dependencies, and schedule jobs using Matillions orchestration features. Data Warehousing & Performance Optimization: o Design and implement optimized data warehousing solutions within Snowflake by leveraging multi-cluster warehouses, data partitioning, and clustering keys. You will be responsible for ensuring that data retrieval and processing are optimized for both performance and cost efficiency. o Use DBT to structure data transformations efficiently, building incremental models to handle large datasets. You will apply performance tuning techniques, such as query optimization, caching, and materialized views, to ensure the Snowflake environment remains performant as data scales. o Monitor and troubleshoot Matillion workflows to ensure that ETL/ELT processes are executing correctly and efficiently, making necessary adjustments to improve performance. Collaboration & Best Practices: o Collaborate with data architects, analysts, and other stakeholders to design data models and pipelines that align with business goals and adhere to best practices. You will help implement data governance policies, ensuring that data pipelines are secure, reliable, and compliant. o Apply version control practices in both DBT and Matillion, ensuring that development efforts are properly documented, reversible, and aligned with team workflows. o Advocate for and contribute to the continuous improvement of the data engineering process, including driving efforts to implement CI/CD pipelines for Snowflake development using DBT and Matillion. ______________ Required Skills & Qualifications: Technical Expertise: o 5-8+ years of hands-on experience in SAP HANA development and Snowflake Data Engineering. o Proven ability to design, develop, and optimize data solutions in both SAP HANA and Snowflake environments. o Strong proficiency in DBT (Data Build Tool) and Matillion, with experience in building modular and scalable data transformation pipelines. o In-depth knowledge of Snowflakes architectural features, including multi-cluster warehouses, query performance tuning, and data modeling. Technologies & Tools: o SAP HANA: Hands-on experience with Web IDE, BODS, SQL/Script, and oData/Rest Web Services. Familiarity with UI5, SAP Analytics Cloud, and advanced HANA modules such as PAL/APL Libraries, Data Masking, and XS Advanced is a plus. o Snowflake: Expertise in DBT, Matillion, SQL, and other ETL tools used for data transformation and pipeline development. Strong knowledge of Snowflake performance optimization techniques is required. Other Qualifications: o Bachelors degree in Computer Science, Information Technology, or related field, or equivalent experience. o Strong communication and collaboration skills, with the ability to work effectively across teams. o Passion for learning and implementing new technologies. Keywords: continuous integration continuous deployment information technology SAP HANA & Snowflake Data Engineer [email protected] |
| [email protected] View all |
| Wed Aug 28 20:44:00 UTC 2024 |