| Data Architect (BI Designer) Databricks and Snowflake at Snowflake, Arizona, USA |
| Email: [email protected] |
| From: Manohar, Cloudingest [email protected] Reply to: [email protected] Title: Data Architect (BI Designer) Databricks and Snowflake Skills: AWS or Azure, Databricks, Snowflake, PySpark and Airflow Spearhead the design and implementation of robust data ingestion pipelines, leveraging Databricks and Snowflake to seamlessly ingest data from diverse sources with high reliability and scalability. Lead and mentor a team of data engineers, providing guidance and technical expertise in data engineering best practices, code reviews, and professional development. Design and optimize ETL processes within Databricks Delta Lake, employing advanced techniques such as schema evolution and incremental updates to ensure data integrity and efficiency. Lead the development of scalable data warehouse solutions, utilizing Snowflake's features such as clustering, materialized views, and time travel to maximize performance and usability. Showcase expertise in SQL for complex querying and performance tuning within Snowflake and Databricks environments, optimizing data access and processing for analytical workloads. Drive automation and orchestration of data workflows using Apache Airflow or Databricks Jobs, implementing CI/CD practices to streamline deployment and ensure data pipeline reliability. Architect and integrate Delta Lake architecture within Snowflake and Databricks ecosystems, leveraging features such as schema enforcement and transactional consistency for data reliability. Collaborate closely with cross-functional teams to understand business requirements and translate them into scalable and efficient data solutions, providing technical leadership and guidance. Thanks & Regards Manohar | Sr. Recruiter Email: [email protected] | www.cloudingest.com Keywords: continuous integration continuous deployment business intelligence |
| [email protected] View all |
| Thu Feb 29 21:47:00 UTC 2024 |