| Sr. Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: vicky, istaffx [email protected] Reply to: [email protected] Data Engineer with expertise in Snowflake, dbt, GCP (Google Cloud Platform), and Python to join our team. You will work closely with BI Analysts to design, build, and maintain the infrastructure and pipelines required to support data-driven reporting and analysis. Your main responsibility will be to ensure that data is available, clean, and structured properly for the BI Analysts to pull reports and insights that drive business decisions. Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines using dbt, Python, and GCP tools, ensuring efficient data flow and transformation. Manage and optimize Snowflake data warehouse infrastructure, focusing on performance, scalability, and costefficiency. Collaborate with BI Analysts to understand reporting requirements and ensure timely and accurate delivery of data. Build and maintain data models, tables, and views in Snowflake to support the reporting needs of the business. Implement data quality checks and validation processes to ensure the accuracy and reliability of data. Monitor, troubleshoot, and optimize data pipelines to ensure smooth operation and minimal downtime. Develop automation scripts in Python to streamline data processes and improve efficiency. Work with crossfunctional teams to integrate various data sources, ensuring that the data is centralized and easily accessible. Ensure data security and privacy in line with company policies and regulatory requirements. Stay upto-date with the latest technologies and trends in data engineering and analytics, continually improving existing processes and infrastructure. Required Skills and Qualifications: Bachelors degree in Computer Science, Data Engineering, or a related field. 8+ years of experience in data engineering roles, preferably with Snowflake, dbt, GCP, and Python. Strong proficiency in designing and optimizing ETL/ELT workflows using dbt and Python. Handson experience with Snowflake for data warehousing, including managing schemas, tables, and performance tuning. Familiarity with Google Cloud Platform (BigQuery, Dataflow, Cloud Functions) for data processing and storage. Experience working closely with BI Analysts, understanding reporting and data visualization needs. Excellent SQL skills and the ability to write complex queries for data transformation and analysis. Strong understanding of data modeling concepts and best practices. Experience with version control systems (e.g., Git) and CI/CD processes in data engineering. Familiarity with data governance and data security practices. Excellent communication skills and the ability to collaborate effectively with crossfunctional teams. Preferred Qualifications: Experience with additional cloud platforms such as AWS or Azure. Knowledge of business intelligence tools such as Tableau, Looker, or Power BI. Prior experience working in agile or fastpaced environments. Keywords: continuous integration continuous deployment business intelligence Sr. Data Engineer [email protected] |
| [email protected] View all |
| Mon Sep 16 20:52:00 UTC 2024 |