| Data Engineering Manager at Remote, Remote, USA |
| Email: [email protected] |
| From: peter, vsiiusa [email protected] Reply to: [email protected] Job Title: Data Engineering Manager Client: Blue Health Intelligence Analytics Location: Remote Experience Required: 10+ years Job Description: Blue Health Intelligence Analytics is seeking an experienced Data Engineering Manager to lead a team of data engineers and architects in designing and implementing large-scale, complex big data solutions for the healthcare sector. This role involves developing architecture blueprints, optimizing data pipelines, ensuring high performance, and managing data processing at scale using modern cloud technologies. The ideal candidate should have strong expertise in cloud-based solutions (specifically AWS and Databricks), as well as a deep understanding of data governance, security, and cost optimization. Key Responsibilities: Leadership: Lead and mentor a team of data engineers and architects in delivering high-quality data solutions. Oversee the design and implementation of large-scale and complex big data solutions. Architecture Design: Develop architecture blueprints for various design patterns, including batch, real-time, and micro-batches. Ensure solutions are scalable, high-performing, and optimized for large-scale data processing. Cloud Services & Data Solutions: Design and implement scalable data solutions using AWS services such as MWAA, Lambda, RDS, ECS, and EKS (7+ years experience). Proficient in Databricks using pyspark, Unity Catalog, and SQL Warehouse (6+ years experience) to optimize data pipelines. Snowflake Expertise: Optimize queries, schemas, and security layers in Snowflake (5+ years experience). Cost Optimization: Deep expertise in FinOps best practices for optimizing costs on AWS, Databricks, and Snowflake. Data Governance & Compliance: Develop and enforce data governance policies and best practices to ensure data quality, compliance, and security. Deployment & CI/CD: Proficient in deployment patterns and experienced with CI/CD tools such as CDK, CloudFormation, and Terraform. Security Practices: Knowledge of AppSecOps tools and best practices to ensure the security of data solutions. Required Skills and Experience: 10+ years of experience leading teams of data engineers and architects in delivering large-scale, complex data solutions. AWS Services: Expertise in AWS MWAA, Lambda, RDS, ECS, and EKS (7+ years). Databricks: Proficiency in Databricks using pyspark, Unity Catalog, and SQL Warehouse (6+ years). Snowflake: Strong experience in Snowflake for optimizing queries, schemas, and security layers (5+ years). FinOps Best Practices: Deep knowledge of FinOps for building cost-effective solutions in AWS, Databricks, and Snowflake. Data Governance: Strong understanding of data governance policies and practices to maintain data quality and compliance. CI/CD Tools: Experience with CDK, CloudFormation, and Terraform for deployment automation. AppSecOps: Familiarity with AppSecOps tools and best practices. Preferred Qualifications: Advanced degree in a related field (e.g., Computer Science, Data Engineering, etc.) Experience with additional cloud platforms or big data technologies is a plus. Excellent communication skills and ability to collaborate across teams. Strong problem-solving and critical thinking abilities. Peter VisionSoft International Inc (www.vsiiusa.com ) Email : [email protected] Keywords: continuous integration continuous deployment Data Engineering Manager [email protected] |
| [email protected] View all |
| Tue Nov 12 20:51:00 UTC 2024 |