Data Engineer with BI at Remote, Remote, USA |
Email: [email protected] |
Data Engineer with BI Skills Need- Snowflake , Databricks, Tableau, AWS Technical Lead Client : Blue Health Intelligence Hybrid position Chicago, IL 10+ years of experience leading team of data engineers & architects in large scale & complex big data solutions Expertise in developing architecture blueprints for various design patterns - batch, real time and micro batches. Extensive experience in designing and implementing scalable data solutions using AWS services like MWAA and Lambda, RDS, ECS, EKS (7+ years). Proficient in Databricks using pyspark, unity catalog, SQL Warehouse (6+ years) for optimizing data pipelines, ensuring high performance, and managing large-scale data processing. Proficient in Snowflake (5+ years) for optimizing queries, schemas, and security layers. Deep expertise in FinOps best practices in AWS, Databricks, and Snowflake to build cost effective data products and solution Adept at developing and enforcing data governance policies and best practices to ensure data quality and compliance. Skilled in deployment patterns and proficient with CI/CD tools, specifically CDK, CloudFormation, and Terraform. Knowledge of using AppSecOps tools and best practices -- Keywords: continuous integration continuous deployment business intelligence information technology Illinois Data Engineer with BI [email protected] |
[email protected] View all |
Tue Oct 08 23:13:00 UTC 2024 |