| Lead Databricks Engineer NOT Data Engineer || USC GC || Healthcare must at Remote, Remote, USA |
| Email: [email protected] |
| From: Awkash Kumar, Largeton INC [email protected] Reply to: [email protected] JD :: Assignment Design and implement data pipelines using Databricks, Spark, and other Big Data technologies. Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and build solutions that meet those needs. Build and maintain data warehouse and data lake solutions that can scale with the business. Develop and maintain ETL workflows, including data transformation, validation, and loading. Implement and maintain data security policies and procedures to ensure the confidentiality, integrity, and availability of data. Have expertise in building data pipelines in medallion architecture. Optimize data pipelines for performance, scalability, and cost. Keep up-to-date with emerging trends and technologies in the Big Data ecosystem. Cloud agnostic with strong databricks and pyspark expertise. Skills / Experience Experience with software and cloud engineering and architecture in building enterprise data analytics platforms Experience in implementing solutions using Azure Data Lake, Azure Databricks and PowerBI Experience creating data ingestion and data pipelines using databricks Experience configuring and deploying Azure services. Expertise with Databricks Experienced in creating Analytics / BI reporting solutions Additional skills Excellent communication skills verbal and written Experienced in facilitating meetings and working sessions Experience in Azure DevOps and working in an Agile methodology Certified in Data Engineering on Databricks. Able to lead the direction on design decisions. Keywords: business intelligence Lead Databricks Engineer NOT Data Engineer || USC GC || Healthcare must [email protected] |
| [email protected] View all |
| Wed Aug 14 00:15:00 UTC 2024 |