Home

Looking for Data Architect (Microsoft Fabric & Azure Databricks) at Remote, Remote, USA
Email: sameer@globalitfamily.com
https://jobs.nvoids.com/job_details.jsp?id=1981817&uid=
From:

SAM,

Global IT Family

sameer@globalitfamily.com

Reply to:   sameer@globalitfamily.com

Requisition Class: DBAR : Database Architect 1

Region Name: State of Georgia

Title/Role: DECAL Data Architect (Microsoft Fabric & Azure Databricks) (752057)

Start Date: 01/06/2025

End Date: 06/30/2025

Worksite Address: 2 Martin Luther King Jr. Drive SE, 754 East Tower, Atlanta, Georgia 30334

Agency Interview Type: Either Web Cam or In Person

Job Description: Data Architect - Microsoft Fabric & Azure Databricks

The Department of Early Care & Learning (DECAL) is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems. This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform. The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake architecture.

Work Location & Attendance Requirements:

           Must be physically located in Georgia

           On-site: Tuesday to Thursday, per manager's discretion

           Mandatory in-person meetings: 

o          All Hands

o          Enterprise Applications

o          On-site meetings

o          DECAL All Staff

           Work arrangements subject to management's decision

While the intent may be a long-term tenure, this position is subject to annual budget restrictions.  The initial contract is through the end of this fiscal year and is anticipated to be renewed July 1st.

Key Responsibilities:

Data Architecture:

           Design end-to-end data architecture leveraging Microsoft Fabric's capabilities.

           Design data flows within the Microsoft Fabric environment.

           Implement OneLake storage strategies.

           Configure Synapse Analytics workspaces.

           Establish Power BI integration patterns.

Integration Design:

           Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.

           Design Delta Lake architecture for IES Gateway data.

           Implement medallion architecture (Bronze/Silver/Gold layers).

           Create real-time data ingestion patterns.

           Establish data quality frameworks.

Lakehouse Architecture:

           Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance.

Data Governance:

           Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance.

Implement row-level security.

           Configure Microsoft Purview policies.

           Establish data masking for sensitive information.

           Design audit logging mechanisms.

Pipeline Development:

           Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration.

Performance Optimization:

           Implement performance tuning strategies for large-scale data processing and analytics workloads.

           Optimize Spark configurations.

           Implement partitioning strategies.

           Design caching mechanisms.

           Establish monitoring frameworks.

Security Framework:

Design and implement security patterns aligned with federal and state requirements for sensitive data handling.

Required Qualifications:

Education:

 Bachelors degree in computer science or related field.

Experience:

           6+ years of experience in data architecture and engineering.

           2+ years hands-on experience with Azure Databricks and Spark.

           Recent experience with Microsoft Fabric platform.

Technical Skills:

Microsoft Fabric Expertise:

           Data Integration: Combining and cleansing data from various sources.

           Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines.

           Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.

           Data Visualization Techniques: Representing data graphically in impactful and informative ways.

           Optimization and Security: Optimizing queries, improving performance, and securing data

Azure Databricks Experience:

           Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics.

           Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes.

           Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement.

           Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.

           Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination)

           Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.

Skill

Required / Desired

Amount

of Experience

6+ years of experience in data architecture and engineering.

Required

6

Years

2+ years hands-on experience with Azure Databricks and Spark.

Required

2

Years

Recent experience with Microsoft Fabric platform.

Required

2

Years

Azure Databricks Experience

Required

2

Years

Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12.

Required

3

Years

Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark

Required

3

Years

Thanks & Regards,

Sameer Kumar

Global IT Family

Email: sameer@globalitfamily.com   

www.globalitfamily.com

Skype: sameer.satapathy

LinkedIn : https://www.linkedin.com/in/samira-kumar-satapathy-10ab0318/ (Open to connect in Linkedin)

Connect with us!

Keywords: business intelligence information technology
Looking for Data Architect (Microsoft Fabric & Azure Databricks)
sameer@globalitfamily.com
https://jobs.nvoids.com/job_details.jsp?id=1981817&uid=
sameer@globalitfamily.com
View All
06:51 PM 04-Dec-24


To remove this job post send "job_kill 1981817" as subject from sameer@globalitfamily.com to usjobs@nvoids.com. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to sameer@globalitfamily.com -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at me@nvoids.com


Time Taken: 1

Location: ,