Home

Hiring!!!- Data Architect - Louisville, KY at Louisville, Kentucky, USA
Email: [email protected]
Data Architect

Louisville, KY

We are seeking an experienced Data Architect with
hands-on expertise in Azure Databricks, Azure Data
Lakehouse, and Medallion Architecture. The ideal candidate will
have strong implementation experience, including the integration of Delta
Lake tables, and a background in working with Customer Data
Platforms (CDP). This role requires a deep understanding of cloud-native
data solutions and the ability to architect and deliver scalable, high-performing
data platforms that can support advanced analytics, machine learning, and
business intelligence solutions.

Key Responsibilities:

Design and Implement Data Architecture
: Lead the design and development of scalable,
cloud-based data architectures leveraging Azure Data Lakehouse and Medallion
Architecture principles.

Azure Databricks and Delta Lake
: Architect and implement data pipelines and ETL
processes using Azure Databricks, ensuring seamless
integration with Delta Lake to enable ACID transactions,
time travel, and optimized data storage.

Medallion Architecture
: Implement the Medallion Architecture pattern,
building Bronze, Silver, and Gold layers to ensure efficient data
processing, aggregation, and enrichment for analytics and reporting.

Customer Data Platform (CDP) Integration
: Design and manage the data architecture to
effectively handle customer data, ensuring the Customer Data
Platform (CDP) is integrated with the Azure data ecosystem,
enabling personalized and customer-centric analytics.

Data Lakehouse Management
: Lead the implementation and optimization
of Azure Data Lake Storage (ADLS) to support structured,
semi-structured, and unstructured data storage, ensuring efficient
querying and data retrieval.

Data Governance and Security
: Define and implement robust data governance,
security, and compliance practices using tools like Azure Data
Catalog, Azure Purview, and Azure Key Vault.
Ensure data is securely stored and accessed in compliance with data
privacy regulations (GDPR, CCPA).

Performance Optimization
: Optimize data pipelines for performance,
scalability, and cost-efficiency, ensuring that data is processed
efficiently and meets SLAs for downstream analytics and reporting systems.

Collaboration with Data Engineers and Analysts
: Work closely with data engineers, business
analysts, and data scientists to define data requirements, ensuring that
data pipelines are designed to meet business needs.

Real-Time Data Integration
: Architect real-time data ingestion pipelines,
integrating with various data sources (APIs, event hubs, etc.), and
streamlining real-time analytics using Azure Databricks and Delta Lake.

Documentation and Best Practices
: Establish best practices for data architecture,
provide documentation for data pipelines and architecture, and ensure
knowledge sharing across the organization.

Required Qualifications:

5+ years of experience
in data architecture and engineering, with
expertise in Azure Databricks, Azure Data Lakehouse,
and Delta Lake.

Hands-on experience
implementing Medallion Architecture,
building and managing Bronze, Silver, and Gold data layers.

Strong experience with Azure Data Lake
Storage (ADLS) and integration with Delta Lake for
efficient data storage and querying.

Customer Data Platform (CDP)
experience, with the ability to design and
integrate customer-centric data architectures that drive personalized
analytics.

Experience in data governance, security, and
compliance using Azure tools like Azure Purview, Data
Catalog, and Key Vault.

Proven experience in ETL/ELT development and
real-time data ingestion pipelines, working with large-scale datasets.

Strong knowledge of SQL, Python,
and Spark for data processing, analysis, and pipeline
development.

Familiarity with data modeling techniques, big
data technologies, and data warehousing in a cloud environment.

Excellent communication and collaboration skills,
with the ability to work cross-functionally and lead data-driven
initiatives.

Preferred Qualifications:

Experience with machine learning and advanced
analytics workflows using Azure Databricks.

Familiarity with API integration and
real-time data streaming solutions like Azure Event Hubs or Azure
Stream Analytics.

Knowledge of DevOps for data,
including automated CI/CD pipelines for data deployments.

Education:

Bachelors or Masters degree in Computer Science, Information Systems,
or a related field

--

Keywords: continuous integration continuous deployment information technology Kentucky
Hiring!!!- Data Architect - Louisville, KY
[email protected]
[email protected]
View all
Wed Oct 23 20:27:00 UTC 2024

To remove this job post send "job_kill 1869519" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]
Time Taken: 0

Location: ,