Data Architect at Remote, Remote, USA |
Email: [email protected] |
From: Praveen Kumar, Largeton inc [email protected] Reply to: [email protected] Job Title: Data Architect Duration: 6 months w possible extensions Location: Remote (EST candidates) or Cincinnati, OH - (2 days onsite) Visa: USC and GC Retail experience will always have a higher preference over others for Kroger. Pillar: SCMFA (supply chain & manufacturing) Team: Warehousing Domain Data Interface Project details: This role will be pivotal in designing and building our warehousing domain data interface. The ideal candidate will be an individual contributor capable of leading design discussions, making informed design decisions, and collaborating with stakeholders to create canonical data models. This role offers the opportunity to play a crucial part in shaping the architecture and success of our data solutions. What we are looking for: This person will possess strong technical proficiency in a variety of tools and technologies relevant to data engineering in Azure cloud environments. This includes demonstrated expertise in Azure Databricks for building and optimizing data pipelines, as well as experience with Azure Synapse Analytics for data warehousing and analytics. Proficiency in SQL is essential for querying and manipulating data within these platforms, along with programming skills in Python and PySpark for data processing and transformation tasks. Additionally, the candidate should have experience working with distributed computing frameworks and familiarity with cloud-based storage solutions such as Azure Blob Storage and Azure Data Lake Storage. Knowledge of data modeling, ETL processes, and data security best practices is also crucial for designing and implementing scalable and reliable data solutions. Key Responsibilities Design and implement robust data pipelines for high-throughput data ingestion, transformation, and storage. Optimize data processing workflows for performance and scalability in Azure cloud environments. Ensure data consistency, reliability, and security in distributed data processing environments. Monitor and troubleshoot data pipeline failures, ensuring minimal downtime and maximum reliability. Draft architectural diagrams, interface specifications and other design documents Participate in the development and communication of data strategy and roadmaps across the technology organization to support project portfolio and business strategy Innovate, develop, and drive the development and communication of data strategy and roadmaps across the technology organization to support project portfolio Drive the development and communication of enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms Define high-level migration plans to address the gaps between the current and future state, typically in sync with the budgeting or other capital planning processes Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement Mentor team members in data principles, patterns, processes and practices Promote the reuse of data assets, including the management of the data catalog for reference Draft and review architectural diagrams, interface specifications and other design documents Must haves: 8+ years of experience in data engineering - looking for an Architect level candidate. Top Sills: Databricks, PySpark, & Data Modeling Proficiency in Python, PySpark, and SQL. Experience with data modeling tools and frameworks. Strong understanding of data engineering concepts and hands-on experience with Databricks. Familiarity with system design concepts relevant to data architecture. Knowledge of data governance practices, including the use of Unity Catalog. Keywords: green card Ohio Data Architect [email protected] |
[email protected] View all |
Tue Nov 26 19:57:00 UTC 2024 |