| Data Architect - Supply Chain Experience at Remote, Remote, USA |
| Email: [email protected] |
| From: Anoop, Sspearhead Inc. [email protected] Reply to: [email protected] Job details: Job Title: Data Architect - Supply Chain Experience Long Term remote role Manager Notes: Manager is looking for 15+ years of exp. Manager is looking for Data Expiration Data modeling is a must have This person will grow into a Data Architect role and will be the backbone of the entire team It would be great to have Auto and Manufacturing Must have conceptual experience; not just the background Should be able to explain clearly how they came up with the solution The manager comes with 25yrs of Data space and will ask detailed questions during the interview process. Senior Data Engineer is responsible for building and maintaining the data infrastructure that enables an organization to efficiently collect, process, store, and analyze data for informed decision-making. Their role is critical in ensuring data availability, quality, and reliability throughout the data lifecycle. Accountabilities: Data Pipeline Architecture Design: responsible for designing and architecting data pipelines that move, transform, and process data from various sources to target data storage or analytics platforms and need to ensure scalability, reliability, and efficiency in these architectures. Data Modeling: They design and implement data models that suit the requirements of the project and structuring data to support efficient querying and analysis. ETL (Extract, Transform, Load) Processes: Building robust ETL processes is a key responsibility. Senior Data Engineers design and develop ETL workflows that extract data from source systems, transform it into the desired format, and load it into Azure Data Lake. Data Integration: integrating data from different sources, which may include databases, APIs, third-party services, and more. Integration involves handling data in various formats and ensuring data consistency and accuracy. Data Quality and Monitoring: implement data quality checks and monitoring mechanisms to identify and rectify data quality issues. Also create alerts and notifications for anomalies in data processing. Performance Optimization: responsible for optimizing the performance of data pipelines and processing systems. This includes fine-tuning queries, optimizing data storage, and managing resources effectively to ensure timely data processing. Data Security: Ensuring data security and implement security measures to protect sensitive data and ensure proper access controls. Collaboration: collaborate with cross-functional teams, including data analysts, business analysts and software engineers, to understand data requirements and provide the necessary guidelines to support their work. Technology Selection: assess and select appropriate tools, technologies, and frameworks for different aspects of the data engineering process and stay up to date with industry trends and emerging technologies. Leadership and Mentoring: As senior members of the team, should be able take on leadership roles by guiding and mentoring junior data engineers. Participate in code reviews, best practice discussions, and training sessions. Troubleshooting and Support: When issues arise in data pipelines or systems, Senior Data Engineer is responsible for diagnosing and resolving these issues in a timely manner to minimize disruptions. Documentation: document data pipelines, workflows, architecture designs, and other relevant processes to ensure knowledge sharing and maintainable systems. Scope and Competency Requirements: Problem-Solving/Know How: (complexity of problems and education/experience & other knowledge required) A bachelors or masters degree in computer science, information technology, data science, or a related field with 7+ years of experience as a data engineer, with a significant portion of that experience specifically working with Azure data services. Proficiency in Microsoft Azure services and tools related to data engineering, such as Azure Data Factory, Azure Databricks, Azure Analytical Service, Azure Synapse Analytics, Azure Cosmos DB, etc. Strong Experience in implementing data solutions in Azure Data Lake platform Experience with Data Governance tools like Azure Purview, Alation.etc are preferred. Expertise in SQL, T-SQL and experience working with various database systems, including relational databases and NoSQL databases is required. Experience with data modeling, schema design, and performance optimization, especially creating tabular models for Self-service analytics using Power BI. Strong skills in data integration, ETL (Extract, Transform, Load) processes, and data orchestration workflows. Expertise in data warehousing concepts and techniques. Programming skills in languages such as Python, PySpark, Java, Scala, or PowerShell for scripting and automation. Experience designing, building, and optimizing end-to-end data pipelines. Proven track record of implementing data solutions that meet performance, scalability, and reliability requirements. Experience with data migration, data warehousing, and data lake solutions. Experience in creating data pipelines to extract the data from SAP applications is preferred. The ability to analyze complex data engineering challenges and develop innovative solutions. Strong troubleshooting skills to identify and resolve issues in data pipelines and systems. Effective communication skills to work collaboratively with cross-functional teams, including data scientists, analysts, and business stakeholders. The ability to translate technical concepts into understandable terms for non-technical team members. Data accuracy and quality are paramount. A Senior Azure Data Engineer should be meticulous in ensuring that data pipelines and processes maintain high data integrity. As a senior role, this individual might be required to lead and mentor junior members of the data engineering team. ATTRIBUTES/SKILLS: Functional knowledge and ability of Systems and Software. Must be a capable team player and able to adapt to various project requirements. Must be able to use methods appropriate to the position and assignment to solve problems and achieve accurate results. Excellent organizational skills for multi-tasking. Demonstrated ability to work in a cross-functional, team oriented environment. Must have the ability to remain organized and self directed in a fast-paced environment. Must have ability to analyze, interpret, and communicate related data, including analytical data. Must have the ability to develop solutions for problems or systems. Must be able to work with minimal supervision displaying strong self-motivation. Must have the ability to learn computer applications as necessary for the position. Must successfully complete any training or certification courses required to support or strengthen position. Must have the ability to read, interpret, and follow verbal and written instructions, work procedures and other related materials. COMMUNICATION: Persuasive, professional communication style. Must possess strong verbal and written communication skills including strong customer service skills. Must communicate appropriate information accurately and clearly as needed including strong presentation skills. Must have the ability to effectively and appropriately interface and communicate with a variety of individuals or groups on a frequent basis. Thanks, Anoop Sspearhead Inc. www.Sspearhead.com Keywords: business intelligence database information technology |
| [email protected] View all |
| Mon Nov 06 18:58:00 UTC 2023 |