| Technical Architect - Big Data Technologies Supply Chain at Remote, Remote, USA |
| Email: [email protected] |
| From: Madhu, STM Consulting Inc [email protected] Reply to: [email protected] Technical Architect - Big Data Technologies (Supply Chain Domain ) Please submit good candidates with 15 plus years of experience and skilled in Informatica, DataStage, SQL Server, Apache NiFi, Kafka and AWS, Cloudera Certifications. Duration: 6-12 months, Location: Dallas/remote Rate: $75 Hourly C2C Qualifications: Education: Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field. 15+ years of overall IT experience with a demonstrated track record of major solution design/architecture contributions in a large enterprise. Preferably in Supply Chain Domain Minimum of 5 years in the customer facing roles with a strong focus on data/integration operations Expertise in ETL (Extract, Transform, Load) tools such as Informatica PowerCenter, IBM DataStage, Talend, Microsoft SSIS (SQL Server Integration Services), or Apache NiFi/Airflow and ability to design and implement complex transformation in Python, Spark, Microsoft SQL, Spark-SQL, JOLT transformation. Proficiency in data modeling techniques, including dimensional modeling, star schema, snowflake schema, and data vault modeling. Deep understanding of distributed computing principles, data management concepts, and big data ecosystem components (e.g., Hadoop, Spark, Kafka, Apache Delta Lake). Strong understanding of various integration methodologies via batch using various data formats (CSV, XML, JSON, and Parquet), and hands-on experience in Rest APIs, Hands-on experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes), code management tools and frameworks (e.g., Ci/CD, Git) for understanding and managing big data solutions. Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions. Excellent communication and interpersonal skills, with the ability to collaborate effectively across teams and influence decision-making. Certifications in relevant technologies (e.g., AWS Certified Solutions Architect, Cloudera Certified Professional) are a plus. Job Description: We are seeking a highly skilled and experienced Technical Architect specializing in Big Data Technologies within the supply chain domain. As a Technical Architect, you will play a crucial role in designing, implementing, and optimizing big data solutions tailored to meet the unique challenges and requirements of the supply chain industry. You will collaborate closely with cross-functional teams to ensure the successful delivery of innovative and scalable data solutions that drive operational efficiencies and strategic insights. Responsibilities: Architectural Design: Ability to architect end-to-end ETL solutions, including data ingestion, transformation, storage, and consumption layers, aligned with business requirements and industry best practices. Preferably in Supply Chain Domain Technology Evaluation: Stay abreast of the latest advancements in big data technologies and evaluate their suitability for addressing specific supply chain challenges. Recommend tools, frameworks, and platforms to enhance data processing, analysis, and visualization capabilities. Data Integration: Design robust data integration strategies to consolidate and harmonize data from disparate sources within the supply chain ecosystem, including ERP systems, IoT devices, logistics providers, and external data feeds. Data Modeling: Define and implement appropriate data models, schemas, and structures to support efficient storage, retrieval, and analysis of supply chain data. Apply best practices for data modeling in distributed and real-time processing environments. Performance Optimization: Identify performance bottlenecks and optimization opportunities within big data pipelines and workflows. Collaborate with development teams to implement optimizations and fine-tune system configurations for improved throughput and latency. Security and Compliance: Ensure that big data solutions adhere to industry standards and regulatory requirements related to data security, privacy, and compliance. Implement encryption, access controls, and auditing mechanisms to safeguard sensitive supply chain data. Scalability and Resilience: Design scalable and fault-tolerant architectures that can accommodate growing volumes of supply chain data and withstand system failures or disruptions. Implement clustering, replication, and data partitioning techniques to enhance scalability and resilience. Collaboration and Communication: Work closely with stakeholders across business, IT, and data science teams to understand their requirements, priorities, and pain points. Communicate technical concepts and architectural decisions effectively to both technical and non-technical audiences. Keywords: continuous integration continuous deployment information technology Technical Architect - Big Data Technologies Supply Chain [email protected] |
| [email protected] View all |
| Thu Apr 04 22:29:00 UTC 2024 |