| BIG DATA Architect :: 10+ years at Remote, Remote, USA |
| Email: [email protected] |
| From: Manohar, Cloudingest [email protected] Reply to: [email protected] Title: BIG DATA Architect Experience: 10+ years Seeking a skilled Data Architect to design and implement data architecture solutions for data-centric projects. The role involves leading the development of enterprise data strategies, creating real-time analytics models, managing data pipelines, and optimizing data processing using various technologies. Design and implement innovative data architecture solutions tailored to the unique requirements of data-centric projects, utilizing cutting-edge technologies and best practices. Lead the refinement and enhancement of enterprise data strategies, setting high standards for data management processes, and ensuring compliance with industry regulations and standards. Utilize DataBricks to develop advanced real-time analytics models that extract actionable insights from complex datasets, empowering data-driven decision-making across the organization. Manage end-to-end data pipelines within Azure Data Factory, overseeing seamless data ingestion, transformation, and delivery processes. Optimize data transformations using Apache Spark, Scala, and Python to ensure high performance, scalability, and data integrity. Implement Delta Lake for reliable and scalable data versioning and management, facilitating efficient data processing and analysis. Implement dynamic data masking techniques in Azure SQL DB to protect Personally Identifiable Information (PII) data, ensuring compliance with data privacy regulations. Leverage Adaptive Query Execution (AQE) frameworks to enhance the performance of complex data processing tasks, optimizing resource utilization and execution efficiency. Collaborate with cross-functional teams to establish robust data communication channels, enabling effective data sharing and enhancing decision-making processes based on data-driven insights. Thanks & Regards Manohar | Sr. Recruiter Email: [email protected] | www.cloudingest.com Keywords: database |
| [email protected] View all |
| Fri Mar 15 22:12:00 UTC 2024 |