| Principal Data Architect | CloudSufi | Atlanta, GA at Atlanta, Georgia, USA |
| Email: [email protected] |
| Responsibilities: Ideate, architect, design, and develop new enterprise data platforms. Collaborate with cloud and security architects to ensure alignment with overarching technology strategy. Architect and design core components with a microservices architecture. Create and maintain essential data platform SDKs and libraries. Design and develop connector frameworks to source data from disparate systems. Optimize data storage, processing, and querying performance for large-scale datasets. Implement security patterns and practices. Develop data quality frameworks to ensure accuracy and reliability. Collaborate with cross-functional teams to design data models and storage solutions. Implement advanced analytics and machine learning capabilities. Establish observability and data governance frameworks. Stay updated with the latest data engineering trends and technologies. Drive deployment and release cycles for a robust and scalable platform. Required Experience: 15+ years of experience in modern data engineering and software engineering. Prior experience building enterprise-scale data platforms in a green fi eld environment. Pro fi ciency in GCP, BigQuery, SQL, Python, Spark, DBT, Air fl ow, Kafka, Kubernetes, Docker. Experience with distributed microservices-based data architectures. Pro fi ciency in batch and real-time streaming infrastructure and IoT architectures. Strong understanding of metadata management, data cataloging, and data lineage. Hands-on experience with GCP ecosystem and data lakehouse architectures. Familiarity with container technologies like Docker and Kubernetes. Expertise in data modeling, architecture, governance principles, and DataOps. Experience with observability tooling such as Grafana and Datadog. Previous experience working with engineers of all levels. Quali fi cations: Bachelors degree in Computer Science or a related fi eld. Experience with Data Mesh architecture. Knowledge in building Semantic layers for data platforms. Experience in building scalable IoT architectures. Strong knowledge of software development principles and methodologies. Excellent problem-solving skills. Strong communication and interpersonal skills. -- Keywords: information technology Florida Principal Data Architect | CloudSufi | Atlanta, GA [email protected] |
| [email protected] View all |
| Sat Apr 06 04:15:00 UTC 2024 |