Remote Hiring || Apache Druid SME at Apache, Oklahoma, USA |
Email: [email protected] |
Hi, Hope you are doing well. Title: Apache Druid SME Location: Remote Key Responsibilities: 1. Druid Architecture and Development: Design, implement, and manage large-scale Apache Druid clusters. Develop and optimize Druid data ingestion pipelines using batch and real-time data sources. Implement Druid indexing and segment management strategies for efficient data storage and retrieval. Create and maintain Druid schemas and configurations to support various use cases. 2. Data Ingestion and Integration: Integrate Druid with various data sources such as Kafka, Hadoop, and traditional databases. Develop and manage real-time data ingestion processes using Kafka and Druid. Implement and optimize batch ingestion processes from Hadoop, S3, and other storage systems. 3. Query Optimization and Performance Tuning: Optimize Druid queries for performance and efficiency. Implement and maintain Druid aggregations, roll-ups, and other data summarization techniques. Monitor and tune Druid clusters for performance, reliability, and scalability. Analyze query performance and implement strategies to minimize query latency and improve throughput. 4. Security and Compliance: Implement security best practices for Druid, including data encryption, authentication, and authorization. Ensure compliance with data governance policies and regulations. Manage access controls and permissions within Druid. Qualifications: Education: Bachelor's or Masters degree in Computer Science, Engineering, or a related field. 7 to 15 years of total experience with at least 3-5 years of Apache Druid experience. Technical Skills: Extensive experience with Apache Druid, including architecture, configuration, and optimization. Strong understanding of real-time data processing and stream processing frameworks (e.g., Kafka, Flink, Storm). Proficient in data ingestion techniques using Kafka, Hadoop, S3, and other data sources. Experience with SQL and query optimization in Druid. Familiarity with Druid APIs and extension points. Knowledge of data indexing, aggregation, and roll-up strategies in Druid. Proficiency in monitoring and logging tools (e.g., Grafana, Prometheus). Experience with security practices for data systems, including encryption and access control. Strong programming skills in Java, Python, or similar languages. Experience with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes) is a plus. -- Keywords: sthree information technology Remote Hiring || Apache Druid SME [email protected] |
[email protected] View all |
Tue Sep 10 00:52:00 UTC 2024 |