Log Data Engineering - (Hybrid) at Remote, Remote, USA |
Email: [email protected] |
From: Rakesh, Nutech [email protected] Reply to: [email protected] Log Data Engineering Interview: 30 mins Phone + 1 hr Panel interview Work Location: will need to sit onsite in Owings Mills, 2 days onsite, 3 days remote Initial Assignment Duration: 6 months key skills: Process raw data, write scripts, call APIs Log data pipelines in Python Ansible automation (or Terraform) & AWS skills are MUST IaC skills Manage Splunk cloud environment. Linux/ Windows - agents (Splunk, Fluentbit/Fluentd) Troubleshooting incidents Splunk Responsibilities Support systems engineering lifecycle activities for large hybrid Splunk and Cribl deployments, including requirements gathering, design, testing, implementation, operations, and documentation. Implementing log data pipelines through automation in Python to ingest logs into log management platforms like Splunk, Open Search Automating platform management processes through Ansible or other scripting tools/languages Troubleshooting incidents impacting the log data platforms Coordinating and collaboration with users of the platform Develop training and documentation materials Support log data platform upgrades including coordinating testing of upgrades with users of the platform Gather and process raw data from multiple disparate sources (including writing scripts, calling APIs, writing SQL queries, etc.) into a form suitable for analysis Enables log data, batch and real-time analytical processing solutions leveraging emerging technologies Build log data pipelines to help with the development and testing of log data engineering Experience Ability to troubleshoot and diagnose complex issues Able to demonstrate experience supporting technical users and conduct requirements analysis Can work independently with minimal guidance & oversight Experience with IT Service Management and familiarity with Incident & Problem management Highly skilled in identifying performance bottlenecks, identifying anomalous system behavior, and resolving root cause of service issues. Demonstrated ability to effectively work across teams and functions to influence design, operations, and deployment of highly available software Knowledge of standard methodologies related to security, performance, and disaster recovery Required Technical Expertise 3-5 years experience managing and configuring Splunk Enterprise and/or Splunk Cloud Developing and managing requirements, and making data-driven decisions Experience with Linux and Windows agents (Splunk, Fluentbit/Fluentd) for log data engineering Experience in designing, developing, and deploying cloud-based solutions using AWS Experience in onboarding new data, configuration, creating new dashboards, extracting information through Splunk, Cribl Experience in development of systems for data extraction, ingestion and processing of large volumes of data Demonstrated proficiency with scripting and automation (bash, python, other programming languages) Familiarity with Splunk rest APIs Knowledge of cloud platforms (prefer AWS) and container + orchestration technologies Experience with data pipeline orchestration platforms Preferred Technical Experience Splunk Certification (Admin or Architect) Experience with Ansible tower automations Experience using Gitlab Experience with large platform migration efforts Experience with AWS OpenSearch Experience with Cribl Familiarity with data streaming technologies such as Kafka, Kinesis, spark streaming, etc Thanks & Regards Rakesh Nutech Systems, Inc. [email protected] www.nutech-inc.com Keywords: information technology Log Data Engineering - (Hybrid) [email protected] |
[email protected] View all |
Wed May 29 23:46:00 UTC 2024 |