| Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Shyam, TechStar Group [email protected] Reply to: [email protected] Job Title: Data Engineer Location: Dallas (TX), NJ, Tampa (FL), Atlanta (GA) High Level Tasks Create Ingestion framework to ingest inventory, topology and other network performance data related to VBG. Build a near real time data curation framework in Cloudera/GCP for MNSO- network performance data Creating Hourly/Weekly/Monthly Aggregates Enrich MNSO performance metrics with topology, customer profile etc. via external systems and prepare data for model training. Build and support APIs to serve curated data to external systems as per SLA expectations. Skillset "Big data expert with 5+ years experience in Hadoop Big data ecosystem (Spark SQL, Spark Functional Programming to support real time streaming in Python or Scala, Spark Performance Tuning, Sqoop, OOZIE, Yarn. HIVE etc.)" Mid-level experience (3+ years) with Data migration/Ingestion Technology (Kafka, Ni-FI) Realtime streaming application build experience and Performance tuning in Flink/Spark Database experience with Druid/Impala/HBase Experience in building and support APIs to expose data to external systems and support Data as Service use cases Keywords: Florida Georgia New Jersey Texas |
| [email protected] View all |
| Mon Feb 06 21:29:00 UTC 2023 |