| Contract job opportunity for Data Engineer with Remote (12+ years of experience required) at Remote, Remote, USA |
| Email: [email protected] |
| From: Praveen, Themesoft Inc [email protected] Reply to: [email protected] Role: Data Engineer Location: Remote Duration: Contract 12+ years of experence required Skills: Apache impala, Kafka, Beam, Hadoop, Spark, Cloudera Big data expert with 5+ years experience in Hadoop Big data ecosystem (Spark SQL, Spark Functional Programming to support real time streaming in Python or Scala, Spark Performance Tuning, Sqoop, OOZIE, Yarn. HIVE etc.)" Mid level experience (3+ years) with Data migration/Ingestion Technology (Kafka, Ni-FI) Realtime streaming application build experience and Performance tuning in Flink/Spark Database experience with Druid/Impala/HBase Experience in building and support APIs to expose data to external systems and support Data as Service use cases GCP is one platform, another on-prem cluster with multiple projects Experience of working on framework/ configuration driven set-up that is scalable High Level Tasks Create Ingestion framework to ingest inventory, topology and other network performance data related to VBG. Build a near real time data curation framework in Cloudera/GCP for MNSO- network performance data Creating Hourly/Weekly/Monthly Aggregates Enrich MNSO performance metrics with topology, customer profile etc. via external systems and prepare data for model training. Build and support APIs to serve curated data to external systems as per SLA expectations Regards, Praveen [email protected] Themesoft Inc | www.themesoft.com Keywords: |
| [email protected] View all |
| Tue Feb 07 21:50:00 UTC 2023 |