| Requirement || Data engineer || (Hybrid with Multiple Location) NO H1B at Remote, Remote, USA |
| Email: [email protected] |
| From: Aditya Kumar, Stellent It [email protected] Reply to: [email protected] Job Title Data engineer Location (Hybrid with Multiple Location) Richmond, McLean, Dallas, NYC, Chicago, or Atlanta . Duration long term Job Description Looking for data engineers who can build data pipelines from grounds up. The candidate should be able to assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build pipelines to extraction, transformation, and loading of data from a wide variety of data sources using AWS Glue / EMR. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Develop RestFul API to integrate with third party APIs using a framework. Experience building and optimizing big data data pipelines, architectures and data sets. Strong analytic skills related to working with unstructured datasets. Working knowledge of message queuing, stream processing, and highly scalable big data data stores. Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with data pipeline and workflow management tools: Airflow Experience with AWS cloud services: EC2, EMR, AWS Glue Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with programming language: Python Aditya Kumar Technical Recruiter Stellent IT Phone: 7327959133 Email: [email protected] Gtalk: [email protected] Keywords: information technology |
| [email protected] View all |
| Wed Sep 20 02:01:00 UTC 2023 |