| need usc or h4ead only-------Data Engineer - Pittsburgh, PA at Pittsburgh, Pennsylvania, USA |
| Email: [email protected] |
| From: abhishek saini, infotechspectrum [email protected] Reply to: [email protected] Job Title: Data Engineer Location: Pittsburgh, PA (3 days Hybrid) Duration: 12 months contract to hire Job Description: Job Description: Data Engineer - ETL with Python, Hadoop & Snowflake Responsibilities Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support scalability of business solutions Craft and implement data pipelines utilizing Glue, Lambda, Spark, and Python Define and deliver reusable components for ETL/ELT framework. Define optimal data flow for system integration and data migration Integrate new data management technologies and software engineering tools into existing structures Qualifications Experienced in Design, Development, and Implementation of large - scale projects in financial industries using Data Warehousing ETL tools (Pentaho) Experience in creating ETL transformations and jobs using Pentaho Kettle Spoon designer and Pentaho Data Integration Designer and scheduling Strong knowledge and experience of SQL, Snowflake, Python and Spark Experience with Big Data/distributed frameworks such as Spark, Kubernetes, Hadoop, and Hive Ability to design ETL/ELT solutions based on user reporting and archival requirements Strong sense of customer service to consistently and effectively address client needs Self-motivated; comfortable working independently under general direction Supplier Call Notes: Finance Engineering project Person need to handle multiple project Spark, Python Hadoop, Snowflake Airflow (Scheduling tool) Develop ETL Pipeline 6-7+ YOE Open to relocation candidates Pentaho is not mandatory Financial experience is a Plus Keywords: Pennsylvania need usc or h4ead only-------Data Engineer - Pittsburgh, PA [email protected] |
| [email protected] View all |
| Wed Jun 26 03:51:00 UTC 2024 |