Data Modeler(Need 10 years profile from Banking industry) - Local to NJ at Industry, Texas, USA |
Email: [email protected] |
From: Kavyasree, IT americas INC [email protected] Reply to: [email protected] TItle:Data Modeler(Hybrid : 2-3X in a week ) Location: Jersey City,NJ Migrate existing SSIS ETL scripts to Python; develop new ETL scripts Support existing SSIS SQL Projects Maintain ETL pipelines in and out of data warehouse using combination of Python and Snowflakes SnowSQL Write SQL queries against Snowflake. Understanding data pipelines and modern ways of automating data pipeline using cloud-based Work closely with existing senior integration staff to flush out design, priority and build. Scaffolding and framework will be needed for staging and transforming datasets. Use existing DevOps pipeline for Python and enhance if necessary. Automate Python scripts on our enterrprise scheduler. Strong troubleshooting skills to identify root cause and resolve production issues Skills: Skills At least 5 years of full-time development experience using Python. Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks. Direct experience of building data piplines using Azure Data Factory and (preferably Databricks). Extensive experience in software development and the entire SDLC. Solid understanding of a variety of programming tools and development platforms. Experience in creating high-level product specifications and design documents. Experience in writing Python applications with the benefit of frameworks like Django, Flask, Pyramid, or Tornado. Experience in Python testing and code analysis tools like Pytest and Pylint. Integration experience (ETL, ELT) with Python. Strong SQL skills. Familarity with SSIS would be helpful. General development expertise, use of version control, ticketing, and continuous integration systems. Experience in using an Enterprise Scheduler (Tidal) Experience in an Agile Development environment # On-point communication skills to concisley report status of work/issues and next action, and articulate technical complexity to Businss analysts, Project manager and Business users Keywords: information technology New Jersey |
[email protected] View all |
Fri Aug 25 18:47:00 UTC 2023 |