| ETL Developer --- (USC only) at Remote, Remote, USA |
| Email: [email protected] |
| From: Sonali, KPG [email protected] Reply to: [email protected] Position: ETL Developer Location: Remote (EST) Duration: 6 months+ Need LinkedIn Cloud data warehouse experience of some sort Snowflake Matillion Python Control-M IICS Informatica nice to have AWS JOB DESCRIPTION BASIC PURPOSE: Leverages proven Azure/AWS/Snowflake Cloud skills based around the design and development of multiple data pipelines going between legacy on premise and cloud environments. Data focus is on Marketing Analytics in relation to Customer Leads, Contacts & Campaigns. Uses coding skills to enable multiple sources to move data through Snowflake, MDM, RDS, and other cloud data environments using tools such as Spark, Striim, Kafka, Snowpipe, Azure Data factory, AWS Glue, Matillion, FiveTran and more. POSITION RESPONSIBILITIES: Design optimal cloud-hybrid Big Data/Data Warehouse data pipelines and orchestration architectures to migrate existing solutions from on premise to cloud, and to initiate new cloud data solutions. Construct new data platforms and developing pipelines, ELT/ETL and analytical processes to support products and solutions. Provide data warehouse designs and solutions to support enhancements of existing platform, applying relational database principles and advanced approaches to data organization using data warehouse, data mart, and OLAP concepts as appropriate. Work closely with other database and application designers and developers to ensure that designs and solutions meet technical and business expectations. Develop software including database stored procedures, packages, triggers, deployment scripts, data extraction and load (ELT/ETL) scripts. Provide oversight for code written by others to insure it complies with coding, security, performance, and data integrity standards. Develop, implement, and maintain change control and testing processes for modifications to databases. Develop Big Data and Cloud data acquisition, integration and analytics while adhering to corporate strategies, policies, best practices, IT General Controls (ITGC) and SOX compliance where applicable. Prepare technical design documents and estimation including storage, resource, and operational details. Work with development teams, Data Scientists, Database Administrators and Project Management Office as part of Data Engineering team and assist on research, development & implementation of special projects, as needed. Perform in depth application and system integration testing building quality into all work. Exhibit work consistent with the software development lifecycle, including Agile and Kanban. Perform other job related functions as assigned. KNOWLEDGE AND EXPERIENCE: EDUCATION: Master's Degree in a technical, MIS or related business degree from an accredited institution of study; or any equivalent combination of education and relevant work experience. EXPERIENCE: Minimum of 4 years of recent experience developing and implementing data warehouses, data systems or cloud-based solutions (IaaS, PaaS). Experience with message brokers such as Event Hubs or Kafka. Experience working on elastic and data intensive architecture. Experience with R, Python or Spark preferred. Experience with JSON and API calls preferred. KNOWLEDGE & SKILLS: Experience with Data Warehousing technologies such as Snowflake, Azure SQL DW and Redshift. Experience with Big Data technologies including Data Lake, HDInsight, Hadoop, and blob storage preferred. Experience using SQL, T-SQL stored procedures, T-SQL functions; and/or an Oracle Environment using SQL Plus and PL/SQL Coding Languages. Familiarity with complex SQL Server scaling concepts (AlwaysOn, Geo-Scaling, Sharding, Large Scale DB Management). Familiarity with Kimball methodologies of data warehousing. Experience with legacy technologies such as SSIS and Tableau. Knowledge of Load and Performance test practices. Ability to handle multiple tasks, prioritize accordingly and make decisions as required. Must have excellent communication, interpersonal, and analytical skills with a strong customer service orientation. Be highly collaborative, team-oriented and a strong consensus builder. Regards Sonali Gupta Technical Recruiter KPG99 INC E: [email protected] Keywords: database rlang information technology procedural language ETL Developer --- (USC only) [email protected] |
| [email protected] View all |
| Wed Jun 12 05:46:00 UTC 2024 |