ETL Lead ll Contract ll Remote at Remote, Remote, USA |
Email: [email protected] |
From: Asad Saeed, DigitalDhara [email protected] Reply to: [email protected] Hi All Role: Matillion ETL with Snowflake Work Location: CA PST hours Type: Contract Job Specification for a Matillion Resource Specialist Objective: Ensure proficient use of Matillion with Snowflake and extracting, transforming, and loading (ETL) data from various API connectors, focusing on the big 4 social media and advertising platforms Google, Facebook, X, LinkedIn, and potentially Reddit. Maintain data quality through orchestrations, as well as perform advanced data transformations within the data lake. Key Responsibilities: Advanced Data Ingestion and Management: Leverage Matillion to create robust ETL pipelines, utilizing orchestration connector components and the generic API tool. Design and implement efficient data ingestion strategies for each platform: Google, Facebook, [X], LinkedIn, and potentially Reddit. Ensure timely and accurate data retrieval, handling various API limits and quotas efficiently. Data Cleaning and Quality Maintenance: Utilize Python scripting capabilities within Matillion to perform advanced data cleaning and quality checks. Implement deduplication algorithms and maintain data integrity during the ETL process. Develop reusable components to validate, cleanse, and enhance data. Data Transformation and Utilization: Blend and transform raw data into actionable insights, ensuring it is analytics-ready. Utilize SQL expertise for performing advanced transformations including joins, aggregations, and window functions. Collaborate with data analysts and stakeholders to understand and implement business logic in transformations. Data Security and Compliance: Implement secure ETL processes to ensure that sensitive data is protected. Ensure that the data management practices are in compliance with GDPR, CCPA, or other relevant data protection regulations. Documentation and Knowledge Sharing: Develop comprehensive documentation for all developed ETL processes and data pipelines. Share knowledge with internal teams regarding best practices, lessons learned, and technical insights. Collaboration and Support: Work closely with other data team members, including data analysts, data scientists, and BI developers. Provide ongoing support and optimization for the ETL processes Thanks & Regards Asad Saeed Technical Recruiter Email: [email protected] Keywords: business intelligence information technology California |
[email protected] View all |
Thu Oct 12 23:19:00 UTC 2023 |