Matillion Engineer _ Remote at Remote, Remote, USA |
Email: [email protected] |
From: Sagar Kale, Digital Dhara [email protected] Reply to: [email protected] Data Engineer (Matillion specialist) Location: Remote EST/PST Time zone location. C2C Key Responsibilities Data Engineer (Matillion specialist with Tableau )): A senior resource who understands Data, Experience in ETL tool (Preferably Matillion). Must have very good experience in Tableau (building dashboards with Tableau). Documentation and Knowledge Sharing: - Develop comprehensive documentation for all developed ETL processes and data pipelines. - Share knowledge with internal teams regarding best practices, lessons learned, and technical insights. Collaboration and Support: - Work closely with other data team members, including data analysts, data scientists, and BI developers. - Provide ongoing support and optimization for the ETL processes. Data Related experience info for screening the candidates profile Someone who has worked on Informatica very extensively can pick up Matillion Tool easily. Advanced Data Ingestion and Management: - Leverage Matillion to create robust ETL pipelines, utilizing orchestration connector components and the generic API tool. - Design and implement efficient data ingestion strategies for each platform: Google, Facebook, [X], LinkedIn, and potentially Reddit. - Ensure timely and accurate data retrieval, handling various API limits and quotas efficiently. Data Cleaning and Quality Maintenance: - Utilize Python scripting capabilities within Matillion to perform advanced data cleaning and quality checks. - Implement deduplication algorithms and maintain data integrity during the ETL process. - Develop reusable components to validate, cleanse, and enhance data. Data Transformation and Utilization: - Blend and transform raw data into actionable insights, ensuring it is analytics-ready. - Utilize SQL expertise for performing advanced transformations including joins, aggregations, and window functions. - Collaborate with data analysts and stakeholders to understand and implement business logic in transformations. Data Security and Compliance: - Implement secure ETL processes to ensure that sensitive data is protected. - Ensure that the data management practices follow GDPR, CCPA, or other relevant data protection regulations. This resource should be proficient of using Matillion tool for extracting, transforming, and loading (ETL) data from various API connectors, focusing on the big 4 social media and advertising platforms Google, Facebook, X, LinkedIn, and potentially Reddit. Maintain data quality through orchestrations, as well as perform advanced data transformations within the data lake. Thanks & Regards, Sagar Kale [email protected] Keywords: business intelligence information technology |
[email protected] View all |
Wed Jan 10 00:08:00 UTC 2024 |