| Application Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Vishal kashyap, sourceinfotechs [email protected] Reply to: [email protected] Role- Application Engineer Location: Plano,TX(Hybrid) An Application Engineer works alongside Information & data Architects, Engineers, Data Scientists, and other stakeholders to design and maintain moderate to advanced data models. The Application Engineer is responsible for designing, building, and maintaining large-scale databases that support web applications and other digital services. The Application Engineer is responsible for developing ETL data pipelines and helping with data lineage requirements implementations and supporting reports that provide accurate and timely data for internal and external clients. This role requires familiarity of data architecture, data sources, data flow and extraction & manipulation of data sets of various sizes. Position Qualifications: UPDATED: There were some updates from the client on this one. They are requiring Collibra experience round the data lineage. Candidates must meet all requirements to be considered. The client has gone through too many to send them otherwise. Thanks. For the Application Engineer / with data lineage Developing ETL data pipelines and helping with data lineage Experience with Collibra required 5 years of experience in Data Engineering, developing, data cataloging, lineage end-to-end scalable data applications and data pipelines 6 years of experience using Informatica IDQ with 3 years IICS ETL experience Programming (e.g., Python) Querying languages ( SQL) Snowflake experience Mapping, Analysis , working with business Position Responsibilities: Design and Methodology Design, build, test and document solutions to implement, validate data lineage, solutions and stabilize data pipeline to ensure reliable operations. Design, implement and operate medium to large-scale, high-volume, high-performance data structures for reporting, analytics, and data science. Define, implement robust data lineage rules and standards, ensure thorough testing and validation is performed to create a quality product Must have a working experience with data modeling, data mapping, transformation and lineage. Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes by leveraging best ETL data tools. Ensure data cataloging, lineage requirements are reviewed, implemented, and tested during the ETL process implementations. Design, develop, manage and build real-time data pipelines from a variety of sources. Collaborate with engineers to adopt best practices in data integrity, design, analysis, testing, validation, and documentation. Coordination with other teams to design optimal patterns for data ingest and egress and coordinate data quality initiatives and troubleshooting. Participate in sprint planning meetings as needed. Continually improve data lineage with the ETL automation and support production activities. Review and are familiar with automated processes for performance and fault tolerance. Design and implement security measures to protect data from unauthorized access or misuse. Keeps management informed of status of on activities through accurate, timely, and appropriate reporting. Contribute to Data Governance, system documentation and sharing of data asset knowledge. Thanks & Regards, Vishal Kashyap Business Development Manager Email- [email protected] | Ph- (302)-204-7465 806, New Castle , Wilmington, DE, US, 19801 Keywords: Delaware Texas |
| [email protected] View all |
| Wed Jan 31 04:50:00 UTC 2024 |