| Data Integration Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Yashwant Singh, DMS Visions Inc [email protected] Reply to: [email protected] Hi, Hope you are doing well, Please find the job description given below and let me know your interest. Position: Data Integration Engineer Location: 100%Remote Duration: 6+ months Job Description: Position Summary: As a Principal Data Engineer, you will be part of a newly formed Engineering team that is focused on making critical data available to our business teams. Using the agile framework, you will build end-to-end pipelines based on rigorous engineering standards and coding practices to deliver data that is accessible and of the highest quality. The Principal Engineer will also contribute to the modernization of our architecture and tools to help increase our output, scalability, and speed. The Principal Data Engineer will design and develop highly scalable and extensible data pipelines which enable collection, storage, distribution, modeling, and analysis of large data sets from numerous channels. This position requires an innovative software engineer who is passionate about data & data quality. The ideal candidate will possess strong data warehousing and API integration experience and the ability to develop scalable data pipelines that make data management and analytics/reporting faster, more insightful, and more efficient. Develop, test, document and maintain scalable data pipelines. Build out new data integrations including APIs to support continuing increases in data volume and complexity. Establish and follow data governance processes and guidelines to ensure data availability, usability, consistency, integrity, and security. Build and implement scalable solutions that align to our data governance standards and architectural road map for data integrations, data storage, reporting, and analytic solutions. Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Design and develop data integrations and a data quality framework. Write unit/integration/functional tests and document work. Design, implement, and automate deployment of our distributed system for collecting and processing streaming events from multiple sources Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues. Guide and mentor less experienced engineers on coding best practices and optimization. Qualifications: Education: 4-year college degree or equivalent combination of education and experience. Prefer academic background in in Computer Science, Mathematics, Statistics, or related technical field. 7 years of relevant work experience in analytics, data engineering, business intelligence or related field. Skilled in object-oriented programming (Python in particular). Experience developing integrations across multiple systems and APIs. Experience with or knowledge of Agile software development methodologies. Experience with cloud-based databases, specifically AWS technologies (e.g. Redshift, RDS, S3, EMR, EC2, Kinesis). Experience using SQL queries as well as writing and optimizing SQL queries in a business environment with large-scale, complex datasets. Experience with data warehouse technologies. Experience creating ETL and/or ELT jobs. Excellent problem solving and troubleshooting skills. Process oriented with great documentation skills. Experience developing in a Linux environment. Experience designing data schemas and operating SQL/NoSQL database systems is a plus. Experience with Big Data tools like Spark, Hadoop, Kafka, etc. is a plus. If you are interested, please share your updated resume and suggest the best number & time to connect with you Thanks & Regards, Yashwant Singh | IT Recruiter | DMS Vision Inc. 4645 Avon Lane, Suite 210, Frisco, TX 75033 [email protected] | Desk- 972-645-5050 www.DMSVisions.com Keywords: sthree information technology |
| [email protected] View all |
| Thu Jan 05 02:55:00 UTC 2023 |