| Data Integration Engineer-Omaha, NE- Hybrid-No CPT-OPT-H1B at Omaha, Nebraska, USA |
| Email: [email protected] |
| From: sunny, Source Infotech Inc [email protected] Reply to: [email protected] Hi, Hope you are all doing well, Please find the details of Requirement, Data Integration Engineer Omaha, NE- Hybrid 12+months Visa: No CPT/OPT/H1B Must have local ID and have LinkedIn!! Ideally looking for applicants with a solid background in Data Integration, Kafka, Spark, SQL, and Data Pipelines. Job Description Build and maintain data pipelines that are scalable, repeatable, and secure, and can serve multiple users within our company. Facilitate getting data from a variety of different sources, getting it in the right formats, assuring that it adheres to data quality, privacy, and security standards, and assuring that downstream users can get that data quickly. Description Design and build a scalable, low-latency, fault-tolerant streaming data platform that empowers diverse end users to extract meaningful and timely insights from our data assets Work closely with business and technology stakeholders to build modern distributed streaming data pipelines and analytics data stores using streaming frameworks Build a platform that facilitates gathering and collecting data, storing it, performing real-time processing on it, and serving it to end users and decision-making systems. Help drive adoption of the Data Analytics platform as part of the larger data strategy. Maintain an ongoing understanding of emerging data management technologies, industry trends, and best practices. Identify ways to improve data reliability, efficiency, and quality. Hands-on production experience with distributed stream processing frameworks: such as Kafka / Spark Streaming / Storm Experience with deployment platforms such as Kubernetes Production experience in building a robust, fault-tolerant data pipeline that cleans, transforms, and aggregates unorganized and messy data into databases or data sources Experience with micro-services Experience with relational databases (SQL Server or Oracle, etc.) and non-relational databases Practical experience in performance tuning and optimization, bottleneck problem analysis Experience with data warehousing principles, schema design, data governance, and database security is a plus Excellent communication skills Experience with agile or other rapid application development methods. Experience with object-oriented design, coding, and testing patterns as well as experience in engineering (commercial or open source) software platforms and large-scale data infrastructures. Significant knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases. Thanks, Sunny IT Recruiter Source InfoTech Inc., Email: [email protected] Keywords: information technology Idaho Nebraska Data Integration Engineer-Omaha, NE- Hybrid-No CPT-OPT-H1B [email protected] |
| [email protected] View all |
| Tue Jul 30 00:30:00 UTC 2024 |