| Data Engineer infrastructure,Big data Admin at Eden Prairie, Minnesota, USA |
| Email: [email protected] |
| From: Hari krishna, 3K TECHNOLOGIES [email protected] Reply to: [email protected] Jobtitle: Big data Admin (Data Engineer) Location: Eden Prairie, MN 8+ years Hands-on experience with - Azure Data Bricks . Must be well versed with the platform Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks Developing scalable and re-usable frameworks for ingesting of data sets Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms Working with event based / streaming technologies to ingest and process data. Develop and maintain data pipelines on Snowflake and Azure platforms. Assist in deploying applications with Kubernetes and Dockers. Contribute to event streaming and processing using KAFKA. Must have 3+ years of relevant experience Java development background with strong Azure knowledge, develop and maintain Java applications using Springboot, Jboss, and other technologies. Azure Cloud Experience hands-on experience with Storage Format, provisioning options and single tenant and multi-tenant concepts. Bigdata Experience : Proficient in ETL development with Talend, Big Data processing and storage, MDM implementation for data consistency Python/Spark/Scala development > 5+ years coding experience . Lead the design and implementation of cloud-based data solutions. The candidate should be very well versed with Cloud technology and Java is a must. Keywords: Minnesota |
| [email protected] View all |
| Wed Nov 08 21:46:00 UTC 2023 |