Job Role ::::::::::- Data Engineer 13+ exp :::::::::::Remote at Remote, Remote, USA |
Email: [email protected] |
Job Role :- Data Engineer 13+ exp Location Remote Long Term Project J ob Description : We will focus on Azure Databricks, Python, Spark, Kafka and SQL as primary skill. We will make sure resource understands Azure security model. Resource will be working on data integration (ETL), building data quality framework and do data reconciliation activities using DQ framework. Data will be stored in ADLS. *SKILLS:* Mature the Senior Cloud Software Engineer mindset within the agile teams using techniques such as Acceptance Test Driven Development, Continuous Integration, and Continuous Delivery to provide quality products with seamless integration across Development, Quality Assurance, Infrastructure, Operations, and Release Management roles Servant leader who develops and supports a learning organization model through coaching, training, and mentorship. Can adapt as necessary for unintended consequences of this change initiative and understands the value of commitments to delivery made by a development team. Blogging and community support are a part of this role. Expected to work on both tactical and strategic assignments. Expected to handle the manual work while figuring out how to automate it. IT experience on web-based products Agile methodologies and Test Driven Development Continuous integration experience (for example tools like Jenkins, GitHub actions). Expert knowledge in Python/Scala programming (Spark scripting, and API as a big PLUS) Expert knowledge in Spark programming in Databricks (Spark SQL, Spark Streaming) Expert knowledge of Azure Data tools like ADF(Azure Data Factory), Knowledge of the AirFlow or other scheduling software Knowledge of SQL and RDBMS concepts Experience of programming for Kafka is a big PLUS. * Azure Cloud experience sufficient to perform as Azure Data Developer * Azure Cloud security model knowledge * Terraform or Bicep IaaS experience 7 years of IT experience working on positions with hands on experience 2 years of experience working on large scale, multiple team projects 2 years of experience with Agile methodologies and Test-Driven Development 2 years of continuous integration experience (for example tools like Jenkins, Anthill Pro). 4 years of experience programming Python/Scala 3 years of experience with programmatic interaction with a relational database. Thanks & Regards, Dushyant Som Email:- [email protected] Crox Consulting Inc. www.thecroxgroup.com ______________________________________________________________________ RPO Solutions || Staffing Solutions || IT Solutions || ______________________________________________________________________ -- Keywords: information technology Job Role ::::::::::- Data Engineer 13+ exp :::::::::::Remote [email protected] |
[email protected] View all |
Tue Oct 29 23:10:00 UTC 2024 |