| Azure Data Engineer || EST time zone || no H1b || Remote || 10+ experience required at Remote, Remote, USA |
| Email: [email protected] |
| Hi Hope you are doing well Note: 10+ Yrs exp and must have Azure Cloud exp for 3-4 yrs in recent project. Seeking a Senior Data Engineer to join our team. This full-time contract position is with an industry-leading data analytics firm interested in full-time flex/remote consultants. The ideal candidates will have the required skills listed below and will be eligible and open to being hired by the data firm at the end of the project's duration. This position will work alongside an existing team and leverage enterprise-level technologies and processes. Requirements 5+ years proven ability of professional Data Development experience 3+ years of proven ability to develop with Hadoop/HDFS/Databricks and SQL/NoSQL (Oracle, SQL Server, Mongo) 3+ years of experience with PySpark/Spark 3+ years of experience developing with either Python, Java, or Scala Full understanding of ETL concepts and Data Warehousing concepts Exposure to VCS (Git, SVN) Exposure to CI/CD pipelines Strong understanding of Agile Principles (Scrum) Bachelor's Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM) Desirable Skills Experience with Azure Exposure to NoSQL (Mongo, Cassandra) Experience with Databricks Exposure to Service Oriented Architecture Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.) Proficient with Relational Data Modeling and/or Data Mesh principles Experience with CI/CD - Continuous Integration/Continuous Delivery Typical Duties Participate in the design and development of Hadoop and Cloud-based solutions Perform unit and integration testing Hands-on programming based on TDD, usually in a pair programming environment Design and develop applications for all data warehousing components, including Real-Time Data Ingestion techniques, Transformations, Aggregations, and related data quality strategy Design and implementation of multi-source data channels and ETL processes Collaborate with architecture and lead engineers to ensure consistent development practices Provide mentoring to junior engineers Participate in retrospective reviews Participate in the estimation process for new work and releases Collaborate with other engineers to solve and bring new perspectives to complex problems Drive improvements in people, practices, and procedures Embrace new technologies and an ever-changing environment Regards Vinay Chaudhary https://www.linkedin.com/in/vinay-chaudhary-550630245lipi=urn%3Ali%3Apage%3Ad_flagship3_profile_view_base_contact_details%3Bembwt3VuRmKhCVen6KlbYg%3D%3D Keywords: continuous integration continuous deployment business intelligence golang |
| [email protected] View all |
| Fri Sep 08 23:25:00 UTC 2023 |