| Sr.Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Zara, TechRakers [email protected] Reply to: [email protected] Position Title: Sr. Data Engineer Location: Vienna, VA 100% remote Duration: 6-12 months The candidate needs to be your employee (no sub vendors) Description: To support the Information System Division and the enterprise by providing comprehensive data engineering solutions, translating Navy Federal's business vision and strategies into effective IT and business capabilities through the design, implementation, and integration of IT systems using the Hadoop platform. The Data Engineer will be responsible for developing and expanding on ingestion frameworks for the CECL Data Management project. Required (Individual Role) 1. Extensive experience in engineering and designing data management solutions using Hadoop platform tools and technologies such as Apache HDFS, Sqoop, Spark, Hive, Impala, HBase, and Kafka 2. Significant experience in Python programming 3. Proficient in the data ingestion pipeline process, exception handling, and metadata management on Hadoop platforms. 4. Hands-on experience creating automated data integration applications using data models, data mappings and business rules specifications to load data warehouses, operational data stores, data marts, and data lakes while programmatically handling exceptions including late arriving, missing, or erroneous data. 5. Experience in UNIX shell scripting 6. Demonstrated experience developing/expanding automated technology controls (e.g., Data Quality checks, Data Movement controls) 7. Demonstrated experience enabling access to data by way of databases or dashboards. 8. Demonstrated experience cleaning, filtering, transforming data, and/or enriching data Desired (Individual Role): 1. Familiarity with optimization of data automation workflows; streamlining of extract-transform-load (ETL) operations. 2. Familiarity with operations, data infrastructure and architecture activities within a financial institution 3. Strategic problem solving and innovation with delivered work 4. Web services development. Micro services development a plus 5. Familiarity with cloud services and/or DevOps processes 6. Passion for learning emerging technical skills, tools, and best practices. 7. Working in an agile environment and familiarity with collaboration tools such as Azure DevOps, and Github 8. Bachelors or Masters degree in Computer Science, or related field Keywords: information technology Virginia |
| [email protected] View all |
| Fri Feb 17 15:07:00 UTC 2023 |