| Big Data Engineer at Vancouver, Washington, USA |
| Email: [email protected] |
| From: Syed Anwer, ConvexTech Inc [email protected] Reply to: [email protected] Job title: Big Data Engineer Location: Vancouver, WA ONSITE FROM DAY 1 Duration of the project: 12+ Months Contract Visa acceptance: GC or USC Rate: 65 TO 70 /hr. on C2C Vancouver, WA ONSITE FROM DAY 1 Client name (To prevent the dual submission): HP Type of engagement CTC, CTH or FT: CTC Mode of interview: Video Description: Design and implement distributed data processing pipelines using Spark, Python, SQL and other tools and languages prevalent in the Big Data/Lakehouse ecosystem. Analyzes design and determines coding, programming, and integration activities required based on general objectives. Reviews and evaluates designs and project activities for compliance with architecture, security and quality guidelines and standards Writes and executes complete testing plans, protocols, and documentation for assigned portion of data system or component; identifies defects and creates solutions for issues with code and integration into data system architecture. Collaborates and communicates with project team regarding project progress and issue resolution. Works with the data engineering team for all phases of larger and more-complex development projects and engages with external users on business and technical requirements. Collaborates with peers, engineers, data scientists and project team. Typically interacts with high-level Individual Contributors, Managers and Program Teams on a daily/weekly basis. Required skills: Bachelor's or Master's degree in Computer Science, Information Systems, Engineering or equivalent. 6+ years of relevant experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools. 3+ years of experience with Cloud based DW such as Redshift, Snowflake etc. 3+ years experience in Big Data Distributed ecosystems (Hadoop, SPARK, Hive & Delta Lake) 3+ years experience in Workflow orchestration tools such as Airflow etc. 3+ years experience in Big Data Distributed systems such as Databricks, AWS EMR, AWS Glue etc. Leverage monitoring tools/frameworks, like Splunk, Grafana, CloudWatch etc. Experience with container management frameworks such as Docker, Kubernetes, ECR etc. 3+ years working with multiple Big Data file formats (Parquet, Avro, Delta Lake) Experience working on CI/CD processes such as Jenkins, Codeway etc. and source control tools such as GitHub, etc. Strong experience in coding languages like Python, Scala & Java Knowledge and Skills Fluent in relational based systems and writing complex SQL. Fluent in complex, distributed and massively parallel systems. Strong analytical and problem-solving skills with ability to represent complex algorithms in software. Strong understanding of database technologies and management systems. Strong understanding of data structures and algorithms Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools. Strong analytical and problem-solving skills. ConvexTech Syed Anwer Lead Talent Acquisition | Staffing & Recruitment Phone: 214-295-3794 Text Now: 214-296-2578 Email: [email protected] ConvexTech Inc. 10027 Park Meadow Dr Houston TX 77089. |
| [email protected] View all |
| Fri Nov 11 23:53:00 UTC 2022 |