| Data Engineer || Portland, OR (Preferred Local) at Portland, New York, USA |
| Email: [email protected] |
| Role: Data Engineer Location: Portland, OR (Preferred Local) Duration: 12+ Months Interview: Video Job Description: 10+ years of experience Hands on experience in Databricks and AWS - EMR [Hive, Pyspark], S3, Athena. Familiarity with Spark Structured Streaming Minimum 4 years experience working experience with Hadoop stack dealing huge volumes of data in a scalable fashion 10+ years of hands-on experience with SQL, ETL, data transformation and analytics functions 8+ years of hands-on Python experience including Batch scripting, data manipulation, distributable packages 4+ years experience working with batch orchestration tools such as Apache Airflow or equivalent, preferable Airflow 4+ years working with code versioning tools such as GitHub or BitBucket; expert level understanding of repo design and best practices Familiarity with deployment automation tools such as Jenkins 8+ years of hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, data quality; hand on experience with API development 4+ years designing and developing relational database objects; knowledgeable on logical and physical data modelling concepts; some experience with Snowflake Familiarity with Tableau or Cognos use cases Familiarity with Agile; working experience preferred Arun Solanki | Sr.Recruiter | cyberThink | ( 908.988.2600 | * [email protected] | Leader in Staffing and IT Services since 1996 -- Keywords: sthree information technology Data Engineer || Portland, OR (Preferred Local) [email protected] |
| [email protected] View all |
| Mon Jul 29 21:34:00 UTC 2024 |