| Sr. Data Engineers (Local to WA) - Bellevue, WA at Bellevue, Washington, USA |
| Email: [email protected] |
| From: Rahul, Spar Information Systems [email protected] Reply to: [email protected] Hi Associate, Hope you are doing good. I have urgent requirement kindly let me know if you have any resource available. Sr. Data Engineers (Local to WA) Location: Bellevue, WA Duration: 12+ Months Job descriptions for the Sr data engineering for DSnA support: We operate in an Azure + Databricks Lakehouse. Well need a person with: Azure experience - ADF for orchestration, ADLS for storage, AzureDevOps for CI/CD Databricks experience - all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, SparkSQL) PowerShell experience - this is our scripting language of choice SQL proficiency - its used everywhere (TSQL, PostgreSQL) Proficiency with parquet and delta formats Additionally - they will need experience in: SDLC + CI/CD - we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices. Should have a deep understanding of indexes and partitioning. Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources) Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework) Rahul.B Team Lead SPAR Information Systems Email: [email protected] Keywords: continuous integration continuous deployment information technology Washington Sr. Data Engineers (Local to WA) - Bellevue, WA [email protected] |
| [email protected] View all |
| Thu Apr 25 19:09:00 UTC 2024 |