Job Opportunities - Principal Data Engineer Bellevue, WA Only Local at Bellevue, Washington, USA |
Email: [email protected] |
From: Iswarya, Smart Techlink Solutions [email protected] Reply to: [email protected] Hi , We do have a priority requirement with one of our clients. Kindly review and let me know if you have any questions. Principal Data Engineer Bellevue, WA (ONLY LOCALS) Note: Need Senior Candidates from 12 to 15 years experience. We operate in an Azure + Databricks Lakehouse. Well need a person with: Azure experience ADF for orchestration, ADLS for storage, AzureDevOps for CI/CD Databricks experience all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, SparkSQL) PowerShell experience this is our scripting language of choice SQL proficiency its used everywhere (TSQL, PostgreSQL) Proficiency with parquet and delta formats Additionally they will need experience in: SDLC + CI/CD we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices. Should have a deep understanding of indexes and partitioning. Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources) Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework) Thanks & Regards Iswarya | Technical Recruiter [email protected] | www.smarttechlink.com | Keywords: continuous integration continuous deployment information technology Washington Job Opportunities - Principal Data Engineer Bellevue, WA Only Local [email protected] |
[email protected] View all |
Tue Aug 20 22:24:00 UTC 2024 |