azure data engineer : REMOTE: 50 per HR at Remote, Remote, USA |
Email: [email protected] |
From: Jay, Brillius [email protected] Reply to: [email protected] Role: Data Engineer Location: Remote Duration: 6+ Month(s) Required Skills: Data Engineer with a combination of expert SQL skills and software engineering expertise. Extensive experience coding data pipelines and transformations in PySpark/SQL on the Azure Databricks platform. Technical expert in data lake technology and distributed computing architectures (Apache Spark). In-depth knowledge of Azure cloud services related to data engineering and analytics, such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure SQL. Comfortable working with diverse data stores including RDBMS, NoSQL DBs, ADLS Gen2, Parquet, CSV, Delta tables. Knowledge of data integration patterns and approaches (APIs, Microservices, Pub/Sub, Batch, Streaming, etc.). Knowledge of Unity Catalog and data governance standards. Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration. Some experience working with Power BI for reporting and visualizations. Keywords: continuous integration continuous deployment business intelligence |
[email protected] View all |
Sat Sep 09 03:50:00 UTC 2023 |