Hiring - Azure Databricks Architect in Kansas City, MO(Onsite) at Kansas City, Missouri, USA |
Email: [email protected] |
From: Sri, VDart Inc [email protected] Reply to: [email protected] Azure Databricks Architect Location: Kansas City, MO(Onsite) Contract Databricks Lakehouse Architecture and Delta(ACID, Schema Enforcement, Time travel, Rollback, and Schema Evolution(merge Schema),) pattern and map with Databricks workspace, Driver, Worker, Executer, Core, Task, Spark Cluster (Configuration, Event Log, Driver Log, Metrics), Databricks JOB, Databricks Workflow, Databricks Interactive and Job Cluster, Schedule Databricks Job, DataFrame, Delta Table, Transaction Log, Ganglia UI, Databricks Notebook, Databrick Secrets scope, Databricks Token, Databricks schema, Repos, DBFS and Databrick CLI. Databricks performance tuning and optimization using Databricks runtime, Photon Acceleration, Data Skew (Salting, Skew Hint, Broadcast join), Optimize, ZOrder, Data skipping, Vacuum and explain plan, liquid partitioning Data Governance, Metadata Management, Data Lineage, RBAC, Insight, auditing, and dashboarding using Databricks Unity Catalog which includes Creating Unity Catalog Enable workspace, ADLS Gen2 Storage, Databricks Access Connector, Creating Managed, and External Metastore, Adding workspace into Metastore, Databricks Account Console, Unity Catalog, Schema, Tables. Spark Architecture includes Spark Core, Spark SQL, Spark Streaming, Structured Streaming, Spark Context, RDD, DAG, DataFrame API, Dataset API, GraphX, and Spark MLlib. Keywords: user interface Missouri |
[email protected] View all |
Thu Aug 17 22:26:00 UTC 2023 |