| Urgent Need | Azure databricks Engineer | Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Satya Prakash, Envision Tech Sol. [email protected] Reply to: [email protected] Hi, Hope you are doing great! Please find the requirement below, If you find yourself comfortable with the requirement please reply back. Azure Databricks Data Engineer Location Kansascity MO (Remote) a. Databricks Lakehouse and Delta(ACID, Schema Enforcement, Timetravel, Rollback, and Schema Evolution(mergeSchema),) pattern and map with Databricks workspace, Driver, Worker, Executer, Core, Task, Spark Cluster (Configuration, Event Log, Driver Log, Metrics), Databricks JOB, Databricks Workflow, Databricks Interactive and Job Cluster, Schedule Databricks Job, DataFrame , Delta Table, Transaction Log, Ganglia UI , Databricks Notebook, Databrick Secrets scope, Databricks Token, Databricks schema, Repos, DBFS and Databrick CLI. b. Databricks performance tuning and optimization using Databricks runtime, Photon Acceleration, Data Skew (Salting, Skew Hint, Broadcast join), Optimize, ZOrder, Data skipping, Vacuum and explain plan, liquid partitioning c. Data Governance, Metadata Management and Data Lineage, RBAC, Insight, auding and dashboarding using Databricks Unity Catalog which includes Create Unity Catalog Enable workspace, ADLS Gen2 Storage, Databricks Access Connector, Creating Managed and External Metastore, Adding workspace into Metastore, Databricks Account Console, Unity Catalog, Schema, Tables. d. Spark Architecture including Spark Core, Spark SQL, Spark Streaming, Structured Streaming, Spark Context, RDD, DAG, DataFrame API, Dataset API, GraphX, and Spark MLlib. Keywords: user interface Missouri |
| [email protected] View all |
| Wed Aug 23 04:46:00 UTC 2023 |