| Need || Databricks Engineer || 12+ Months || Remote at Remote, Remote, USA |
| Email: [email protected] |
| * REMOVE in subject line. * HI, HOPE YOU ARE DOING GREAT TODAY. LET ME KNOW IF YOU ARE INTERESTED IN BELOW REQUIREMENT. PLEASE SEND THE SUITABLE RESUME ALONG WITH CONTACT DETAILS, CURRENT LOCATION ASAP ON [email protected] Title: Databricks Engineer Work Location: Remote Duration: 12+ months Mandatory Skill: Data Quality and Data Governance Job Description: Design, build and implementation of new data pipelines, experience in data ingestion, data cleansing, data standardization, data mart, data orchestration, data quality, data governance, metadata management, data integrations, to name a few. Experience in Implementing data quality rules to ensure the source data is always full, fresh and on-time. Experience in developing data governance rules where applicable (e.g. data retention period, archival policy, access control etc.) Experience in building end to end data orchestration, ability to perform flexible scheduling, implement appropriate dependencies, visualization and handling of data exceptions. Experience in designing and building data pipelines, data transfers, database schemas, DQ metrics, logging and troubleshooting tools. Ability to write test scripts to verify the new data pipeline design that is built on Azure platform meets the requirements in all material respects, and the data quality before delivering to the end users. Experience working with ADF, Databricks, Ataccama One, ADLS, Airflow, Synapse, Python, PySpark. Ability to engage with the business users to assess their BI and Analytics needs; Review the business process and conceptualize the entities that interoperate within the business process. Ability to determine how the various entities are related and develop entity relationship diagrams that represent the connections among the entities. Experience in developing a logical data model and validate the model to ensure that it serves the needs of the business application and its consumers. Ability to transform the logical representation of the model into a physical representation and work with database administrators to instantiate and manage the data. Collaborate with the BI and Analytics teams on creating the optimized, reusable dimensional model, complete with metadata and lineage information Thanks & Regards Bhavanesh Eamani Lead Technical Recruiter PH : 9724400073 Agile Enterprise Solutions Inc. 7460 Warren Pkwy,Suite 100, Frisco, TX 75034. Email: [email protected] Website: www.aesincus.com LinkedIN: https://www.linkedin.com/in/bhavanesh-eamani-741a1a1ba/ * REMOVE in subject line. * Keywords: business intelligence information technology Texas |
| [email protected] View all |
| Wed Nov 08 22:29:00 UTC 2023 |