| Urgent Requirement || Senior Azure Databricks Data Engineer || Remote || 6+ Months at Remote, Remote, USA |
| Email: [email protected] |
| From: Suraj Prashar, Pivotal [email protected] Reply to: [email protected] Hi, Hope you are doing great!! Please find the requirement below, If you find yourself comfortable with the requirement please reply back with your updated resume and I will get back to you or I would really appreciate if you can give me a call back at my contact number (703) 570-8775 * (Ext. 232). Job Title: Senior Azure Databricks Data Engineer Location: Remote Duration: 6+ MONTHS Visa Type: No H1/OPT/CPT Job Description:- Responsibilities: In this role, you will be responsible for: Collaborating with Stakeholders and the Analytics team to analyze business requirements and estimate development efforts. Designing and implementing efficient pipelines using Azure Data Factory and transformations using Databricks SQL and PySpark/Python Developing complex ETL processes using Databricks/SQL/PySpark to transform and process large datasets. Create pipelines for data ingestion from various sources, including web APIs, ADLS, DB connections etc. Utilizing Azure Data Factory to orchestrate, schedule, and manage data workflows. Collaborating with the Data Engineering team to ensure data quality, accuracy, and availability. Conducting testing, troubleshooting, and performance tuning of pipelines and transformations. Ensuring the timely and successful delivery of data solutions. Qualifications: 6+ years of experience as a Data Engineer with a strong focus on ADF, Databricks SQL, and PySpark. Proficiency in SQL/Python for data transformation, manipulation, and efficient data pipelines. Solid understanding of database management systems, ETL frameworks, and data warehousing concepts. Experience with Azure services such as Data Factory, SQL Database, Key Vault, and Databricks on Azure. Hands-on experience with Azure Databricks data modeling + medallion layers Expertise in relational databases (Microsoft SQL Server, MySQL, Oracle), SQL development, and data transformations on large datasets. Working knowledge of diverse data sources including Finance/Sales/Marketing others Strong data modeling skills. Excellent verbal and written communication skills. Legal work authorization in the U.S. without the need for sponsorship. Preferred Skills: Experience working with Big Data sources and processing. Knowledge of Data Build Tool (DBT) for advanced data transformation and analytics. Keywords: database |
| [email protected] View all |
| Fri Aug 18 23:59:00 UTC 2023 |