Need Sr. Azure Databricks Developer in Houston, TX - Day 1 Onsite at Houston, Texas, USA |
Email: john.p@siriinfo.com |
From: John Papatla, siri info solutions.inc john.p@siriinfo.com Reply to: john.p@siriinfo.com Hello, Hope you are doing well! Greeting from Siri Info Solutions. I am John with Siri Info Solutions. We Siri Info Solutions is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients. Job Title: Sr. Azure Databricks Developer (PysPark + Scala) Location: Houston, TX - Day 1 Onsite Duration: Long term contract Description: We are seeking a highly experienced Azure Databricks Developer with a profound proficiency in SCALA and PySpark programming languages. This role requires a minimum of 13 years of hands-on experience in developing, optimizing, and maintaining data solutions on the Azure Databricks platform. The selected candidate will be expected to work 100% onsite, with the location being Houston, TX. Responsibilities: Databricks Development: Design, develop, and implement scalable and efficient data processing solutions using Azure Databricks. Utilize SCALA and PySpark to build robust ETL processes for large-scale data sets. Cluster Management: Manage and optimize Azure Databricks clusters for optimal performance and resource utilization. Implement best practices for cluster configuration, monitoring, and maintenance. Big Data Processing: Work with large volumes of data, ensuring effective processing, transformation, and integration. Implement and optimize data processing workflows to meet performance and scalability requirements. Performance Tuning: Fine-tune and optimize existing ETL processes for maximum efficiency. Identify and address bottlenecks in data processing pipelines. Data Integration: Integrate data from diverse sources, ensuring data consistency and accuracy. Collaborate with data architects and other teams to understand and fulfill data integration requirements. Qualifications: Minimum of 13 years of professional experience in data engineering and development. Expertise in SCALA and PySpark programming languages, with a focus on big data processing. Extensive hands-on experience with Azure Databricks, including cluster management and notebook development. In-depth knowledge of distributed computing and big data processing frameworks. Proven experience in designing and implementing complex ETL processes. Strong proficiency in SQL and data modeling. Excellent problem-solving and troubleshooting skills. Effective communication and collaboration skills. Location: This is a 100% onsite position, and the candidate is expected to be present at the Houston, TX location from Day 1. Keywords: access management Texas https://jobs.nvoids.com/job_details.jsp?id=741285 |
john.p@siriinfo.com View All |
12:05 AM 12-Oct-23 |