Need of Sr. Azure Databricks Developer (PysPark + Scala) at Houston, TX - Day 1 Onsite at Houston, Texas, USA |
Email: [email protected] |
From: lokesh, siri info solutions [email protected] Reply to: [email protected] Hello , Hope you are doing well!! Greeting from Siri Info Solutions. I am LOKESH with Siri Info Solutions. We Siri Info Solutions is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients. Must have : Need only 15+ years profiles Job Title: Sr. Azure Databricks Developer (PysPark + Scala) Location: Houston, TX - Day 1 Onsite Duration: Long term contract Must Haves: Azure, Databricks, PySpark, Scala. Important Note: Candidate must be on video for virtual interview, and should have valid ID Card handy at the time of interview to flash over the call. Description: We are seeking a highly experienced Azure Databricks Developer with a profound proficiency in SCALA and PySpark programming languages. This role requires a minimum of 13 years of hands-on experience in developing, optimizing, and maintaining data solutions on the Azure Databricks platform. The selected candidate will be expected to work 100% onsite, with the location being Houston, TX. Responsibilities: Databricks Development: Design, develop, and implement scalable and efficient data processing solutions using Azure Databricks. Utilize SCALA and PySpark to build robust ETL processes for large-scale data sets. Cluster Management: Manage and optimize Azure Databricks clusters for optimal performance and resource utilization. Implement best practices for cluster configuration, monitoring, and maintenance. Big Data Processing: Work with large volumes of data, ensuring effective processing, transformation, and integration. Implement and optimize data processing workflows to meet performance and scalability requirements. Performance Tuning: Fine-tune and optimize existing ETL processes for maximum efficiency. Identify and address bottlenecks in data processing pipelines. Data Integration: Integrate data from diverse sources, ensuring data consistency and accuracy. Collaborate with data architects and other teams to understand and fulfill data integration requirements. Qualifications: Minimum of 13 years of professional experience in data engineering and development. Expertise in SCALA and PySpark programming languages, with a focus on big data processing. Extensive hands-on experience with Azure Databricks, including cluster management and notebook development. In-depth knowledge of distributed computing and big data processing frameworks. Proven experience in designing and implementing complex ETL processes. Strong proficiency in SQL and data modeling. Excellent problem-solving and troubleshooting skills. Effective communication and collaboration skills. Location: This is a 100% onsite position, and the candidate is expected to be present at the Houston, TX location from Day 1. BEST REGARDS J LOKESH Technical Recruiter Siri InfoSolutions Inc., MWBE Certified Direct / Desk:: (848) 837-0011 [email protected] CONNECT ME IN LINKEDIN SiriInfo Website (eVerify) 3 Ethel Rd, Suite # 302 Edison NJ 08817 US Citizens and Green Card Holders are also encouraged to apply Keywords: access management Idaho New Jersey Texas |
[email protected] View all |
Sat Mar 02 00:49:00 UTC 2024 |