| Hiring Sr Azure Databricks Engineer Houston TX Day 1 Onsite at Houston, Texas, USA |
| Email: [email protected] |
| From: Anilkumar, Siri info Solutions [email protected] Reply to: [email protected] Hello Partner Hope you are doing well!! Greeting from Siri Info Solutions I am Anil Kumar with Siri Info. We Siri Info is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients. Job Title : Sr. Azure Databricks (PysPark + Scala) Engineer Work Location & Reporting Address: Houston, TX - Day 1 Onsite Contract duration :Long Term Minimum years of experience: 15+ years Must Have: Azure, Databricks, PySpark, SCALA Location: This is a 100% onsite position, and the candidate is expected to be present at the Houston, TX location from Day 1. Description: We are seeking a highly experienced Azure Databricks Developer with a profound proficiency in SCALA and PySpark programming languages. This role requires a minimum of 13 years of hands-on experience in developing, optimizing, and maintaining data solutions on the Azure Databricks platform. The selected candidate will be expected to work 100% onsite, with the location being Houston, TX. Responsibilities: Databricks Development: Design, develop, and implement scalable and efficient data processing solutions using Azure Databricks. Utilize SCALA and PySpark to build robust ETL processes for large-scale data sets. Cluster Management: Manage and optimize Azure Databricks clusters for optimal performance and resource utilization. Implement best practices for cluster configuration, monitoring, and maintenance. Big Data Processing: Work with large volumes of data, ensuring effective processing, transformation, and integration. Implement and optimize data processing workflows to meet performance and scalability requirements. Performance Tuning: Fine-tune and optimize existing ETL processes for maximum efficiency. Identify and address bottlenecks in data processing pipelines. Data Integration: Integrate data from diverse sources, ensuring data consistency and accuracy. Collaborate with data architects and other teams to understand and fulfill data integration requirements. Qualifications: Minimum of 13 years of professional experience in data engineering and development. Expertise in SCALA and PySpark programming languages, with a focus on big data processing. Extensive hands-on experience with Azure Databricks, including cluster management and notebook development. In-depth knowledge of distributed computing and big data processing frameworks. Proven experience in designing and implementing complex ETL processes. Strong proficiency in SQL and data modeling. Excellent problem-solving and troubleshooting skills. Effective communication and collaboration skills. Keywords: access management Texas |
| [email protected] View all |
| Mon Oct 16 19:51:00 UTC 2023 |