Scala Developer with Databricks Engineer Houston TX Day one Onsite at Houston, Texas, USA |
Email: [email protected] |
From: Anilkumar, Siri info Solutions [email protected] Reply to: [email protected] Hello Partner, Hope you are doing well!! Greeting from Siri Info Solutions Inc I am Satheesh Kumar with Siri Info. We Siri Info is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients. Job Title : Scala Developer with Databricks Engineer Work Location & Reporting Address: Houston, TX(Day one Onsite) Contract duration :Long Term Minimum years of experience:12+ years Must have Skills: Azure ,Databricks ,Pyspark ,Scala ,SQL Important Note: Candidate must be on video for virtual interview, and should have valid ID Card handy at the time of interview to flash over the call. Description: We are seeking a highly experienced Azure Databricks Developer with a profound proficiency in SCALA and PySpark programming languages. This role requires a minimum of 13 years of hands-on experience in developing, optimizing, and maintaining data solutions on the Azure Databricks platform. The selected candidate will be expected to work 100% onsite, with the location being Houston, TX. Responsibilities: Databricks Development: Design, develop, and implement scalable and efficient data processing solutions using Azure Databricks. Utilize SCALA and PySpark to build robust ETL processes for large-scale data sets. Cluster Management: Manage and optimize Azure Databricks clusters for optimal performance and resource utilization. Implement best practices for cluster configuration, monitoring, and maintenance. Big Data Processing: Work with large volumes of data, ensuring effective processing, transformation, and integration. Implement and optimize data processing workflows to meet performance and scalability requirements. Performance Tuning: Fine-tune and optimize existing ETL processes for maximum efficiency. Identify and address bottlenecks in data processing pipelines. Data Integration: Integrate data from diverse sources, ensuring data consistency and accuracy. Collaborate with data architects and other teams to understand and fulfill data integration requirements. Qualifications: Minimum of 13 years of professional experience in data engineering and development. Expertise in SCALA and PySpark programming languages, with a focus on big data processing. Extensive hands-on experience with Azure Databricks, including cluster management and notebook development. In-depth knowledge of distributed computing and big data processing frameworks. Proven experience in designing and implementing complex ETL processes. Strong proficiency in SQL and data modeling. Excellent problem-solving and troubleshooting skills. Effective communication and collaboration skills. Keywords: access management Idaho Texas |
[email protected] View all |
Thu Oct 19 03:55:00 UTC 2023 |