Hiring Sr. Azure Databricks Developer/Data architect (PYSpark + Scala) :: Houston, TX - Day 1 Onsite :: Infosys British Petroleum (BP) :: Pay rate : $65/hr on C2C at Houston, Texas, USA |
Email: fanindra@siriinfo.com |
Hello Partner, Good morning Hope you are doing well!! Greeting from Siri Info Solutions. I am Fanindra with Siri Info Solutions. We Siri Info Solutions is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients Job Title: Sr. Azure Databricks Developer/Data architect (PysPark + Scala) Location: Houston, TX - Day 1 Onsite Duration: Long term contract Description: We are seeking a highly experienced Azure Databricks Developer with a profound proficiency in SCALA and PySpark programming languages. This role requires a minimum of 15+ years of hands-on experience in developing, optimizing, and maintaining data solutions on the Azure Databricks platform. The selected candidate will be expected to work 100% onsite, with the location being Houston, TX. Responsibilities: Databricks Development: Design, develop, and implement scalable and efficient data processing solutions using Azure Databricks. Utilize SCALA and PySpark to build robust ETL processes for large-scale data sets. Cluster Management: Manage and optimize Azure Databricks clusters for optimal performance and resource utilization. Implement best practices for cluster configuration, monitoring, and maintenance. Big Data Processing: Work with large volumes of data, ensuring effective processing, transformation, and integration. Implement and optimize data processing workflows to meet performance and scalability requirements. Performance Tuning: Fine-tune and optimize existing ETL processes for maximum efficiency. Identify and address bottlenecks in data processing pipelines. Data Integration: Integrate data from diverse sources, ensuring data consistency and accuracy. Collaborate with data architects and other teams to understand and fulfill data integration requirements. Qualifications: Minimum of 13 years of professional experience in data engineering and development. Expertise in SCALA and PySpark programming languages, with a focus on big data processing. Extensive hands-on experience with Azure Databricks, including cluster management and notebook development. In-depth knowledge of distributed computing and big data processing frameworks. Proven experience in designing and implementing complex ETL processes. Strong proficiency in SQL and data modeling. Excellent problem-solving and troubleshooting skills. Effective communication and collaboration skills. Best Regards, Fanindra Sharma | Technical Recruiter SIRI INFO SOLUTIONS INC Email id : fanindra@siriinfo.com Desk No: (732) 686-6828 www.siriinfo.com 3 Ethel Rd, Suite # 302 Edison NJ 08817 CPUC Certified Disclaimer:We respect your online privacy. If you would like to be removed from our mailing list please reply with "Remove" in the subject and we will comply immediately. We apologize for any inconvenience caused. Please let us know if you have more than one domain. The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient, be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. We are an equal opportunity employer with a diverse workforce.Note : Any resume submitted by Siri Info is presented with the understanding that the candidate is being considered for your direct end-client (end-client is the company where the work will be performed). If there is any other company involved between the end-client and your company, please do not submit this resume without our written approval. If you submit the resume to another third party, Siri Info reserves the right to work with the third party directly. US Citizens and Green Card Holders are also encouraged to apply Keywords: access management information technology Idaho New Jersey Texas |
fanindra@siriinfo.com View All |
07:38 PM 16-Oct-23 |