Data Engineer @ Plano, TX - Onsite at Plano, Texas, USA |
Email: [email protected] |
Need Only local Genuine profiles with Old LinkedIn. Hi Hope you doing well! Trident Consulting is seeking a "Data Engineer for one of our clients in Plano, TX/ Onsite. A global leader in business and technology services Job Title: Data Engineer Job Location: Plano, TX/ Onsite Job Type: Contract ***Primarily looking for Spark Scala with Databricks and AWS experience Required Skills : Amazon S3,PySpark,Databricks Workflows, Databricks CLI, Databricks Unity Catalog Admin, Databricks Delta Lake, Databricks SQL, Spark in Scala Job summary: We are seeking a highly skilled Data Engineer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have extensive experience in Spark in Scala, Databricks SQL, Databricks Delta Lake, Databricks Unity Catalog Admin, Databricks CLI, Databricks Workflows, PySpark, and Amazon S3. This role requires a strong technical background and the ability to work effectively in a collaborative environment. Responsibilities: Lead the development and implementation of data processing workflows using Spark in Scala and Databricks. Oversee the management and optimization of data storage solutions with Databricks Delta Lake Provide expertise in Databricks SQL to enable efficient querying and data analysis. Administer Databricks Unity Catalog to ensure data governance and security. Utilize Databricks CLI for seamless integration and automation of data workflows. Develop and manage Databricks Workflows to streamline data processing tasks. Implement PySpark solutions to enhance data processing capabilities. Manage and maintain data storage on Amazon S3, ensuring data integrity and accessibility Collaborate with cross-functional teams to understand data requirements and deliver actionable insights. Ensure data quality and consistency across various datasets. Provide technical support and troubleshooting for data-related issues. Stay updated with the latest advancements in data technologies and tools. Contribute to the continuous improvement of data processing and analysis methodologies. Qualifications: Possess a strong background in Spark in Scala with proven experience in developing data processing workflows. Demonstrate expertise in Databricks SQL for efficient data querying and analysis. Have extensive experience with Databricks Delta Lake for data storage optimization Show proficiency in administering Databricks Unity Catalog for data governance. Utilize Databricks CLI for effective integration and automation of workflows. Develop and manage Databricks Workflows to streamline data processing tasks. Implement PySpark solutions to enhance data processing capabilities. Manage data storage on Amazon S3, ensuring data integrity and accessibility. Collaborate effectively with cross-functional teams to deliver actionable insights. Ensure data quality and consistency across various geospatial datasets. Provide technical support and troubleshooting for data-related issues. Stay updated with the latest advancements in data technologies and tools. Contribute to the continuous improvement of data processing and analysis methodologies. About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract and full-time roles. Trident's commitment is to deliver the best and brightest individuals in the industry for our clients' toughest requirements. Some of our recent awards include: 2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area Balaji Kandasamy Lead Technical Recruiter M: (925) 488-1999 [email protected] WBE | MBE | SBE | WOSB 6101 Bollinger Canyon Road Suite 330, CA 94583 Keywords: sthree information technology California Texas Data Engineer @ Plano, TX - Onsite [email protected] |
[email protected] View all |
Tue Oct 29 03:09:00 UTC 2024 |