| Data Engineer @ Charlotte, NC at Charlotte, North Carolina, USA |
| Email: [email protected] |
| Need Profiles with all the required skills, Dont share irrelevant profiles. Hi, My name is Balaji and I'm an IT recruiter at Trident Consulting. Trident Consulting is seeking a "Data Engineer" for one of our clients in " Charlotte, NC Remote/Hybrid(3 days office)" A global leader in business and technology services. Role: Data Engineer Location: Charlotte, NC Remote/Hybrid(3 days office) Duration: Contract Required Skills : Python, Apache Spark, Amazon Redshift, Amazon S3, Spark PySpark, Databricks SQL Job summary : We are seeking a highly skilled Data Engineer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have extensive experience in Spark in Scala, Databricks CLI, Delta Live Pipelines, Apache Airflow, Amazon S3, Amazon Redshift, Python, Databricks SQL, Databricks Delta Lake, Databricks Workflows, and PySpark. This hybrid role requires a proactive individual who can contribute to our innovative projects and drive impactful solutions. Responsibilities Develop and maintain scalable data pipelines using Spark in Scala to ensure efficient data processing. Implement and manage Databricks CLI for seamless integration and automation of workflows. Design and deploy Delta Live Pipelines to streamline data ingestion and transformation processes. Utilize Apache Airflow to orchestrate complex data workflows and ensure timely execution Integrate and manage data storage solutions using Amazon S3 and Amazon Redshift for optimal performance. Write and maintain Python scripts to support various data engineering tasks and automation. Leverage Databricks SQL to perform advanced data analysis and generate actionable insights. Utilize Databricks Delta Lake to ensure data reliability and consistency across the platform. Create and manage Databricks Workflows to automate repetitive tasks and improve efficiency Develop and optimize PySpark applications for large-scale data processing and analytics. Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. Provide technical guidance and mentorship to junior developers to foster a culture of continuous learning. Ensure all solutions adhere to best practices and industry standards for data security and compliance. Qualifications Possess a strong background in Spark in Scala with proven experience in developing data pipelines. Demonstrate expertise in using Databricks CLI for workflow automation and integration. Have hands-on experience with Delta Live Pipelines for data ingestion and transformation Show proficiency in Apache Airflow for orchestrating complex data workflows. Exhibit knowledge of Amazon S3 and Amazon Redshift for data storage and management. Be skilled in Python programming for data engineering and automation tasks. Utilize Databricks SQL for advanced data analysis and insights generation. Ensure data reliability and consistency using Databricks Delta Lake. Manage and optimize Databricks Workflows for improved efficiency Develop and maintain PySpark applications for large-scale data processing. Collaborate effectively with cross-functional teams to deliver technical solutions. Provide mentorship and technical guidance to junior developers Adhere to best practices and industry standards for data security and compliance. About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology and engineering professionals in contract and full-time roles. Trident's commitment is to deliver the best and brightest individuals in the industry for our clients' toughest requirements. Some of our recent awards include: 2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area Sincerely yours, Balaji K Trident Consulting 6990 Village Parkway, Suit 212 Dublin, CA 94568 Phone: (925) 488-1999 Ext.427 India: +91 956-683-6349 Email: [email protected] https://www.tridentconsultinginc.com/Consultants/ Keywords: sthree information technology California North Carolina Data Engineer @ Charlotte, NC [email protected] |
| [email protected] View all |
| Fri Oct 25 20:47:00 UTC 2024 |