| Databricks Data Engineer || Remote at Remote, Remote, USA |
| Email: [email protected] |
| Greeting, Hope doing well My name is Ankit Kumar, a Sr. Technical Recruiter with Silverlink Technologies. We are looking for a suitable candidate for the position, I came across your resume and found this a perfect fit for this role. I would appreciate it if you can provide the best time and number to reach you to discuss this further. Databricks Data Engineer Location : remote Client: HCL Experience: 12+ years Rate $55/hr. on CTC Job Title/Role Databricks Data Engineer Mandatory Skills Responsible for designing, implementing, and optimizing data pipelines and workflows using Databricks and other data engineering tools; Work closely with cross-functional teams to ensure data integrity, performance, and scalability, enabling the organization to make data-driven decisions Client Interview Needed for Selection (Yes / No) Yes Job Description As a Databricks Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines and workflows using Databricks and other data engineering tools. You will work closely with cross-functional teams to ensure data integrity, performance, and scalability, enabling the organization to make data-driven decisions.Key Responsibilities: Design, develop, and maintain data pipelines and ETL processes using Databricks, Spark, and other data engineering tools. Implement and report on business key performance indicators (KPIs) in data warehousing environments. Utilize analytic SQL to work with traditional relational databases and distributed systems. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Optimize data workflows for performance, scalability, and reliability. Develop and maintain documentation for data engineering processes and solutions. Ensure data quality and integrity through rigorous testing and validation. Preferred Qualifications: 4+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments. 4+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems. 3+ years of experience with programming languages such as Python and PySpark. 3+ years of experience with data orchestration/ETL tools. 2+ years of experience with Databricks/Spark and Power BI. 2+ years of experience with X12 EDI. 2+ years of experience with Azure.Skills and Competencies: Strong understanding of data warehousing concepts and best practices. Proficiency in SQL and experience with relational databases. Expertise in programming languages like Python and PySpark. Experience with data orchestration tools and ETL processes. Familiarity with Databricks, Spark, and Power BI. Knowledge of X12 EDI standards in healthcare domain. Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. (1.) To be responsible for providing technical guidance to a team of developers, enhancing their technical capabilities and increasing productivity. (2.) To conduct comprehensive code reviews, establish and oversee quality assurance processes, performance optimization , implementation of best practices and coding standards to ensure succeful delivery of complex projects. (3.) To ensure process compliance in the assigned module, and participate in technical discussionsorreview as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations). (4.) To collaborate with stakeholders to define project scope, objectives, deliverables and accordingly prepare and submit status reports for minimizing exposure and closure of escalations. Thanks & Regards Ankit Kumar Team Lead [email protected] https://www.linkedin.com/in/ankit-kumar-6300111a1/ Silverlink Technologies Pvt Ltd www.silverlinktechnologies.com -- Keywords: business intelligence information technology Databricks Data Engineer || Remote [email protected] |
| [email protected] View all |
| Fri Sep 13 17:38:00 UTC 2024 |