| Senior Data Engineer/Developer. at Remote, Remote, USA |
| Email: [email protected] |
| Job title : Senior Data Engineer/Developer. Location: NYC, NY (Remote but occasionally travel involved) Duration: Long term 10+ Years experience required. We are actively seeking qualified candidates for the position of Senior Data Engineer/Developer. In this role, we are looking for individuals with a strong background in data engineering, particularly experienced in leveraging Databricks, Python/PySpark, and SQL to construct robust and scalable data pipelines suitable for production environments. Key Responsibilities: Designing and developing data pipelines using Databricks, ensuring optimal performance and reliability. Utilizing Python/PySpark for data processing and transformation tasks within the pipeline. Proficiently working with SQL to query and manipulate data, ensuring accuracy and efficiency. Collaborating with cross-functional teams to understand data requirements and deliver solutions that meet business needs. Ensuring the implementation of best practices in data engineering for scalability, maintainability, and performance. Requirements: Proven experience as a Data Engineer/Developer with a focus on Databricks, Python/PySpark, and SQL. Demonstrated ability to build and deploy production-grade data pipelines. Strong expertise in optimizing and troubleshooting data processing tasks using Databricks. Proficiency in Python/PySpark for data manipulation and transformation. Solid understanding of SQL for querying and handling large datasets. Excellent communication skills and the ability to collaborate effectively in a team environment. -- Keywords: information technology New York |
| [email protected] View all |
| Sat Feb 24 01:51:00 UTC 2024 |