| Spark and Python Developer - 6 months Remote at Remote, Remote, USA |
| Email: [email protected] |
| Spark and Python Developer - 6 months Remote I hope you're doing well. I wanted to reach out to you and see if you have suitable candidates for Spark and Python Developer opportunity with one of our clients Spark and Python Developer Must be an expert with Spark and Python Please find the below JD Job Title: Spark and Python Developer Duration: 6 months Location: Remote We are currently seeking an experienced candidate with expertise in Spark and Python. Moving from IDQ to AWS Glue Responsibilities: Design, implement, and maintain scalable data pipeline solutions using Spark, Python, AWS Glue, and Snowflake Develop and deploy high-performance ETL processes using Spark and Python to ingest data from various sources and load it into Snowflake Write efficient, maintainable, and scalable data transformation code using Spark, Python, and SQL Collaborate with team members to develop, test, and maintain data pipeline solutions Optimize data processing performance through tuning, caching, partitioning, and indexing techniques Monitor and troubleshoot issues related to data pipelines, ensuring data quality and integrity Develop and maintain documentation on data pipeline architecture, processes, data flows, and data dictionary Requirements : Solid experience with Spark is required Strong expertise in Python is required Expertise in AWS cloud platform is required Knowledge of data pipeline concepts and best practices Experience with AWS Glue and Snowflake is highly desirable Proficient in SQL and database concepts, with the ability to optimize queries and data processing performance Strong problem-solving and analytical skills Excellent communication and collaboration skills, with the ability to work effectively in a team environment Nice-to-Have Skills : Experience with other cloud platforms, such as Azure or Google Cloud Knowledge of Java/Scala is a plus Regards Ranga Reddy, Account Manager 1149 Bloomfield Ave. Clifton, NJ 07012 [email protected] | sprucetech.com Spruce Technology Inc | 1149 Bloomfield Ave , Suite G , Clifton, NJ 07012 Update Profile | Constant Contact Data Notice Sent by [email protected] powered by Try email marketing for free today! Keywords: information technology New Jersey |
| [email protected] View all |
| Wed Jan 31 19:36:00 UTC 2024 |