| Spark or Python Developer-Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Ashok Reddy, Sligo Software Solutions Inc. [email protected] Reply to: [email protected] Greetings from Sligo Software Solutions, Inc. !! SLIGO is a Software Development & IT Consulting company. We have around 100+ IT associates working with our esteemed clients across several domains such as IT, Banking, Healthcare, and Government. We have an urgent requirement for Spark/Python Developer position with our client. Role: Spark/Python Developer Location: N/A, New York Duration: 6 Months Client: Spruce Technology Inc Client Job ID#: SPR-069 BF Moving from IDQ to AWS Glue Duties Design, implement, and maintain scalable data pipeline solutions using Spark, Python, AWS Glue, and Snowflake. Develop and deploy high-performance ETL processes using Spark and Python to ingest data from various sources and load it into Snowflake. Write efficient, maintainable, and scalable data transformation code using Spark, Python, and SQL. Collaborate with team members to develop, test, and maintain data pipeline solutions. Optimize data processing performance through tuning, caching, partitioning, and indexing techniques. Monitor and troubleshoot issues related to data pipelines, ensuring data quality and integrity. Develop and maintain documentation on data pipeline architecture, processes, data flows, and data dictionary. Mandatory Requirements Experience (9+ Years) Requirements Solid experience with Spark is required. Strong expertise in Python is required. Expertise in AWS cloud platform is required. Knowledge of data pipeline concepts and best practices. Experience with AWS Glue and Snowflake is highly desirable. Proficient in SQL and database concepts, with the ability to optimize queries and data processing performance. Strong problem-solving and analytical skills. Excellent communication and collaboration skills, with the ability to work effectively in a team environment. Nice-to-Have Skills: Experience with other cloud platforms, such as Azure or Google Cloud. Knowledge of Java/Scala is a plus. Ashok Reddy Akkala Sligo Software Solutions, Inc. NYS and NYC MBE Certified Company. Email:[email protected] www.sligosoft.com 12 Metro Park Rd, Suite 112 Albany, NY 12205 LinkedIn:https://www.linkedin.com/in/ashok-reddy-a88b471b7/ Keywords: information technology Idaho New York |
| [email protected] View all |
| Wed Jan 31 01:00:00 UTC 2024 |