| Data Management || Data Engineer with Pyspark experience at Chicago, Illinois, USA |
| Email: [email protected] |
| From: sravan, Unicorn Technologies LLC [email protected] Reply to: [email protected] Hi Folks Hope you are doing good Kindly go through JD and share suitable profiles Role :: Data Management/Data Engineer with Pyspark experience Location :: Chicago, IL(ONLY LOCALS) Visa :: H4 EAD, USC , GCEAD Job Summary: The Data Management Specialist will be responsible for managing and optimizing our organization's data infrastructure, ensuring data quality, and implementing data solutions using PySpark, DataBricks, Snowflake, and/or Redshift. The ideal candidate will have a strong background in data management, programming, and cloud-based data platforms. Key Responsibilities: 1. Develop and maintain data pipelines using PySpark to process and transform large volumes of data. 2. Design, implement, and optimize data solutions using DataBricks for data analytics and machine learning applications. 3. Manage and administer cloud-based data platforms such as Snowflake and Redshift, ensuring high availability, scalability, and performance. 4. Collaborate with cross-functional teams to understand data requirements and deliver tailored data solutions. 5. Implement data governance policies and procedures to ensure data quality, consistency, and security. 6. Monitor and troubleshoot data issues, ensuring timely resolution and minimal impact on business operations. 7. Stay updated with the latest trends and technologies in data management, cloud computing, and big data analytics. 8. Provide technical guidance and mentorship to junior data management team members. Qualifications: Bachelor's degree in Computer Science, Information Systems, or related field; Master's degree preferred. Minimum of 5 years of experience in data management, data engineering, or related role. Strong programming skills in Python and experience with PySpark for data processing and analytics. Hands-on experience with DataBricks for building and optimizing data pipelines. Proficiency in managing and administering cloud-based data platforms such as Snowflake and/or Redshift. Solid understanding of data modeling, ETL processes, and data warehousing concepts. Excellent analytical, problem-solving, and communication skills. Ability to work effectively in a fast-paced environment and manage multiple priorities. Preferred Qualifications: Certifications in PySpark, DataBricks, Snowflake, or Redshift. Experience with other data management tools and technologies. Knowledge of machine learning algorithms and techniques. Experience working in banking and payments domain Thanks & Regards Sravan Kumar Technical Recruiter Unicorn Technologies LLC 4080 McGinnis Ferry Road, Suite 1305, Alpharetta, GA 30005 Direct: 470-480-4029 EXT: 121 [email protected] www.unicorntek.com Linkedin: https://www.linkedin.com/in/sravan-kumar-b20416177/ Keywords: golang Georgia Illinois Data Management || Data Engineer with Pyspark experience [email protected] |
| [email protected] View all |
| Thu Apr 11 01:53:00 UTC 2024 |