| Data Engineer // Chicago, IL (only Locals) // Contract at Chicago, Illinois, USA |
| Email: [email protected] |
| Hi, My name is Naveen Kumar and I represent iTech US Inc. iTech is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have job opening for the below role. Role: Data Engineer Location: Chicago, IL (only Locals) Duration: Contract Key Skills: Datastage, Pyspark, Snowflake, AWS Note: Share only H1 candidates who can share pp no Role Description: Key Responsibilities: Design, develop, and optimize ETL processes using IBM DataStage to extract, transform, and load data from various sources into our data warehouse and analytical systems. Build and maintain data pipelines using PySpark to process large volumes of structured and unstructured data in distributed computing environments. Design and implement data models and schemas in Snowflake, ensuring optimal performance, scalability, and data integrity. Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. Perform data profiling, cleansing, and transformation to ensure data quality and consistency across multiple sources and systems. Monitor and troubleshoot data pipeline performance issues, identify bottlenecks, and implement optimizations to improve efficiency and reliability. Develop and maintain documentation, including data dictionaries, process workflows, and technical specifications, to support data engineering processes. Stay current with emerging technologies and best practices in data engineering, big data processing, and cloud computing, and propose innovative solutions to enhance our data infrastructure. Key Skills and Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred. Proven experience in data engineering roles, with a strong focus on ETL development and data pipeline automation. Proficiency in IBM DataStage for designing and implementing ETL processes. Hands-on experience with Apache Spark and PySpark for distributed data processing and analytics. Experience working with Snowflake or other cloud-based data warehouses. Solid understanding of database concepts, data modeling techniques, and SQL programming. Strong programming skills in Python or other scripting languages. Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform. Excellent analytical, problem-solving, and communication skills. Ability to work effectively in a fast-paced, collaborative environment and manage multiple priorities simultaneously. Thanks & Regards Naveen Kumar iTechUS, Inc linkedin.com/in/naveen-kumar-588721194 -- Keywords: information technology Illinois |
| [email protected] View all |
| Wed Mar 13 02:03:00 UTC 2024 |