| Lead Data Engineer - Chicago, IL (Need Locals) - HCL America role - Need 15+ Experience at Chicago, Illinois, USA |
| Email: [email protected] |
| From: Nora West, W3Global [email protected] Reply to: [email protected] Hello, It's best not to share profiles with me if you've already submitted them to HCL America within 3 months. Lead Data Engineer - Chicago, IL - HCL America role MUST HAVE: Python/Pyspark scripting, Glue / lambda, Snowflake (sql, stored procs), Airflow or equivalent orchestration, AWS Cloud formation, Informatica Job Description Design and implement data pipelines to extract, transform, and load data from various sources into a data warehouse Develop and maintain data models and schemas to support business intelligence and analytics applications Optimize data storage and retrieval systems for performance and scalability Collaborate with data scientists and analysts to develop and deploy machine learning models and algorithms Implement data governance policies and procedures to ensure data quality, security, and compliance Manage and monitor data processing and storage infrastructure, including cloud-based platforms such as AWS Develop and maintain ETL workflows using tools Design and implement data integration solutions for thirdparty applications and services Conduct performance tuning and optimization of database systems and queries Mentor and train junior data engineers and other team members on best practices and emerging technologies in data engineering. Building and managing DevOps & DataOps CI/CD pipelines and automated deployments Debugging and resolving issues with cloud service configuration, integration, performance, security standards, scalability. Prepare technical design documents and SLA agreements Ensure the delivery of thorough project documentation. Introduce best practices and provide necessary support from the Center of Excellence as needed. Manage the identification, evaluation, mitigation, and reporting of project risks. Set quality standards and perform regular quality reviews. Ensure that project issues and challenges are resolved promptly in collaboration with the client. -- Thanks & Regards, Nora West Recruiter E: [email protected] LinkedIn : https://www.linkedin.com/in/j-pooja-nora-west-609474191/ US: 1701 Legacy Dr, Suite#1000, Frisco, Texas - 75034 CA: 18 King Street East, Suite 1400 Toronto, ON M5C 1C4 Keywords: continuous integration continuous deployment information technology California Illinois Lead Data Engineer - Chicago, IL (Need Locals) - HCL America role - Need 15+ Experience [email protected] |
| [email protected] View all |
| Fri Sep 20 01:06:00 UTC 2024 |