| Senior Data Engineer at Chicago, Illinois, USA |
| Email: [email protected] |
| Hi please send me the Suitable profile for the Below Requirement Role: Senior Data Engineer Experience: 10+years Location: Chicago, IL Requirements: Bachelor's degree or experience in Data Science and Management field. At least 8 years experience as a Data Engineer or similar role. At least 3 years experience with Databricks on any cloud platform Strong proficiency in SQL and experience with relational databases. Proficiency in at least one programming language (e.g., Python, Java, Scala) for data processing and scripting. Knowledge of data modeling and database design principles. Good experience with cloud platforms, such as AWS, Azure, or Google Cloud. Preferred Qualifications: Bachelors degree in Computer Science, Engineering, Mathematics or a related field. Experience with stream processing technologies. i.e., Kafka Knowledge of data governance and security best practices. Experience and Certifications in AWS and Databricks technologies. Responsibilities: Design, develop, and maintain scalable and efficient data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse leveraging AWS, Databricks, Python and SQL technologies. Optimize and troubleshoot existing data pipelines for performance and reliability. Implement data quality and validation processes to ensure accuracy and consistency of data. Assemble large, complex sets of data that meet non-functional and functional business requirements. Identify, design and implement internal process improvements including re-design infrastructure for greater scalability, optimize data delivery, and automating manual processes. Thanks & Regards G Shashidhar [email protected] Mindgraph : www.mind-graph.com -- Keywords: information technology Illinois Senior Data Engineer [email protected] |
| [email protected] View all |
| Fri Jul 26 00:21:00 UTC 2024 |