| Data Engineer- 10+ at Remote, Remote, USA |
| Email: [email protected] |
| From: Pallavi Sharma, KEY INFOTEK [email protected] Reply to: [email protected] Job Description Minimum Position Qualifications: Extensive knowledge of data principles, patterns, processes, and practices Any experience defining evolutionary data solutions and underlying technologies Stronganalytical skillswith the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy Experience with SQL database design, data modeling Analyze and organize raw data Build data systems and pipelines Evaluate business needs and objectives Interpret trends and patterns Conduct complex data analysis and report on results Demonstrated written and oral communication skills Basic understanding of network and data security architecture Strong knowledge of industry trends Knowledge in a minimum of the following technical disciplines: data warehousing, data management, analytics development, data integration, cloud, servers and storage, and database management Experience building cost effective and performance driven solutions using elastic architectures in Azure Data lake services, Azure Data Factory, and Databricks Platforms. Experience with SQL and NoSQL applications on Big Data Platforms Experience with SSAS Tabular models, Power BI, Dataflows and DAX Experience with Azure Data Platform stack: Azure Data Lake, Azure Synapse, Data Factory and Databricks Experience with Python, Spark and SQL Any experience with streaming technologies like Kafka, IBM MQ and EventHub Desired Previous Experience/Education: Any experience with operational data science, machine learning or artificial intelligence solutions Any experience with data science solutions or platforms Degree in Computer Science, IT, or similar field; a Masters is a plus Data engineering certification (e.g IBM Certified Data Engineer) is a plus Any experience with data science solutions or platforms Any experience with a variety of SQL, NoSQL and Big Data Platforms Any experience building solutions using elastic architectures (preferably Microsoft Azure and Google Cloud Platform) Key Responsibilities Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms Define high-level migration plans to address the gaps between the current and future state Present opportunities with cost/benefit analysis to leadership to shape sound architectural decisions Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement Interpreting data, analyzing results using statistical techniques Developing andimplementingdata analyses, data collection systems and other strategies that optimize statistical efficiency and quality Acquiringdata from primary or secondary data sources and maintaining databases Promote the reuse of data assets, including the management of the data catalog for reference Project: Will be working towards 3 independent domains around Planning, Buying and Forecasting Data. This Data Engineer will not be joining a "team". They will work closely with the DA and the product management team while in the discovery phase of this project. The rest of the team will be added in 2024. Experience with Databricks is a must-have. Keywords: message queue business intelligence information technology |
| [email protected] View all |
| Tue Sep 26 01:30:00 UTC 2023 |