| Urgent looking for Azure Data Factory engineer at New Brunswick, New Jersey, USA |
| Email: [email protected] |
| From: Tamkeen Aslam, Orbit People [email protected] Reply to: [email protected] Job Title: Azure Data factory data engineer Location: New Brunswick, NJ Onsite role Overview: We are looking for an experienced Azure Data Factory Data Engineer to join our team. The ideal candidate will focus on sourcing data from ODATA services and loading it into PostgreSQL databases. This role requires expertise in data integration, ETL processes, and a solid understanding of Azure cloud technologies. Knowledge on Azure DataBrciks notebook creation for ETL processing is added advantage. Key Responsibilities: Data Pipeline Development: Design and implement data pipelines using Azure Data Factory to extract data from ODATA sources and load it into PostgreSQL databases. ODATA Integration: Configure and optimize ODATA connectors to ensure efficient data retrieval and integration. Data Transformation: Utilize Azure Data Factorys data flow features to transform data as needed before loading it into PostgreSQL. Performance Monitoring: Monitor and troubleshoot data pipelines to ensure optimal performance and reliability. Collaboration: Work closely with data analysts, database administrators, and stakeholders to gather requirements and deliver effective data solutions. Documentation: Create and maintain documentation for data pipeline architectures, workflows, and processes. Best Practices: Implement data governance and best practices in ETL processes, including version control and testing. Technical Skills: Strong proficiency in Azure Data Factory, including pipeline creation and management. Knowledge of SQL and experience with PostgreSQL, including data modeling and query optimization. Familiarity with Azure services like Azure Blob Storage and Azure SQL Database. Knowledge of programming languages such as Python or Scala for data processing in Databricks Keywords: information technology New Jersey Urgent looking for Azure Data Factory engineer [email protected] |
| [email protected] View all |
| Fri Oct 04 23:49:00 UTC 2024 |