| Azure Data Engineer@Weehawken, NJ (Onsite) Only Local at Weehawken, New Jersey, USA |
| Email: [email protected] |
| Hi Contract Role: Azure Data Engineer Exp 11 Location: Weehawken, NJ (Onsite) Only Local Rate: 50 Must have: Azure Cloud Services, ADF, Databricks, ADLS, JD: Design, Develop, and Maintain Data Pipelines: Build, test, and optimize scalable and efficient ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks, and other Azure tools. Ensure data pipelines run efficiently, are resilient, and scale with increasing data volumes. Data Storage and Management: Architect and manage Azure Data Lake Storage (ADLS) for high-performance storage of structured, semi-structured, and unstructured data. Ensure data security, access control, and data governance standards are followed using Azure Active Directory (AAD), Azure Key Vault, and role-based access controls (RBAC). Collaborate with Data Science and Analytics Teams: Work closely with data scientists and analysts to define data requirements, ensure data quality, and enable data accessibility. Support machine learning workflows by preparing data for use in Azure Databricks, Azure Machine Learning, or other advanced analytics platforms. Data Integration: Integrate data from on-premises and cloud-based sources, ensuring data accuracy and integrity. Develop and implement data transformation and enrichment processes to support analytical use cases. Monitor, Optimize, and Troubleshoot Data Workflows: Monitor performance, reliability, and health of data pipelines and systems. Troubleshoot issues in data pipelines, resolving data inconsistencies, pipeline failures, or slow-running queries. Cloud Cost Management and Optimization: Leverage Azure cost management tools to optimize and manage cloud infrastructure and storage costs. Documentation and Best Practices: Write clear, maintainable documentation for data workflows, data dictionaries, and architecture designs. Ensure coding standards, data management practices, and security protocols are adhered to. Passport Numb is Mandatory Thanks & regards Acharya Sr. Lead IT Recruiter Mail: [email protected] -- Keywords: information technology New Jersey Azure Data Engineer@Weehawken, NJ (Onsite) Only Local [email protected] |
| [email protected] View all |
| Wed Nov 20 02:42:00 UTC 2024 |