| Datawarehouse Engineer||New York, NY - Onsite at New York, New York, USA |
| Email: [email protected] |
| Hi, Hope you are doing great today, Please find the below requirement and if you are comfortable then share the updated resume with contact details ASAP. Job Title: Datawarehouse Engineer - Azure Cloud Location: New York, NY Onsite (Local or nearby only) Duration: 12+ Months Visa: No H1B & Opt, Cpt We are seeking an experienced Azure Data Architecture to join our team and play a pivotal role in in architecting and implementing a data management and reporting solution using Microsoft Azure platform. In this role, you will work closely with data scientists, data analysts, and business stakeholders to design, develop, and maintain data pipelines and analytical solutions using Azure Databricks. Responsibilities: 1. Data Pipeline Development: Design, develop, and maintain data pipelines and ETL processes using Azure Databricks, Apache Spark, and other Azure services to ingest, transform, and prepare data for analytics and reporting. 2. Data Modeling: Collaborate with to design and implement scalable data models that support advanced analytics and machine learning workloads. 3. Data Integration: Integrate data from various sources, including on-premises systems and cloud-based sources, ensuring data quality, reliability, and consistency. 4. Performance Optimization: Optimize data pipelines and queries for performance, scalability, and cost-effectiveness, utilizing best practices for distributed computing and parallel processing. 5. Data Governance and Security: Implement data governance and security measures to ensure data privacy, compliance, and adherence to organizational policies and regulations. 6. Monitoring and Troubleshooting: Set up monitoring and alerting for data pipelines, and proactively troubleshoot and resolve issues to minimize manual interventions. 7. Documentation: Create and maintain documentation for data engineering processes, data flows, and system architecture. 8. Collaboration: Work closely with cross-functional teams, including data scientists, analysts, software developers, and business stakeholders, to understand analytics requirements and deliver solutions that meet business needs. Qualifications: Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. Proven experience in architecting and implementing data engineering, ETL development, and big data processing using Azure Databricks and Apache Spark. Strong proficiency in SQL, relevant programming languages. Familiarity with Azure services such as Azure Data Factory, Azure SQL Data Warehouse, and Azure Storage. Knowledge of data warehousing concepts, data lakes, and data modeling. Experience with version control systems (e.g., Git) and DevOps practices. Excellent problem-solving skills and the ability to work in a collaborative, fast-paced environment. Capable to lead small team and can work independently. Strong communication skills to convey technical concepts to non-technical stakeholders. Experience in healthcare domain will be a huge added advantage. Nice to have good knowledge and understating of .Net framework, Amit Vikal (AV) Thoth IT LLC https://www.thothit.net -- Keywords: information technology New York |
| [email protected] View all |
| Tue Jan 23 00:10:00 UTC 2024 |