| Azure Data Engineer: Dallas, TX (Local) at Dallas, Texas, USA |
| Email: [email protected] |
| Hi, I hope you are doing great. Kindly find the below-mentioned job description and if interested, share your updated resume at [email protected] Job Title: Data Engineer Location: Dallas, TX (Onsite) Duration: Long Term Interview: Video Visa: USC, GC, H4EAD, GCEAD Required Skill - Azure Data Factory, Azure Data Brick, And Azure Synapse Analytics Job Summary We are seeking a Data Engineer to work on a Data Strategy initiative to join our team. The ideal candidate will have a deep understanding of data modeling, data schemas and has developed ETLs from various sources ensuring high data availability, fault tolerance and security and governance. Responsibilities: Collaborate with stakeholders to understand data requirements and design scalable and efficient data models, schemas, and architectures on the Azure platform. Develop and implement data integration and ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources into Azure data storage systems. Build and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Databricks, or similar tools to automate the movement and transformation of data. Optimize data storage and retrieval mechanisms, ensuring high data availability, fault tolerance, and efficient query performance. Hands-on experience with cloud platforms (MS Azure, AWS or Google Cloud Services) Hands-on experience with distributed computing (preferably using Apache Spark or Databricks) Monitor and troubleshoot data pipelines, identifying and resolving performance issues, data quality problems, and data integration challenges. Collaborate with data scientists and analysts to provide them with access to reliable and well-structured data sets for analysis and reporting purposes. Implement data governance and security measures to protect sensitive data, ensure compliance with regulatory standards, and adhere to data privacy policies. Work closely with the DevOps team to automate deployment processes, ensure continuous integration and delivery of data solutions, and maintain infrastructure as code. Stay updated with the latest advancements in Azure data services, evaluate and implement new tools and features to enhance data engineering processes. Requirements Bachelor's or masters degree in computer science, Engineering, or a related field. Proven experience as a Data Engineer, with a strong focus on Azure, AWS or GCP cloud platform. In-depth knowledge of Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage, and Azure Cosmos DB. Proficiency in designing and implementing scalable data models, data warehouses, and data lakes. Strong understanding of ETL processes, data integration patterns, and data transformation techniques. 5+ years ETL/ELT/Python programming skills including experience with pipeline orchestration tools, logging, monitoring & alerting, deep troubleshooting, and automated testing & deployments (CI/CD) Familiarity with big data technologies and frameworks like Hadoop, Spark, and NoSQL databases is a plus. Strong analytical and problem-solving skills, with the ability to troubleshoot and optimize data pipelines. Excellent communication and collaboration skills to work effectively in a team environment and interact with stakeholders from various disciplines. Thanks & Regards Harshit Sharma | 1Point System LLC Sr. Technical Acquisition Office: (704) 980-0370 Fax: 803-832-7973 [email protected] LinkedIn: linkedin.com/in/harshit-sharma-032388212 115 Stone Village Drive Suite C Fort Mill, SC 29708 An E-Verified company | An Equal Opportunity Employer Disclaimer: If you wish not to receive the email in the future kindly reply to this email with -- Keywords: continuous integration continuous deployment database information technology green card microsoft South Carolina Texas |
| [email protected] View all |
| Wed Jan 03 21:33:00 UTC 2024 |