| Data Engineer - Azure Platform at Raleigh, North Carolina, USA |
| Email: [email protected] |
| From: Dheeraj, webgeosolutions [email protected] Reply to: [email protected] Greetings from Web Geo Solutions, LLC. We have an exciting new job opportunity with our direct client, matching your skills. Please review the job description and respond with all the requested details if you are interested. Job Details JOB ID: NCDPI - Technical Architect- Senior (730992) Client: NC - Last day to apply: 3/21 Initial Term: 12 Months+ Tentative start date: ASAP Interview mode : In-Person Interview Work location: Raleigh, NC Job Description: **This is an onsite position. Job Title: Data Engineer - Azure Platform Overview: We are looking for an experienced Data Engineer to join our team. You will use various methods to import raw data into Azure Cloud. You will analyze data and create rules for the ETL process. The import process will also include identifying the business rules and apply them to the files stored in staging area before moving the files to processed area. The ideal candidate will have a strong background in data engineering, along with expertise in cloud computing. This role offers an exciting opportunity to play a key role in modernizing our technology stack and driving our organization's digital transformation journey. Responsibilities: Collaborate with cross-functional business teams to understand requirements, analyze, and organize raw data import by identifying the ETL rules. Identify and apply transformation rules for legacy data migration from mainframe systems to the Azure cloud platform. Develop and implement data pipelines, ETL processes, and data integration solutions to facilitate the conversion of data. Develop and maintain documentation, best practices, and standards for data engineering processes and procedures. Provide technical leadership and mentorship to team members, guiding them in best practices for data engineering and cloud migration projects. Explore ways to enhance data quality and reliability. Requirements and Skills 1. **Data Modeling and Database Design:** - Proficiency in designing and implementing relational and non-relational databases. - Knowledge of data modeling techniques and tools. 2. **Azure Data Services:** - Deep understanding and hands-on experience with Azure data services such as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage, etc. 3. **ETL (Extract, Transform, Load) Processes:** - Expertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks. - Knowledge of data integration and transformation techniques. 4. **SQL and T-SQL:** - Proficient in writing complex SQL queries and stored procedures. - Familiarity with Transact-SQL (T-SQL) for managing and querying SQL Server databases. 5. **Data Security and Compliance:** - Knowledge of data security best practices and experience implementing security measures for data storage and processing on Azure. - Awareness of compliance requirements and ability to implement solutions that adhere to NC DPI and DIT regulations. 6. **Data Monitoring and Optimization:** - Ability to set up monitoring and logging for data pipelines and databases. - Skills in optimizing data storage and processing for performance and cost-effectiveness. 7. **Scripting and Automation:** - Proficiency in scripting languages like Python or PowerShell for automating data engineering tasks. - Knowledge of Azure Resource Manager (ARM) templates for infrastructure as code. Additionally, obtaining relevant certifications, such as the Microsoft Certified: Azure Data Engineer Associate, can further validate and enhance these skills. Qualifications: Bachelors degree in computer science, Engineering, or a related field Proven experience as a data engineer, with a strong focus on data migration, ETL, and data integration. Hands-on experience with data warehousing concepts, database technologies (SQL on Azure) Strong problem-solving skills, attention to detail, and the ability to work effectively in a fast-paced environment. Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders. If you are interested, please reply with below details for further evaluation Please send all the requested below information for consideration Contact details (and employer details if C2C) Your full legal name (Must match with state issued ID or passport) Phone number Personal email id (this same id should be used to send E-RTR after submission) Desired hourly rate (above max advertised rate is not considered): W2: $ C2C: $ Work Status (H1B, EAD, GC, US Citizen), please attach a copy of work authorization: If H1B, who holds the visa (contact details, please include name, phone number and email) If selected, how soon would you be available to start Have you ever worked for this client If so, please provide team name, project name, reason for leaving and when the engagement ended. Upon selected, employment is subjected to 7-year national criminal background check. Will you be able to attend In-Person interview (Yes or No) Your current address Are you available to be on-site at clients location for the duration of the project Note: Payment for all approved hours will be paid at the straight hourly rate regardless of the total hours worked (regular and overtime hours) by the engaged resource. Do you accept this requirement Upon selection, candidate must be able to provide three (3) references from prior engagements before a final decision is made. Do you accept this requirement LinkedIn profile URL Skill Matrix NCDPI - Technical Architect- Senior (730992) Skill Required / Desired Amount in years Your actual Experience in years (Please fill all of them) Proficiency in designing and implementing relational and non-relational databases. Required 5 Knowledge of data modeling techniques and tools. Required 5 Hands-on experience with Azure data services such as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage, etc. Required 5 Expertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks. Required 5 Knowledge of data integration and transformation techniques. Required 5 Proficient in writing complex SQL queries and stored procedures Required 5 Knowledge of data security best practices and experience implementing security measures for data storage and processing on Azure. Required 5 Ability to set up monitoring and logging for data pipelines and databases. Required 5 Skills in optimizing data storage and processing for performance and cost-effectiveness Required 5 Proficiency in scripting languages like Python or PowerShell for automating data engineering tasks Required 5 Knowledge of Azure Resource Manager (ARM) templates for infrastructure as code Required 5 Your resume in MS Word format, copy of any relevant certifications & copy of work authorization (H1B/GC/EAD). Please check the other positions that are currently open with several NC State agencies http://www.indeed.com/cmp/Web-Geo-Solutions,-LLC/jobs Keywords: database green card wtwo microsoft Idaho North Carolina |
| [email protected] View all |
| Wed Mar 20 01:28:00 UTC 2024 |