| SENIOR DATA ENGINEER (AZURE) LOCAL TO TX (NO H1B) at Remote, Remote, USA |
| Email: [email protected] |
| From: Maseera Khan, Absolute IT [email protected] Reply to: [email protected] Job Description American Bureau of Shipping (2 positions open) American Bureau of Shipping (ABS) Eagle.org Senior Data Engineer (Azure) Spring, Texas Onsite 2-3 days per week Candidate must be a local and must have an updated LinkedIn ID with a picture and curremt location (REQUIRED!!) Long Term Contract Looking for an an Azure Data Engineer for a hybrid long-term contract for a preferred client based in N. Houston, Texas. The Data Engineer will be responsible for supporting the design, development, and maintenance of data pipelines and data processing systems. They will utilize technologies such as Azure, Spark SQL, SQL Server, Azure Data Factory, Azure Databricks, Azure DevOps, Data build Tool (DBT), Git, Power BI, Azure Synapse Analytics, and Azure Databricks. Working under the guidance of senior data engineers, they will play a crucial role in ensuring the availability, reliability, and scalability of the data infrastructure and in supporting the organizational data-products within the company. You will work under the guidance of senior data engineers and play a vital role in ensuring the availability, reliability, and scalability of data infrastructure and supporting out organizational data- products within the organization. Required Skills/Abilities: 5-7 years of experience in data engineering or related roles. Hands-on experience with Azure services: Data Factory, Synapse, and Databricks. Proficiency in SQL programming, including SQL Server and MPP systems. Familiarity with Spark SQL or Databricks for data processing. Experience in DevOps practices for CI/CD and testing in data & analytics teams. Experience with Power BI for data visualization. Proven experience in Azure Synapse Analytics, Synapse Pipelines or Databricks Strong problem-solving skills and attention to detail. Effective communication and teamwork skills. Self-motivated with a passion for learning in data engineering. In-depth understanding of data warehousing concepts and data modeling. Proficiency in data pipeline development and data integration. Solid understanding of source control (preferably git or azure devops) and branching techniques. Strong analytical skills for complex data sets and issue troubleshooting. Hybrid Spring, Texas 2-3 days onsite Excellent verbal and written communication skills Responsibilities: Data pipeline development: Collaborate with the data engineering team to develop and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Factory, Azure Synapse Analytics, Spark SQL, and other relevant technologies. Ensure the timely and accurate movement of data between systems. Data processing and transformation: Develop & Assist in implementing / maintaining data processing and transformation logic using Azure Synapse Analytics, Spark SQL or Databricks. Extract insights from raw data and transform it into meaningful and structured formats in our data products. Strong DBT (Data Build Tool) experience is a plus, as you may be involved in the implementation and management of DBT workflows. Azure service utilization: Work with Azure services such as SQL Server, Azure Data Factory, Azure Synapse and Azure Databricks & DBT to build and manage data infrastructure components. Leverage the capabilities of these services to ensure efficient and scalable data processing. Version control and collaboration: Utilize Azure DevOps and Git for version control and collaborate effectively with the team to manage code repositories and ensure proper documentation and knowledge sharing. Azure DevOps integration: Assist in integrating data engineering workflows with Azure DevOps for continuous integration, continuous deployment, and automated testing. Contribute to the implementation of CI/CD pipelines for data engineering projects. Data Modelling, visualization and reporting: Exposure to Power BI or similar reporting tools. Ability to collaborate with cross-functional teams to gather requirements and translate them into optimal data models (dimensional modelling experience required) Troubleshooting and support: Assist in identifying and resolving data pipeline issues, bottlenecks, and data quality problems. Provide support in investigating and troubleshooting data-related incidents. Continuous learning and growth: Stay updated with the latest advancements in data engineering technologies and tools. Continuously enhance your knowledge of Azure services and data engineering best practices. Keywords: continuous integration continuous deployment business intelligence information technology Idaho SENIOR DATA ENGINEER (AZURE) LOCAL TO TX (NO H1B) [email protected] |
| [email protected] View all |
| Sat Aug 31 01:59:00 UTC 2024 |