| Onsite Interview : Azure data Engineer No H1B at Remote, Remote, USA |
| Email: [email protected] |
| This is Onsite Interview Role and Local To Houstan TX Client: American Bureau of Shipping Title: Azure data Engineer Location: Houston, Texas-2-3 days a week Duration: 12 months Rate: $60-$63/hr C2C Visa: ANY MOI: Final round In person Need LinkedIn Data pipeline development: Collaborate with the data engineering team to develop and maintain data pipelines, ETL processes, and data integration workflows using Azure Data Factory, Azure Synapse Analytics, Spark SQL, and other relevant technologies. Ensure the timely and accurate movement of data between systems. Data processing and transformation: Develop & Assist in implementing / maintaining data processing and transformation logic using Azure Synapse Analytics, Spark SQL or Databricks. Extract insights from raw data and transform it into meaningful and structured formats in our data products. Strong DBT (Data Build Tool) experience is a plus, as you may be involved in the implementation and management of DBT workflows. Azure service utilization: Work with Azure services such as SQL Server, Azure Data Factory, Azure Synapse and Azure Databricks & DBT to build and manage data infrastructure components. Leverage the capabilities of these services to ensure efficient and scalable data processing. Version control and collaboration: Utilize Azure DevOps and Git for version control and collaborate effectively with the team to manage code repositories and ensure proper documentation and knowledge sharing. Azure DevOps integration: Assist in integrating data engineering workflows with Azure DevOps for continuous integration, continuous deployment, and automated testing. Contribute to the implementation of CI/CD pipelines for data engineering projects. Data Modelling, visualization and reporting: Exposure to Power BI or similar reporting tools. Ability to collaborate with cross-functional teams to gather requirements and translate them into optimal data models (dimensional modelling experience required) Troubleshooting and support: Assist in identifying and resolving data pipeline issues, bottlenecks, and data quality problems. Provide support in investigating and troubleshooting data-related incidents. Continuous learning and growth: Stay updated with the latest advancements in data engineering technologies and tools. Continuously enhance your knowledge of Azure services and data engineering best practices. Required Skills/Abilities: 5-7 years of experience in data engineering or related roles. Hands-on experience with Azure services: Data Factory, Synapse, and Databricks. Proficiency in SQL programming, including SQL Server and MPP systems. Familiarity with Spark SQL or Databricks for data processing. Experience in DevOps practices for CI/CD and testing in data & analytics teams. Experience with Power BI for data visualization. Proven experience in Azure Synapse Analytics, Synapse Pipelines or Databricks Strong problem-solving skills and attention to detail. Effective communication and teamwork skills. Self-motivated with a passion for learning in data engineering. In-depth understanding of data warehousing concepts and data modeling. Proficiency in data pipeline development and data integration. Solid understanding of source control (preferably git or azure devops) and branching techniques. Strong analytical skills for complex data sets and issue troubleshooting. Desired Skills/Abilities: Experience with Azure Familiarity with Delta Lake Experience with DBT (Data Build Tool) Working understanding of Spark Pool and/or Python -- Keywords: continuous integration continuous deployment business intelligence information technology Texas Onsite Interview : Azure data Engineer No H1B [email protected] |
| [email protected] View all |
| Wed Sep 04 22:00:00 UTC 2024 |