| Job title : Sr. Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| Hello Associate, Hope you are doing well We have the below requirement open. Please send me your genuine candidate on my email ID [email protected] Job title : Sr. Data Engineer Location : Arizona (Remote) Duration: Long Term Visa: EAD, GC, USC(No H1B) Primary Skills: Azure Data factory, Azure Databricks, Azure Data lake storage Job Description: Knowledge required on Data Storage, Data structures, Data Processing, Data Security. Strong in programming languages like Python, Java, or Scala, Hadoop (Mandatory). Knowledge required and Hands on implementation || Lakehouse architecture. Must have knowledge and Hands on implementation || Lakehouse on Microsoft fabric. Design, develop, and implement end-to-end data pipelines using Azure Data Factory for efficient data extraction, transformation, and loading (ETL). Knowledge required and must have work on experience with SAP ecosystem, ECC, BW. Develop and maintain azure data pipelines with SAP as data source and data lake as target location for the pipeline. Ensure data pipelines are scalable, reliable, and meet business requirements. Leverage Azure Databricks for big data processing and analytics, optimizing performance and efficiency. Collaborate with data scientists and analysts to implement and enhance data processing workflows on the Azure Databricks platform. Strong understanding of parallel processing and data architecture patterns, proficient in using the following to create data processing solutions: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure Databricks Microsoft Fabric Develop and maintain databases on Azure SQL Database, ensuring optimal performance and data integrity. Write complex SQL queries and optimize database performance for various data retrieval needs. Implement data integration solutions to consolidate data from diverse sources into a unified format. Transform and cleanse data as needed to meet quality and consistency standards. Monitor data pipelines, Azure Databricks clusters, and SQL databases for performance issues and optimize as necessary. Collaborate with the infrastructure team to ensure the overall health and scalability of the data platform. Experience in distributed systems, data pipelines, Apache Hadoop, and Apache Spark. Strong background in Amazon Web Services/Redshift (for data warehousing), Azure, HDFS and Amazon S3, Database systems (SQL and NoSQL), Data warehousing solutions, ETL Tools, Machine learning. Ability to tackle complex problems, learn quickly and independently, and proactively recommend solutions to improve efficiency or effectiveness. Adhere to Agile principles and philosophies (Scrum or Kanban, as applicable) in fulfilment of the role. Collaborate within the direct team in accordance with Team Agreement, Definition of Ready, and Definition of Done. Work as a cross-functional team member in an Agile setting to help complete and deliver the team commitments. Good to have Azure data engineer certification || DP-203 Good to have Microsoft Fabric Certification || DP 600 -- Keywords: sthree information technology business works green card Idaho Job title : Sr. Data Engineer [email protected] |
| [email protected] View all |
| Tue Oct 22 22:31:00 UTC 2024 |