| Lead Azure Data Engineer with Pyspark - Mount Laurel, NJ at Laurel, New York, USA |
| Email: [email protected] |
| Lead Azure Data Engineer with Pyspark Mount Laurel, NJ - Onsite day 1 Contract Required Ex: 12+ Yrs Primary skill set: Databricks, data warehouse Secondary: Azure, RDBMS, Python, Powershell scripting Job Description: Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory with development expertise on batch and real-time data integration Experience in programming using Python RDBMS knowledge and experience in writing the Store Procedures Experience in writing bash and Power shell scripting. Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements Experience in Cloud data warehouse like Azure Synapse, Snowflake analytical warehouse Experience with Orchestration tools, Azure DevOps, and GitHub Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server Experience to own end-to-end development, including coding, testing, debugging and deployment Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies Experience working with structured and unstructured data Familiarity with Azure services like Azure functions, Azure Data Lake Store, Azure Cosmos Ability to provide solutions that are forward-thinking in data and analytics Must be team oriented with strong collaboration, prioritization, and adaptability skills Excellent written and verbal communication skills including presentation skills. -- Keywords: information technology microsoft New Jersey |
| [email protected] View all |
| Wed Feb 14 23:56:00 UTC 2024 |