prakash - azure data engineer |
[email protected] |
Location: Cottleville, Missouri, USA |
Relocation: YES |
Visa: H1B |
Over 8+ years of technical experience in Analysis, Design, Development with technologies like Spark, Hive, Kafka and HDFS including programming languages such as Python, Scala and SQL.
Strong experience in Software Development Life Cycle (SDLC) including Requirements Analysis, Design Specification and Testing as per Cycle in both Waterfall and Agile methodologies. Proficient in Azure Cloud services including Storage, Database, Data Warehouse, ETL, and Logic Apps. Expertise in Apache Hive, Apache Spark, Python, PySpark, and SparkSQL. Demonstrated proficiency in Azure Data Factory for CI/CD scripting, ETL flows, and pipeline orchestration. Experienced in building ETL data pipelines with PySpark and Spark SQL on Azure Databricks. Experienced in developing ETL processes using T-SQL to ensure data accuracy and consistency. Hands-on experience with Azure Analytics Services: ADLS, ADLA, Azure SQL DW, ADF, and ADB. Implement ad-hoc analysis solutions using Azure Data Lake Analytics/Store, HDInsight. Skilled in Azure Logic App Integration and Multi-Hop Architecture in Data Bricks. Strong understanding and utilization of Serverless SQL pool and Dedicated SQL Pools in Synapse. Proficient in designing and implementing NoSQL databases like Cosmos DB in Azure Data Engineering solutions. Keywords: continuous integration continuous deployment database active directory |