| Hiring for Senior Data Engineer Alpharetta GA Need 14+ at Alpharetta, Georgia, USA |
| Email: princy.j@maintec.com |
|
UID: b1b9270a72de47d4a68c9a46de406d84 From: Princy Jain, Maintec princy.j@maintec.com Reply to: princy.j@maintec.com Job Title: Senior Data Engineer (PySpark, Databricks, Oracle, Azure) Location: Alpharetta GA(3 days onsite in a week) Job Type: 8+ months contract with good possibility for extension Experience Level: SME (Subject Matter Expert) Job Description: We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Databricks, Oracle PLSQL, and Azure to join our dynamic team. The ideal candidate should have extensive experience handling large data volumes, optimizing data processing performance, and leading cloud-based data migrations. Key Responsibilities: Big Data Processing: Efficiently handle large data volumes by implementing optimized data read and write strategies. Performance Optimization: Implement best practices to enhance performance in data ingestion, transformation, and storage. Data Engineering with PySpark: Develop, optimize, and execute PySpark-based data pipelines in Databricks. Cloud Data Migration: Design and execute migration strategies from Oracle DB to Azure, ensuring data integrity and performance. Oracle PLSQL Development: Implement database solutions including partitions (various types), index creation, and query performance tuning. Databricks Implementation: Configure, optimize, and troubleshoot Databricks environments for data engineering workloads. Collaboration & Documentation: Work with cross-functional teams to define technical requirements, document solutions, and ensure best practices in data engineering. Required Skills & Experience: Expert-level proficiency in PySpark for large-scale data processing. Strong experience working with Databricks for data engineering workloads. Hands-on experience with Oracle PLSQL, including partitioning, indexing, and query tuning. Cloud expertise in Azure, including data migration from Oracle to Azure. Experience handling and optimizing large-scale ETL and data processing pipelines. Strong understanding of distributed computing, parallel processing, and data performance tuning. Excellent problem-solving and debugging skills. Preferred Skills: Experience with Azure Data Factory, Azure Synapse, or other Azure data services. Familiarity with CI/CD practices for data pipelines. Experience with Data Lake, Delta Lake, or other modern data architectures. Education & Certifications: Bachelors or Masters degree in Computer Science, Information Technology, or related field. Certifications in Azure Data Engineering, Databricks, or Big Data technologies are a plus. Keywords: continuous integration continuous deployment database Georgia Hiring for Senior Data Engineer Alpharetta GA Need 14+ princy.j@maintec.com |
| princy.j@maintec.com View All |
| 01:29 AM 15-Mar-25 |