| Lead Databricks Engineer -2107507-Backfill role || USC, GC, EAD at ofallon, Missouri, USA |
| Email: [email protected] |
| Position: Lead Databricks Engineer -2107507-Backfill role Location: OFallon, MO (Onsite) Duration: Contract Imp Client: Wipro Client:Not disclosed need profiles with PySpark and Hadoop Migration experiences Linkedin must Minimum Qualifications: Candidates are required to have these mandatory skills: Strong hands on in Pyspark and Apache Spark. Experience in Native Spark Migration to Databricks. Experience in Hadoop Migration to Databricks. Experience in Building Data Governance Solutions like Unity Catalog, StarBust etc Build Very Strong Orchestration Layer in Databricks/ADF. Workflows. Build CICD for Databricks in Azure Devops. Process near Real time Data thru Auto Loader, DLT Pipelines. Implement Security Layer in Delta Lake. Implement Massive Parallel Processing Layers in Spark SQL and PySpark. Implement Cost effective Infrastructure in Databricks. Experience In extracting logic and from on prem layers like SSIS, Stored procedures, Informatica, Vertica, Apache Hudi, Filesystems. etc into Pyspark. Ability to Build Solutions as Cloud Agnostic. Proven experience in designing and implementing complex data solutions aligned with business objectives. Expertise in data modelling, integration, security, and governance Hands-on experience with guiding the virtual data model definition, defining Data Virtualization architecture and deployment with focus on Azure, Databricks, PySpark technologies. Prior experience with establishing best practices for business optimizations. Experience with relational and non-relational data stores (Hadoop, SQL, Mongo DB), ETL or ELT tools (SSIS, Informatica, Matillion, DBT), DevOps, Data Lake and Data Fabric concepts In-depth experience with data governance, data integration and related technologies. Proficiency in a variety of database technologies, both relational and non-relational. Knowledge of cloud-based data solutions (e.g., AWS, Azure). Excellent collaboration and communication skills Have a nice day! Thankyou Vijay Tyagi Senior Talent Acquisition Specialist || [email protected] LinkedIn: www.linkedin.com/in/vijay-tyagi-389849240 LARGETON INC | 13800 Coppermine Rd, Herndon, VA 20171 Disclaimer: Largeton is an equal opportunity employer. There is no discrimination based on race, color, religion, sex, national origin, age, disability, or any other protected status. If you believe you have been treated unfairly, please contact our HR department at [email protected]. Keywords: database Missouri Virginia Lead Databricks Engineer -2107507-Backfill role || USC, GC, EAD [email protected] |
| [email protected] View all |
| Fri Jul 12 00:08:00 UTC 2024 |