| Lead Data Engineer || Remote || USC ONLY at Remote, Remote, USA |
| Email: [email protected] |
| Role - Lead Data Engineer Location - Remote NEED SOLID 1 SUB NEED LINKEDIN VERIFIED USC PREFERRED The Lead Data Engineer will be responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with an emphasis on reliability, automation and performance. They will focus on leading the development of solutions, helping transform platforms, and delivering data-driven, meaningful insights and value to the company. What Youll Get to Do: Lead the team to design, configure, implement, monitor, and manage all aspects of Data Integration Framework. Define and develop the Data Integration best practices for the data management environment of optimal performance and reliability. Develop/maintain infrastructure systems (data warehouses/data lakes) and data access APIs. Prepare and manipulate data using big data tools (such as Hadoop, Snowflake, or equivalent MapReduce platform). Provide detailed guidance and performs work related to Modeling Data Warehouse solutions in the cloud OR on-premise. Understand Dimensional Modeling, Denormalized Data Structures, OLAP, and Data Warehousing concepts. Oversee the delivery of engineering data initiatives and projects. Support long term data initiatives as well as Ad-Hoc analysis and ELT/ETL activities. Create data collection frameworks for structured and unstructured data. Apply data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources. Enforce the implementation of best practices for data auditing, scalability, reliability and application performance. Develop and apply data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources. Interpret data, analyze results using statistical techniques, and provide ongoing reports. Execute quantitative analyses that translate data into actionable insights. Provide analytical and data-driven decision-making support for key projects. Design, manage, and conduct QC procedures for data sets using data from multiple systems. Improve data delivery engineering job knowledge by attending educational workshops, reviewing professional publications, establishing personal networks, benchmarking state-of-the-art practices, and participating in professional societies. Youll Bring these Qualifications: 8 years of experience in leading data engineering and cross functional team to implement scalable and fine-tuned ETL/ELT solutions for optimal performance. Bachelors degree in Computer Science, Information Technology, or related discipline (an additional 4 years of relevant work experience may be substituted for Bachelors degree). Experience developing and updating ETL/ELT scripts. Hands-on experience with application development, relational database layout, development, data modeling. Experience with Databricks. Experience with Snowflake is highly desired. Knowledge and understanding of Python or Scala. Strong SQL skills. Experience with Azure SQL Server is highly desired. Knowledge and understanding of database design and implementation concepts. Knowledge and understanding of data exchange formats. Knowledge and understanding of data movement concepts. Strong technical and analytical and problem solving skills to troubleshoot to solve a variety of problems. Strong organizational and communication skills, written and verbal, with the ability to handle multiple priorities. Ability to provide effective direction to and lead technical teams. Kind Regards, Krish Agrani| Absolute IT | IT Recruiter. 116 Village Blvd Suite 200 Princeton New Jersey 08540 Absolute IT -- Keywords: active directory information technology Lead Data Engineer || Remote || USC ONLY [email protected] |
| [email protected] View all |
| Wed Sep 11 01:37:00 UTC 2024 |