| Lead Data Engineer || Remote || Contract || at Remote, Remote, USA |
| Email: [email protected] |
| From: vishnu kumar yadav, sibitalent [email protected] Reply to: [email protected] Hi, Hope you are doing well Role: Lead Data Engineer Location: Remote PST time zone Employment: Contract Job description: 15 + Years Experience please do not share any junior profile , share only 15+ years candidate Must Have: Self-organized and ability to lead a team Excellent understanding of data, database models, data life cycle Strong SQL Skills Good in python programming for data manipulation, cleansing, transformation, storage Exp in Snowflake Good exposure to any cloud - AWS, Azure or GCP Good to have: Pandas, Pyspark, Snowflake, Airflow, DBT, Visualization skills Responsibilities for Data Engineer Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies. Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. Work with data and analytics experts to strive for greater functionality in our data systems. Qualifications for Data Engineer 8 to 10 years of experience working in data engineering, business intelligence or related field delivering large scale data platforms and services. Ideal candidate will have the following skills: A successful history of manipulating, processing and extracting value from large, disconnected datasets. Expertise in data modeling, data access and data storage techniques. The candidate should have foundational knowledge of dimensional modeling to build a data warehouse Strong experience building transformational logic using SQL on relational SQL and NoSQL databases. Skills using DBT framework for data transformation is plus Robust programming skills and strong experience with Python to ingest, transform and load the data Experience building and optimizing big data data pipelines, architectures and data sets using tools like Airflow. Experience with AWS cloud services: EC2, EMR, RDS, Redshift Thanks and Regards, Vishnu yadav Email : [email protected] Contact :19086529380 Web: www.sibitalent.com Keywords: |
| [email protected] View all |
| Thu Jul 20 21:07:00 UTC 2023 |