| Need AWS Data Engineer AND Remote position AND No H1's at Florham Park, New Jersey, USA |
| Email: [email protected] |
| Hi, This is Lucy from American Unit. I hope you are doing great, please see the job description below and if you are really interested and comfortable with this position . Please forward your updated resume to [email protected] JOB DESCRIPTION:- Title: AWS Data Engineer Location: Florham Park, NJ/Remote Rate: $60/hr. on C2C AI Exp:- 10+ Years No H1s Experience Experience in implementation of AWS Data Lake and Data Publication using Databricks, Airflow and AWS S3 Experience in Databricks Data Engineering to create Data Lake solutions using AWS services. Knowledge of Databricks cluster and SQL warehouse, Experience in Client and Parquet file handling Experience in Data Engineering and Data Pipeline creation on Databricks Experience in Data Build Tool (DBT) using Python and SQL Extensive Experience in SQL, PL/SQL, complex Join, Aggregation function and DBT, Python, Data frames and Spark Experience in Airflow for Job Orchestration, dependency Setup and Job scheduling Knowledge of Databricks Unity Catalog and Consumption patterns Knowledge of GitHub and CI/CD Pipelines, AWS Infra like IAM Role, Secrets and S3 buckets Role Responsible for defining technical architecture and application landscape. Responsible for authoring SQL and Python scripts on Databricks and DBT (Data Build tool) to create data pipelines to create Operational Data Mart. Responsible for creation of Data Pipelines for Data processing of Client files into ODM format for downstream data consumption Responsible for identifying data set relationship, join criteria and implement it in code for ODM model development. Responsible for creation of Client Lake for ODM model and setup of consumption pattern using Databricks Unity catalog Responsible for creation of Airflow DAGs for job orchestration and scheduling of data pipeline jobs Thanks & Regards .. Lucy (Priyanka Moyila) American Unit Inc. 2901 N Dallas Pkwy, Suite 333 Plano, TX 75093 Email: [email protected] -- Keywords: continuous integration continuous deployment artificial intelligence sthree information technology procedural language New Jersey Texas |
| [email protected] View all |
| Wed Feb 14 00:13:00 UTC 2024 |