| Data Engineer position at Plano, TX location at Plano, Texas, USA |
| Email: [email protected] |
| From: Hari prasad, Smartfolks [email protected] Reply to: [email protected] Hi, Trust you are doing great! My name is Hari Prasad we have a job opportunity for Data Engineer Consultant for one of our clients. Please find the Job description below, if you are available and interested, please send us your word copy of your resume with following detail to [email protected] . Job Details: Job Title: Data Engineer Location: Plano, TX 75024-HYBRID 3 DAYS a week Duration 6-12 Months Job Description: Must Have Skills Skilled in Business Intelligence/Data Warehouse, Data and Technical Architecture, Methodology, Architecture, Data Governance, Data Modeling, ETL Tools, Big Data, Data Lake. Strong expertise applying industry best practice methods and sound enterprise architecture, data architecture/ management, and integration techniques across domains. What you will be doing: 1. End to End responsibility for data modeling (OLTP, OLAP) 2. Data analysis experience with writing complex queries, unions, joins and aggregations. 3. Data analysis experience using major RDBMS solutions like snowflake, redshift etc 4. Experience with ELT, ETL processes using glue, glue brew transformations. 5. Use airflow to schedule and time data transfers. 6. Understanding of deep JSON structures and partitioning using Kafka, spark, Scala, s3 etc. 7. Work with Data Scientist team to build segmentations, ML use cases, forecasting etc 8. Experience working with sagemaker, jupyter notebooks for deep data analysis. 9. Work with the BI specialists to design develop and enhance connectors to get closer to business use cases. 10. Migration of existing custom pipelines to a normalized connector approach 11. Help educate CT teams on data integration, validation standards and drive clean ingestion egestion patterns for the platform. What you bring: 1. Work with APIs to extract and ingest data. 2. Work with virtual warehouses and configure them for optimal performance and efficiency. 3. Conduct ETL data integration, cleansing transformations using glue spark script. 4. Work on aggregations of data coming from applications and apis to store results in a historic table. 5. Experience with streaming data analytics and building of streaming pipelines and connectors. 6. Experience with connections to BI solutions like tableau which include configurations of roles, policies within aws 7. Leverage Lambda, glue and step functions to cleanse and transform data. 8. Work with DWH technologies like EC2, s3, redshift, athena, snowflake to churn large data sets and partition them in readable formats and in real time Keywords: machine learning business intelligence sthree Connecticut Texas |
| [email protected] View all |
| Tue Aug 22 02:36:00 UTC 2023 |