| Sr. AWS Data Engineer - Hybrid, Dallas-Fort Worth - USC-GC at Dallas, Texas, USA |
| Email: [email protected] |
| From: Jyoti, kpg99 [email protected] Reply to: [email protected] TITLE: Sr. AWS Data Engineer VISA: USC/GC LOCATION: Dallas-Fort Worth MUST be willing to go onsite for an interview, please do not apply if you are not LOCAL to Dallas-Fort Worth. Required Skills and Experience * Bachelor's Degree Computer Science, Information Management, or related field; Masters preferred. 7+ years relevant experience or 4+ years with Masters Databricks experience building data pipelines and workflows is a must Proven record of stand alone projects Proficient in programming language (SQL and python or scala -- pyspark, pysql) Streaming Experience Understanding of cloud infrastructure and technologies specifically AWS Nice to Have Skills and Experience Unity Catalog Kinesis Lamda Job Description * The successful candidate will be part of the Enterprise Data Warehouse team. The engineer will have professional experience in data integration, transformation, and developing data pipelines. This individual will need experience working to get API data from different sources/vendors, along with internal data, enriching and anonymizing the data - then prepping/transforming the data into a readable format (gold) for visualizations, and maintaining current data feeds using streaming practices. Strong experience with Databricks, as well as spark/python or Scala, as well as SQL. They need to have a good understanding of streaming and spark. Architecture concepts, Following medallion architecture (bronze/silver/gold) - they will be operating in AWS (S3) and potentially Azure (blob), once again - Heavy use of Databricks - sole contributor and self-starter/confident in their abilities, and strong communication skills. Candidates must be local to DFW. 3 Days onsite in Dallas HQ preferred 2 days remote. Keywords: sthree golang green card |
| [email protected] View all |
| Thu Jan 25 15:01:00 UTC 2024 |