| Data Architect - Wilmington, DE or Jersey City, New Jersey - Onsite - Local Only at Wilmington, Delaware, USA |
| Email: [email protected] |
| From: PAVITHRA, XFORIA [email protected] Reply to: [email protected] 12+ years of experience on client projects to deliver AWS, Py Spark, Databricks based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, tuning big data processes using Apache Spark Build data pipelines applications to stream Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing pipelines Scala (with a focus on the functional programming paradigm), Scalatest, JUnit, Mockito Embedded Cassandra Apache Spark 2.x Spark query tuning and performance optimization SQL database integration Microsoft, Oracle, Postgres, and/or MySQL Experience working with DFS, S3, Cassandra, and/or DynamoDB. Spark developer who knows how to fully exploit the potential of our Spark cluster and special emphasis to database development skills across Migration projects. Keywords: sthree Data Architect - Wilmington, DE or Jersey City, New Jersey - Onsite - Local Only [email protected] |
| [email protected] View all |
| Thu Jun 13 20:52:00 UTC 2024 |