| Big Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Sona Chhabra, SMART IT FRAME [email protected] Reply to: [email protected] Hi, I tried reaching you for below role. Please find the detailed job description and let me know your interest. Job Title- Big Data Engineer Location - Jersey City, WI - Onsite Duration- 12+ Months Experience 8 - 10 Years Job Description: Design high quality deliverables adhering to business requirement with defined standards and design principles, patterns Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework Develop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/Java Provide solutions to Big data problems dealing with huge volumes of data using Spark based data transformation solutions , Hive, MPP processes like IMPALA. Create Junit tests and ensure code coverage is met as per the agreed standards Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors. Hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting Should be comfortable with Unix File system as well as HDFS commands Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB Should be flexible Should have good communication and customer management skills Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA. Should be aware of the components in Big Data ecosystem. Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer. Digital : BigData and Hadoop Ecosystems. Scala, PySpark, Unix Shell Scripting and text processing tools, Core Java Keywords: continuous integration continuous deployment database information technology Wisconsin Big Data Engineer [email protected] |
| [email protected] View all |
| Tue Apr 30 20:17:00 UTC 2024 |