| Big Data Engineers at Atlanta, Georgia, USA |
| Email: [email protected] |
| From: karthik, RITWIK Infotech INC [email protected] Reply to: [email protected] Hello Associate, Hope you are doing well We have the below requirement open. Please send me your genuine candidate on my email ID [email protected] Position: Big Data Engineers Location: Atlanta, GA(Hybrid) Duration : Long Term Job description: 1 . Must have hands-on experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming a. Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka b. Deep knowledge of troubleshooting and tuning Spark applications 2. Must have hands-on experience with Python and/or Scala i.e. PySpark/Scala-Spark 3. Must have experience with Databricks 4. Must have hands-on experience building, testing, and optimizing Big Data data ingestion pipelines, architectures and data sets 5. Experience in successfully building and deploying a new data platform on Azure/ AWS 6. Experience in Azure / AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue 7. Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series 8. Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog 9. Experience with data ingestion of different file formats across like JSON, XML, CSV 10. Experience with NoSQL databases, including HBASE and/or Cassandra 11. Knowledge of Unix/Linux platform and shell scripting is a must 12. Experience with database solutions like Kudu/Impala, or Delta Lake Keywords: user interface message queue sthree Georgia Idaho |
| [email protected] View all |
| Mon Sep 18 22:49:00 UTC 2023 |