| Remote Big Data Engineer (Databricks) Looking for Locals Atlanta, GA Only USC and GC at Atlanta, Georgia, USA |
| Email: [email protected] |
| Position: Big Data Engineer (Databricks) Location: Atlanta, GA This position is 95% remote candidates still must come onsite for mandatory meetings and events Visa: Only USC and GC Length: 24+ months Interview: MS Teams Video Interview Notes: MUST have Data Bricks, Apache Kafka, and Spark streaming experience ON RESUME Skills and Experience: Required: 6+ years of overall IT experience 3+ years of experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka Deep knowledge of troubleshooting and tuning Spark applications 3+ years of experience with data ingestion from Message Queues (Tibco, IBM, etc.) and different file formats across different platforms like JSON, XML, CSV 3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS, or 3+ years of experience building, testing, and optimizing Big Data data ingestion pipelines, architectures, and data sets 2+ years of experience with Python (and/or Scala) and PySpark/Scala-Spark 3+ years of experience with Cloud platforms e.g. AWS, GCP, etc. 3+ years of experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake or BigQuery 2+ years of experience with NoSQL databases, including HBASE and/or Cassandra Experience in successfully building and deploying a new data platform on Azure/ AWS Experience in Azure / AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue Strong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series Experience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity Catalog Knowledge of Unix/Linux platform and shell scripting is a must Strong analytical and problem-solving skills Preferred (Not Required): Strong SQL skills with ability to write intermediate complexity queries Strong understanding of Relational & Dimensional modeling Experience with GIT code versioning software Experience with REST API and Web Services Good business analyst and requirements gathering/writing skills Education Bachelors Degree required. Preferably in Information Systems, Computer Science, Computer Information Systems or related field Kind Regards, Kartik Bhardwaj | Absolute IT | Recruitment Manager 116 Village Blvd Suite 200 Princeton New Jersey 08540 Direct: 609-639 9618 Office: 201-228-3009 EXT 127 [email protected] www.absoluting.com In case there is any urgency or my absence, please feel free to reach Bharat Goyal ( [email protected] ). The information contained in, or attached to this e-mail, contains confidential information, is intended solely for the use of the individual or entity to which they are addressed, and is subject to legal privilege. If you have received this e-mail in error you should notify the sender immediately, delete the message and notify your system manager. The views or opinions presented in this e-mail are solely those of the sender and do not necessarily represent those of the company. The company accepts no liability, legal or otherwise, for any damage caused, directly or indirectly. Please consider the environment before printing this e-mail -- Keywords: user interface message queue sthree information technology green card microsoft Georgia Remote Big Data Engineer (Databricks) Looking for Locals Atlanta, GA Only USC and GC [email protected] |
| [email protected] View all |
| Wed Jul 24 20:19:00 UTC 2024 |