| Direct client::Bigdata engineer needed local to TX only:: Hybrid role. at Dallas, Texas, USA |
| Email: [email protected] |
| Hi Partner, We have immediate job opening below is the JD let me know if you are intrested. Data engineer OR Bigdata Engineer who has strong experience in Databricks platform using AWS cloud who is strong in coding using python or Pyspark in Spark, to build data pipelines with experience working on Streaming data using Kafka or any other tools. Role: Data Engineer Client: Direct Client Location : Dallas, Texas Requirement: 5+ years of experience designing, building, deploying, testing, maintaining, monitoring and owning scalable, resilient and distributed data pipelines. High Proficiency in at least two of Scala, Python, Spark or Flink applied to large scale data sets. Strong understanding of workflow management platforms (Airflow or similar). Familiarity with advanced SQL. Expertise with big data technologies (Spark, Flink, Data Lake, Presto, Hive, Apache Beam, NoSQL, ...). Knowledge of batch and streaming data processing techniques. Obsession for service observability, instrumentation, monitoring and alerting. Understanding of the Data Lifecycle Management process to collect, access, use, store, transfer, delete data. Strong knowledge of AWS or similar cloud platforms. Expertise with CI/CD tools (CircleCI, Jenkins or similar) to automate building, testing and deployment of data pipelines and to manage the infrastructure (Pulumi, Terraform or CloudFormation). Understanding of relational databases (e.g., MySQL, PostgreSQL), NoSQL databases (e.g., key-value stores like Redis, DynamoDB, RocksDB), and Search Engines (e.g., Elasticsearch). Ability to decide, based on the use case, when to use one over the other. Familiarity with recommendation and search to personalize the experience for millions of users across million items. Masters in Computer Science or related discipline. Please share your details along with the visa and DL Copy! Full Name: Best Mobile Number: Best Email id: LinkedIn id: Current Location: Visa Status: H1B i140 approved: Reason for change: Availability Start Date: Salary range: Interview available: E: [email protected] | www.anblicks.com -- Keywords: continuous integration continuous deployment information technology Idaho Direct client::Bigdata engineer needed local to TX only:: Hybrid role. [email protected] |
| [email protected] View all |
| Fri Oct 04 20:21:00 UTC 2024 |