Big Data Architect at Remote, Remote, USA |
Email: [email protected] |
From: sunil, ICS [email protected] Reply to: [email protected] Role: Big Data Architect Location: Atlanta, GA, 30377 Responsibilities Minimum of 18+ Years of experience in IT and 4-5yrs experience in Big Data development and a hand-ons experience on performance tuning E2E data pipeline. Demonstrate issues faced in implementation and performance tuning experience in previous project and best practices following in performance implementations Create Scala/Spark jobs for data transformation and aggregation with a focus on the functional programming paradigm. Help in designing, building, and enhancing platform and ensure that developed components are testable, repeatable, highly performant, scalable, and automated. Write Scala doc-style documentation with all code & design data processing pipelines Batch interfaces and Real-time interfaces like Kafka messaging Good presentation and communication skills to express what is being worked on day-2-day activities Proficient in Java and Scala and C++, fixing/redesigning native libraries, knowledge of Python is a plus Prior experience or understanding on in-memory data storage and No-SQL DB like Redis, MongoDB & Cassandra Familiarity with Unix scripting & Automation Past experience in BigData development is preferable (Streaming on Apache Flink or Apache Spark) or else should be able to demonstrate conceptual differences between batch and streaming data processing Past experience in DataWarehouse/ETL/SQL development is preferable who can understand the E2E data flow or the application architecture Azure Integration and deployment experience would be a plus Quick learner who can come out with alternate options to solve an application problem Expected Qualifications BS or MS degree in Computer Science, Software Engineering, or related field Good written and verbal communication skills Orientation in modern standards and technical trends Orientation in surrounding frameworks and libraries, particularly Play Experience with microservices architectures, scalability, reliability, and fault tolerance Experience with continuous and iterative development Atlassian tools Experienced working in an Agile development environment, Continuous Integration and Delivery practices Cassandra / other No SQL databases experience & Reactive Systems Strong analytical and problem solving skills and data-driven thinking Keywords: cplusplus database information technology microsoft Georgia |
[email protected] View all |
Wed Sep 13 22:44:00 UTC 2023 |