| Cloud Software & Data Engineer at Houston,TX || Hybrid at Houston, Texas, USA |
| Email: [email protected] |
| Hi Good Morning, Hope you are doing well. We have a position for the below Requirements Role: Cloud Software & Data Engineer Location: Houston,TX || Hybrid Experience: 15 Years & Above Duration: 6-12 Months Responsibilities Work with subject matter experts to clarify requirements and use cases Turn requirements and user stories into functionality via implementation efforts which includes:- Design, build & maintain efficient, reusable, reliable code, High Quality software, Documentation, Traceability Develop server-side services to be elastically scalable and secure by design to support high volume & high velocity data processing. Services should be backward and forward compatible to ease deployment. Ensure the solution is deployable, operable and secure by default. Write and maintain provisioning, deployment, CI/CD and maintenance scripts for services they developed Write Unit Tests, Automation testing, Data Simulations Support, maintain, troubleshoot and fine-tune working cloud environments, and the software run within Builds prototypes, products and systems that meets the project quality standards and requirements Be an individual contributor which includes technical leadership and documentation to developers and stakeholders Provide timely corrective actions on all assigned defects and issues. Contributes to development plans by providing task estimates. Fulfil organizational responsibilities (sharing knowledge & experience with other teams/ groups) Conduct technical training(s)/session(s), write whitepapers/case studies/blogs etc. Background Bachelor's degree or higher in Computer Science or related with minimum years working experience. Skills and knowledge 1. Mandatory 5+ years of software development experience in Big Data technologies (Spark/, Database & Data Lakes) SQL, No-SQL, JSON, CSV, Parquet data types of experience Advanced knowledge of large-scale parallel computing engines (Spark) provisioning, deployment, development of computing pipelines, operation and support, performance tuning (3y+) Good experience in building/tuning Spark pipelines in Python Design, build and maintain data processing pipelines in Apache NiFi, Spark Jobs, AirFlow Extensive knowledge of data structures, patterns and algorithms (5y +) Expertise with several back-end development languages and their associated frameworks python (3y+) In-depth knowledge of application, cloud networking and security as well as related development best-practices and patterns (3y+) Cloud platform knowledge Azure public cloud expertise (3y+) Advanced knowledge of DevOps, CI/CD and cloud deployment practices (5y+) Advanced knowledge of containerization and virtualization (Kubernetes), as well as scale clusters & debug issues on high volume/velocity data jobs and best practices (3y+) Advanced skills in setting up and operating databases (relational and non-relational) (3y+) Good experience in Databricks, Spark on Kubernetes Good Programming experience with Python Experienced in application profiling, bottleneck analysis and performance tuning Good communication and cross functional skills. Problem solving skills, Team player, adaptable & hustler Have worked in highly Agile projects in past 2. Nice to have Build, test and maintain tools, infrastructure to support Data science initiatives Exposure in PowerBI, SpotFire, Dataiku Knowledge and experience with version control tools (Git preferred but not mandatory) In Country cloud providers Azure Stack (3y+) Experience deploying machine learning models into production environment. Experience with ML training/retraining, Model Registry, ML model performance measurement Oil and gas industry experience Architectural expertise" Best Regards, Manindra Ch US IT Recruiter T : +1 832-937-7008 E : [email protected] W : www.schrilltech.com -- Keywords: continuous integration continuous deployment machine learning information technology Texas Cloud Software & Data Engineer at Houston,TX || Hybrid [email protected] |
| [email protected] View all |
| Fri Aug 30 00:20:00 UTC 2024 |