| Data cloud Engineer at Remote, Remote, USA |
| Email: [email protected] |
| Hello all, Please share the profiles Job role : Data cloud Engineer Location: AZ(Hybrid) Exp: Need 11+ Years profiles Only GC and USC (No H1B,CPT,OPT) Key Responsibilities: Perform testing on data ingestion pipelines for variety of data sources: batch, near real-time and real-time/streaming Perform testing on Datawarehouse loads and Reports generated out of the Datawarehouse data. Design, Develop, Execute and Maintain Automated Testing Framework and Scripts with GCP Components (DAG/Airflow, Dataflow, Pyspark, PubSub, Python-language, gsutil commands) Create Test Strategies to handle various testing milestones. Conduct performance testing on API's. Execute Test Plans for Connectivity/SIT/UAT - Functional & Non-Functional Testing. Report & Assign software defects through defects management process and tools. Conduct follow-up meetings with developers and cross teams to close the of defects. Create Test Metrics, Test Execution, Tests, Test Reports and share with Business stake holders on testing progress. Join meetings like Agile Daily Standup, Story grooming, Sprint plannings and Program increment agile ceremonies and working sessions as needed. Report risks, blockers and update tasks on daily basis with comments and completion. Code commits to the Azure/Git Repos Required skills: Strong Skills with Python to Develop Framework, Scripts, Programs. Strong experience with Test Automation (Bigdata Validations) with help of GCP Components (DAG/Airflow, Cloud functions, Dataflow, Pyspark, PubSub, Python-language, gsutil commands) Strong experience with Bigquery/SQL/Datawarehouse, Handling Bigquery client in Programming. Should be experience enough to create the Apache-beam pipelines to integrate the components. Experience with Testing Processes (Connectivity/SIT/UAT - Functional & Non-Functional Testing) and handling Project management tool like JIRA for daily tasks and logging. Experience with Azure DevOps for CICD implementation. Experience in the tools which creates the Synthetic Test Data generation (or) should be capable of creating the pipelines/framework to generate the Synthetic Test Data in forms of Json, Xml, Avro, Parquet, Text/CSV files. Strong experience in Data Maintenance/Management. Good to have Rest API Testing and API Performance Testing. GCP Cloud experience is very much needed. Strong analytical and communication skills: verbal and written Knowledge of Java, Scala, Spark and Kafka Knowledge of GenAI and MLOps is good to have as we scale up towards future usecases. Adoptability to learn new skills/technologies required for daily deliverables Thanks & Regards Shiva VST Consulting, Inc. 200 Middlesex Essex Tpke, Suite 201, Iselin, NJ 08830 Direct: 732 623 9152 Ext:136, Fax: +1 732-404-0045 mail:- [email protected] Web: http://www.vstconsulting.com VST Consulting, Inc Certified Minority Business Enterprise Ranked #24in NJ Finest for 2008. -- Keywords: information technology green card Arizona New Jersey Data cloud Engineer [email protected] |
| [email protected] View all |
| Thu Aug 29 20:23:00 UTC 2024 |