AI Verify Playground Error #290
Unanswered
tempodemobob
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I encountered this error using the custom report (report only robustness toolbox results) and sample image files provided by aiverify.
Any idea how to resolve the error?
Logs below:
2024-05-30 21:52:23,403 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:run_task_processing_in_process(66)]: The task validation is successful: task:665882e197f3bef638a9f620-6658849797f3bef638b149ae
2024-05-30 21:52:23,403 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:run_task_processing_in_process(71)]: Working on task: message_id 1717077143344-0, message_args {"mode":"upload","id":"task:665882e197f3bef638a9f620-6658849797f3bef638b149ae","algorithmId":"algo:aiverify.stock.robustness_toolbox:robustness_toolbox","algorithmArgs":{"annotated_ground_truth_path":"/app/aiverify/uploads/data/pickle_pandas_fashion_mnist_annotated_labels_10.sav","file_name_label":"file_name"},"testDataset":"/app/aiverify/uploads/data/raw_fashion_image_10","modelFile":"/app/aiverify/uploads/model/multiclass_classification_image_mnist_fashion","groundTruthDataset":"/app/aiverify/uploads/data/pickle_pandas_fashion_mnist_annotated_labels_10.sav","modelType":"classification","groundTruth":"labels"}, task_type: TaskType.NEW
2024-05-30 21:52:23,408 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_status(146)]: The current task has changed status to TaskStatus.RUNNING
2024-05-30 21:52:23,414 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:process_new_task(110)]: Sending task update
2024-05-30 21:52:23,429 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:detect_pipeline(30)]: Attempting to detect pipeline model from the given path
2024-05-30 21:52:23,429 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(55)]: Attempting to read pipeline: /app/aiverify/uploads/model/multiclass_classification_image_mnist_fashion
2024-05-30 21:52:23,434 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(83)]: Pipeline validation successful
2024-05-30 21:52:23,444 [INFO][app_logger.py::add_to_log(116)] [task.py:_send_task_update(278)]: Task has received notification to send task update
2024-05-30 21:52:23,449 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(93)]: Found these non python files: {'fashion_mnist_lr_pipeline.sav': '/app/aiverify/uploads/model/multiclass_classification_image_mnist_fashion/fashion_mnist_lr_pipeline.sav'}
2024-05-30 21:52:23,449 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_update(614)]: The update sent successfully: task:665882e197f3bef638a9f620-6658849797f3bef638b149ae:{'type': 'TaskResponse', 'status': 'Running', 'elapsedTime': 0, 'startTime': '2024-05-30T21:52:23.402775', 'output': '""', 'logFile': '/app/aiverify/test-engine-app/logs/task:665882e197f3bef638a9f620-6658849797f3bef638b149ae.log', 'taskProgress': 0}
2024-05-30 21:52:23,454 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(111)]: Attempting to deserialize pipeline: /app/aiverify/uploads/model/multiclass_classification_image_mnist_fashion
2024-05-30 21:52:23,606 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(138)]: Attempting to identify pipeline format: {class 'sklearn.pipeline.Pipeline'}
2024-05-30 21:52:23,611 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(149)]: Supported pipeline format: {class 'sklearn.pipeline.Pipeline'}, PipelinePluginType.SKLEARN[sklearn.pipeline.Pipeline]
2024-05-30 21:52:23,616 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:_load_instances(269)]: Found the pipeline model. Loading pipeline instances
2024-05-30 21:52:23,621 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(56)]: Attempting to read data: /app/aiverify/uploads/data/raw_fashion_image_10
2024-05-30 21:52:23,626 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(81)]: Data validation successful
2024-05-30 21:52:23,632 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/5.png
2024-05-30 21:52:23,644 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/1.png
2024-05-30 21:52:23,654 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/9.png
2024-05-30 21:52:23,677 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/7.png
2024-05-30 21:52:23,689 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/3.png
2024-05-30 21:52:23,700 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/6.png
2024-05-30 21:52:23,710 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/2.png
2024-05-30 21:52:23,720 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/0.png
2024-05-30 21:52:23,730 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/8.png
2024-05-30 21:52:23,739 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/raw_fashion_image_10/4.png
2024-05-30 21:52:23,750 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(157)]: Consolidation results: {pandasdata.Plugin object at 0x7f05880a2090} {class 'imageserializer.Plugin'}
2024-05-30 21:52:23,755 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(181)]: Supported data format: DataPluginType.PANDAS[SerializerPluginType.IMAGE]
2024-05-30 21:52:23,759 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_data(75)]: Data Instance: {pandasdata.Plugin object at 0x7f05880a2090}, Data Deserializer: SerializerPluginType.IMAGE
2024-05-30 21:52:23,771 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(55)]: Attempting to read pipeline: /app/aiverify/uploads/model/multiclass_classification_image_mnist_fashion
2024-05-30 21:52:23,776 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(83)]: Pipeline validation successful
2024-05-30 21:52:23,789 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(93)]: Found these non python files: {'fashion_mnist_lr_pipeline.sav': '/app/aiverify/uploads/model/multiclass_classification_image_mnist_fashion/fashion_mnist_lr_pipeline.sav'}
2024-05-30 21:52:23,794 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(111)]: Attempting to deserialize pipeline: /app/aiverify/uploads/model/multiclass_classification_image_mnist_fashion
2024-05-30 21:52:23,804 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(138)]: Attempting to identify pipeline format: {class 'sklearn.pipeline.Pipeline'}
2024-05-30 21:52:23,809 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(149)]: Supported pipeline format: {class 'sklearn.pipeline.Pipeline'}, PipelinePluginType.SKLEARN[sklearn.pipeline.Pipeline]
2024-05-30 21:52:23,814 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_pipeline(132)]: Pipeline Instance: {sklearnpipeline.Plugin object at 0x7f058805c450}, Pipeline Deserializer: SerializerPluginType.PICKLE
2024-05-30 21:52:24,501 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(56)]: Attempting to read data: /app/aiverify/uploads/data/pickle_pandas_fashion_mnist_annotated_labels_10.sav
2024-05-30 21:52:24,506 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(81)]: Data validation successful
2024-05-30 21:52:24,510 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/pickle_pandas_fashion_mnist_annotated_labels_10.sav
2024-05-30 21:52:24,518 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(157)]: Consolidation results: {pandasdata.Plugin object at 0x7f058858f650} {class 'pickleserializer.Plugin'}
2024-05-30 21:52:24,523 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(181)]: Supported data format: DataPluginType.PANDAS[SerializerPluginType.PICKLE]
2024-05-30 21:52:24,533 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_ground_truth(259)]: GroundTruth Instance: {pandasdata.Plugin object at 0x7f058858f650}, GroundTruth Deserializer: SerializerPluginType.PICKLE
2024-05-30 21:52:24,540 [ERROR][log_utils.py::log_message(37)] [algorithm_manager.py:get_algorithm(126)]: There was an error getting algorithm instance (not found): algo:aiverify.stock.robustness_toolbox:robustness_toolbox
2024-05-30 21:52:24,545 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(112)]: Attempting to find algo:aiverify.stock.robustness_toolbox:robustness_toolbox in the algorithm registry
2024-05-30 21:52:24,552 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(141)]: algo:aiverify.stock.robustness_toolbox:robustness_toolbox is in the algorithm registry. Attempting to re-discover algorithm
2024-05-30 21:52:24,580 [INFO][robustness_toolbox.py::add_to_log(205)] Setup completed
2024-05-30 21:52:24,589 [INFO][log_utils.py::log_message(31)] [algorithm_manager.py:get_algorithm(116)]: Supported algorithm: algo:aiverify.stock.robustness_toolbox:robustness_toolbox, PluginType.ALGORITHM
2024-05-30 21:52:24,593 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_algorithm(356)]: Algorithm Instance: {robustness_toolbox.Plugin object at 0x7f0575d309d0}
2024-05-30 21:52:24,610 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_progress(114)]: The current task completion progress is 100
2024-05-30 21:52:24,623 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:process_new_task(147)]: The raw task results: {'results': [0]}
2024-05-30 21:52:24,626 [ERROR][app_logger.py::add_to_log(126)] [task_processing.py:process_new_task(167)]: Failed output schema validation: Task Results: {'results': [0]}
2024-05-30 21:52:24,629 [WARNING][app_logger.py::add_to_log(121)] [task_processing.py:process_new_task(189)]: The task terminated: The algorithm output schema validation failed
2024-05-30 21:52:24,638 [INFO][app_logger.py::add_to_log(116)] [task.py:_send_task_update(278)]: Task has received notification to send task update
2024-05-30 21:52:24,643 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_update(614)]: The update sent successfully: task:665882e197f3bef638a9f620-6658849797f3bef638b149ae:{'type': 'TaskResponse', 'status': 'Running', 'elapsedTime': 1, 'startTime': '2024-05-30T21:52:23.402775', 'output': '""', 'logFile': '/app/aiverify/test-engine-app/logs/task:665882e197f3bef638a9f620-6658849797f3bef638b149ae.log', 'taskProgress': 100}
2024-05-30 21:52:24,647 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_progress(114)]: The current task completion progress is 100
2024-05-30 21:52:24,648 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_status(146)]: The current task has changed status to TaskStatus.ERROR
2024-05-30 21:52:24,692 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_update(614)]: The update sent successfully: task:665882e197f3bef638a9f620-6658849797f3bef638b149ae:{'type': 'TaskResponse', 'status': 'Error', 'elapsedTime': 1, 'startTime': '2024-05-30T21:52:23.402775', 'output': '', 'errorMessages': '[{"category": "SYSTEM_ERROR", "code": "CSYSx00146", "description": "Task Terminated: The algorithm output schema validation failed", "severity": "warning", "component": "task_processing.py"}]', 'logFile': '/app/aiverify/test-engine-app/logs/task:665882e197f3bef638a9f620-6658849797f3bef638b149ae.log', 'taskProgress': 100}
2024-05-30 21:52:24,692 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_acknowledgement(659)]: The acknowledgement sent successfully - 1717077143344-0
2024-05-30 21:52:24,698 [INFO][app_logger.py::add_to_log(116)] [task.py:cleanup(104)]: The system has received notification to clean up task
Beta Was this translation helpful? Give feedback.
All reactions