"ref_raster_samples_region_1_seed_0.tif" No such file or directory
Good day everyone. I am currently doing the classification tutorial to test my installation of Iota2. I ran into a problem with the program at step 10, selecting pixels in learning polygons by models, where the "ref_raster_samples_region_1_seed_0" TIF file was not created and therefore gdal_merge.py failed to complete the task.
I used a standard configuration and launch:
chain :
{
output_path : '/home/doa/documents/iota2_outputs_test'
remove_output_path : True
nomenclature_path : '/home/doa/miniconda3/envs/iota2-doa/IOTA2_TEST_DOA/IOTA2_TEST_S2/nomenclature23.txt'
list_tile : 'T31TCJ'
s2_path : '/home/doa/miniconda3/envs/iota2-doa/IOTA2_TEST_DOA/IOTA2_TEST_S2/sensor_data'
ground_truth : '/home/doa/miniconda3/envs/iota2-doa/IOTA2_TEST_DOA/IOTA2_TEST_S2/vector_data/reference_data.shp'
data_field : 'code'
spatial_resolution : 10
color_table : '/home/doa/miniconda3/envs/iota2-doa/IOTA2_TEST_DOA/IOTA2_TEST_S2/colorFile.txt'
proj : 'EPSG:2154'
first_step: "init"
last_step: "validation"
}
arg_train :
{
classifier : 'sharkrf'
otb_classifier_options : {"classifier.sharkrf.ntrees" : 100 }
sample_selection: {"sampler": "random",
"strategy": "percent",
"strategy.percent.p": 0.1}
}
arg_classification :
{
classif_mode : 'separate'
}
Iota2.py -config ./miniconda3/envs/iota2-doa/IOTA2_TEST_DOA/IOTA2_TEST_S2/i2_tutorial_classification.cfg
This is how the terminal returns the result.
2024-04-15 13:29:56,204 - distributed.worker - ERROR - the task 's_sel_model_1_seed_0' has failed. Please check logs '/home/doa/documents/iota2_outputs_test/logs/SamplingLearningPolygons/s_sel_model_1_seed_0.err' and '/home/doa/documents/iota2_outputs_test/logs/SamplingLearningPolygons/s_sel_model_1_seed_0.out' for more details Running Sphinx v5.1.1 building [mo]: targets for 0 po files that are specified building [html]: 8 source files given on command line updating environment: [new config] 9 added, 0 changed, 0 removed reading sources... [100%] tasks_status_3 looking for now-outdated files... none found pickling environment... done checking consistency... done preparing documents... done writing output... [100%] tasks_status_3 generating indices... genindex done writing additional pages... search done copying static files... done copying extra files... done dumping search index in English (code: en)... done dumping object inventory... done build succeeded. The HTML pages are in documents/iota2_outputs_test/logs/html. logs zip file available at /home/doa/documents/iota2_outputs_test/logs.zip
With the error file stating as such:
2024-04-15 13:29:55,850 - distributed.worker - ERROR - Command gdal_merge.py -ot Byte -n 0 -createonly -o /home/doa/documents/iota2_outputs_test/samplesSelection/ref_raster_samples_region_1_seed_0.tif /home/doa/documents/iota2_outputs_test/features/T31TCJ/tmp/MaskCommunSL.tif exited with non-zero return code 1
Traceback (most recent call last):
File "/home/doa/miniconda3/envs/iota2-doa/bin/task_launcher.py", line 11, in <module>
sys.exit(main())
File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/iota2-0.0.0-py3.9.egg/iota2/task_launcher.py", line 73, in main
task_launcher(args.dill_file)
File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/iota2-0.0.0-py3.9.egg/iota2/task_launcher.py", line 61, in task_launcher
func(**f_kwargs)
File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/iota2-0.0.0-py3.9.egg/iota2/sampling/samples_selection.py", line 441, in samples_selection
do_sample_selection(model_name, merged_stats, model, wdir, parameters,
File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/iota2-0.0.0-py3.9.egg/iota2/sampling/samples_selection.py", line 503, in do_sample_selection
sel_parameters, tiles_model, outrates = get_sample_selection_param(
File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/iota2-0.0.0-py3.9.egg/iota2/sampling/samples_selection.py", line 276, in get_sample_selection_param
raster_ref, tiles_model = gen_raster_ref(vec, output_path, masks_name,
File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/iota2-0.0.0-py3.9.egg/iota2/sampling/samples_selection.py", line 215, in gen_raster_ref
run(raster_ref_cmd)
File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/iota2-0.0.0-py3.9.egg/iota2/common/utils.py", line 123, in run
raise Exception(exception_msg)
Exception: Launch command fail : gdal_merge.py -ot Byte -n 0 -createonly -o /home/doa/documents/iota2_outputs_test/samplesSelection/ref_raster_samples_region_1_seed_0.tif /home/doa/documents/iota2_outputs_test/features/T31TCJ/tmp/MaskCommunSL.tif
b'Traceback (most recent call last):\n File "/home/doa/.local/bin/gdal_merge.py", line 14, in <module>\n sys.exit(main(sys.argv))\n File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/osgeo_utils/gdal_merge.py", line 448, in main\n t_fh = gdal.Open(out_file, gdal.GA_Update)\n File "/home/doa/miniconda3/envs/iota2-doa/lib/python3.9/site-packages/osgeo/gdal.py", line 4576, in Open\n return _gdal.Open(*args)\nRuntimeError: /home/doa/documents/iota2_outputs_test/samplesSelection/ref_raster_samples_region_1_seed_0.tif: No such file or directory\n'
None
I checked the logs of previous tasks and they were successful so I am lost as to how it went wrong.
Any help is appreciated. Thank you very much for your time and assistance.