RGI Region: 10 Workdir for this run: /work/fmaussion/38223/wd Output dir for this run: /work/fmaussion/38223/out Collecting pip Downloading pip-21.0-py3-none-any.whl (1.5 MB) Collecting setuptools Downloading setuptools-52.0.0-py3-none-any.whl (784 kB) Installing collected packages: pip, setuptools Attempting uninstall: pip Found existing installation: pip 20.1.1 Uninstalling pip-20.1.1: Successfully uninstalled pip-20.1.1 Attempting uninstall: setuptools Found existing installation: setuptools 47.1.0 Uninstalling setuptools-47.1.0: Successfully uninstalled setuptools-47.1.0 Successfully installed pip-21.0 setuptools-52.0.0 Collecting git+https://github.com/OGGM/oggm.git@6367fc80c1065cba81b58a4f7902b2fc9854eaf5 Cloning https://github.com/OGGM/oggm.git (to revision 6367fc80c1065cba81b58a4f7902b2fc9854eaf5) to /tmp/pip-req-build-blkjqtcw Running command git clone -q https://github.com/OGGM/oggm.git /tmp/pip-req-build-blkjqtcw Running command git rev-parse -q --verify 'sha^6367fc80c1065cba81b58a4f7902b2fc9854eaf5' Running command git fetch -q https://github.com/OGGM/oggm.git 6367fc80c1065cba81b58a4f7902b2fc9854eaf5 Building wheels for collected packages: oggm Building wheel for oggm (setup.py): started Building wheel for oggm (setup.py): finished with status 'done' Created wheel for oggm: filename=oggm-1.3.2.dev146+g6367fc8-py3-none-any.whl size=330535 sha256=43b89d1da6cc8aca706166521d3f805c1678427a3c4af3ec21fc180a70c1b90c Stored in directory: /work/fmaussion/38223/wd/fake_home/.cache/pip/wheels/1f/fc/58/4bd5949cb8a029dd192a7cdf352c0c60c908f59cee594a8c71 Successfully built oggm Installing collected packages: oggm Attempting uninstall: oggm Found existing installation: oggm 1.3.2.dev118+gf71fe7d Not uninstalling oggm at /usr/local/pyenv/versions/3.7.9/lib/python3.7/site-packages, outside environment /work/fmaussion/38223/wd/oggm_env Can't uninstall 'oggm'. No files were found to uninstall. Successfully installed oggm-1.3.2.dev146+g6367fc8 2021-01-30 11:17:36: oggm.cfg: Reading default parameters from the OGGM `params.cfg` configuration file. 2021-01-30 11:17:36: oggm.cfg: Multiprocessing switched ON according to the parameter file. 2021-01-30 11:17:36: oggm.cfg: Multiprocessing: using slurm allocated processors (N=64) 2021-01-30 11:17:36: oggm.cfg: Size of LRU cache set to 1000 according to the ENV variable LRU_MAXSIZE N/A% of 19.4 MiB | | Elapsed Time: 0:00:00 ETA: --:--:-- Downloading salem-sample-data... 0% of 19.4 MiB | | Elapsed Time: 0:00:00 ETA: 0:00:34 1% of 19.4 MiB |# | Elapsed Time: 0:00:00 ETA: 0:00:29 2% of 19.4 MiB |### | Elapsed Time: 0:00:00 ETA: 0:00:29 3% of 19.4 MiB |##### | Elapsed Time: 0:00:00 ETA: 0:00:12 4% of 19.4 MiB |###### | Elapsed Time: 0:00:00 ETA: 0:00:12 5% of 19.4 MiB |####### | Elapsed Time: 0:00:00 ETA: 0:00:11 6% of 19.4 MiB |######### | Elapsed Time: 0:00:00 ETA: 0:00:11 8% of 19.4 MiB |############ | Elapsed Time: 0:00:00 ETA: 0:00:08 10% of 19.4 MiB |############### | Elapsed Time: 0:00:00 ETA: 0:00:08 13% of 19.4 MiB |################### | Elapsed Time: 0:00:00 ETA: 0:00:05 15% of 19.4 MiB |###################### | Elapsed Time: 0:00:00 ETA: 0:00:05 18% of 19.4 MiB |########################## | Elapsed Time: 0:00:01 ETA: 0:00:04 21% of 19.4 MiB |############################### | Elapsed Time: 0:00:01 ETA: 0:00:04 23% of 19.4 MiB |################################## | Elapsed Time: 0:00:01 ETA: 0:00:03 25% of 19.4 MiB |##################################### | Elapsed Time: 0:00:01 ETA: 0:00:03 26% of 19.4 MiB |##################################### | Elapsed Time: 0:00:01 ETA: 0:00:03 28% of 19.4 MiB |######################################## | Elapsed Time: 0:00:01 ETA: 0:00:03 30% of 19.4 MiB |########################################### | Elapsed Time: 0:00:01 ETA: 0:00:03 31% of 19.4 MiB |############################################# | Elapsed Time: 0:00:01 ETA: 0:00:03 33% of 19.4 MiB |################################################ | Elapsed Time: 0:00:01 ETA: 0:00:03 35% of 19.4 MiB |################################################## | Elapsed Time: 0:00:01 ETA: 0:00:03 37% of 19.4 MiB |##################################################### | Elapsed Time: 0:00:01 ETA: 0:00:03 39% of 19.4 MiB |######################################################## | Elapsed Time: 0:00:01 ETA: 0:00:02 41% of 19.4 MiB |############################################################ | Elapsed Time: 0:00:01 ETA: 0:00:02 43% of 19.4 MiB |############################################################### | Elapsed Time: 0:00:02 ETA: 0:00:02 45% of 19.4 MiB |################################################################# | Elapsed Time: 0:00:02 ETA: 0:00:02 47% of 19.4 MiB |#################################################################### | Elapsed Time: 0:00:02 ETA: 0:00:02 50% of 19.4 MiB |######################################################################## | Elapsed Time: 0:00:02 ETA: 0:00:02 52% of 19.4 MiB |########################################################################### | Elapsed Time: 0:00:02 ETA: 0:00:01 54% of 19.4 MiB |############################################################################## | Elapsed Time: 0:00:02 ETA: 0:00:01 56% of 19.4 MiB |################################################################################# | Elapsed Time: 0:00:02 ETA: 0:00:01 59% of 19.4 MiB |##################################################################################### | Elapsed Time: 0:00:02 ETA: 0:00:01 61% of 19.4 MiB |######################################################################################## | Elapsed Time: 0:00:02 ETA: 0:00:01 63% of 19.4 MiB |########################################################################################### | Elapsed Time: 0:00:02 ETA: 0:00:01 66% of 19.4 MiB |############################################################################################### | Elapsed Time: 0:00:02 ETA: 0:00:01 68% of 19.4 MiB |################################################################################################### | Elapsed Time: 0:00:02 ETA: 0:00:01 71% of 19.4 MiB |###################################################################################################### | Elapsed Time: 0:00:02 ETA: 0:00:01 74% of 19.4 MiB |########################################################################################################## | Elapsed Time: 0:00:03 ETA: 0:00:00 76% of 19.4 MiB |############################################################################################################## | Elapsed Time: 0:00:03 ETA: 0:00:00 79% of 19.4 MiB |################################################################################################################## | Elapsed Time: 0:00:03 ETA: 0:00:00 82% of 19.4 MiB |###################################################################################################################### | Elapsed Time: 0:00:03 ETA: 0:00:00 84% of 19.4 MiB |########################################################################################################################## | Elapsed Time: 0:00:03 ETA: 0:00:00 88% of 19.4 MiB |############################################################################################################################## | Elapsed Time: 0:00:03 ETA: 0:00:00 90% of 19.4 MiB |################################################################################################################################## | Elapsed Time: 0:00:03 ETA: 0:00:00 93% of 19.4 MiB |####################################################################################################################################### | Elapsed Time: 0:00:03 ETA: 0:00:00 97% of 19.4 MiB |########################################################################################################################################### | Elapsed Time: 0:00:03 ETA: 0:00:00 99% of 19.4 MiB |############################################################################################################################################### | Elapsed Time: 0:00:03 ETA: 0:00:00 100% of 19.4 MiB |################################################################################################################################################| Elapsed Time: 0:00:04 Time: 0:00:04 2021-01-30 11:17:42: oggm.cfg: PARAMS['border'] changed from `20` to `10`. 2021-01-30 11:17:42: oggm.cfg: PARAMS['continue_on_error'] changed from `False` to `True`. 2021-01-30 11:17:42: oggm.cli.prepro_levels: # OGGM Run parameters: has_internet: True dl_cache_readonly: True use_multiprocessing: True use_mp_spawn: False mp_processes: 64 lru_maxsize: 1000 continue_on_error: True grid_dx_method: square topo_interp: cubic use_intersects: True use_compression: True border: 10 mpi_recv_buf_size: 131072 use_multiple_flowlines: True filter_min_slope: True auto_skip_task: False correct_for_neg_flux: True filter_for_neg_flux: False run_mb_calibration: False rgi_version: 61 use_rgi_area: True compress_climate_netcdf: True use_tar_shapefiles: True clip_mu_star: False clip_tidewater_border: True dl_verify: True calving_line_extension: 30 use_kcalving_for_inversion: True use_kcalving_for_run: True calving_use_limiter: True use_inversion_params_for_run: True error_when_glacier_reaches_boundaries: True baseline_climate: CRU hydro_month_nh: 10 hydro_month_sh: 4 climate_qc_months: 3 temp_use_local_gradient: False tstar_search_glacierwide: True temp_local_gradient_bounds: [-0.009, -0.003] tstar_search_window: [0, 0] ref_mb_valid_window: [0, 0] use_bias_for_run: True free_board_marine_terminating: [10.0, 50.0] use_shape_factor_for_inversion: use_shape_factor_for_fluxbasedmodel: glacier_length_method: naive tidewater_type: 2 task_timeout: 0.0 d1: 14.0 d2: 10.0 dmax: 200.0 fixed_dx: 50.0 localmax_window: 500.0 smooth_window: 251.0 q1: 2e-06 q2: 500.0 rmax: 1000.0 f1: 1000.0 f2: 3000.0 a: 4.25 b: 3.7 kbuffer: 2.5 terminus_search_percentile: 10.0 terminus_search_altitude_range: 100.0 flowline_dx: 2.0 flowline_junction_pix: 3.0 flowline_height_smooth: 1.0 elevation_band_flowline_binsize: 30.0 width_alt_range_thres: 250.0 min_n_per_bin: 2.0 base_binsize: 50.0 smooth_widths_window_size: 1.0 mu_star_halfperiod: 15.0 temp_default_gradient: -0.0065 temp_all_solid: 0.0 temp_all_liq: 2.0 temp_melt: -1.0 prcp_scaling_factor: 2.5 min_mu_star: 5.0 max_mu_star: 10000.0 calving_min_mu_star_frac: 0.7 ice_density: 900.0 glen_n: 3.0 inversion_glen_a: 2.4e-24 glen_a: 2.4e-24 inversion_fs: 0.0 fs: 0.0 min_slope: 1.5 min_slope_ice_caps: 1.5 min_slope_flowline_filter: 0.0 distributed_inversion_min_slope: 6.0 mixed_min_shape: 0.001 default_parabolic_bedshape: 0.003 downstream_min_shape: 0.0001 trapezoid_lambdas: 1.0 cfl_number: 0.02 cfl_min_dt: 60.0 min_ice_thick_for_length: 0.0 inversion_calving_k: 0.6 calving_k: 0.6 calving_limiter_frac: 0.0 free_board_lake_terminating: 10.0 calving_front_slope: 0.05 2021-01-30 11:17:42: oggm.cli.prepro_levels: # OGGM environment: ## System info: python: 3.7.9.final.0 python-bits: 64 OS: Linux OS-release: 5.10.9 machine: x86_64 processor: x86_64 ## Packages info: oggm: 1.3.2.dev146+g6367fc8 numpy: 1.19.4 scipy: 1.5.4 pandas: 1.1.4 geopandas: 0.8.1 netCDF4: 1.5.4 matplotlib: 3.3.3 rasterio: 1.1.8 fiona: 1.8.17 pyproj: 3.0.0.post1 shapely: 1.7.1 xarray: 0.16.1 dask: 2.30.0 salem: 0.3.0-1-g697762b OGGM git identifier: fb9e48387f52796bebc287d432774a50c6b8adef 2021-01-30 11:17:50: oggm.cli.prepro_levels: Starting prepro run for RGI reg: 10 and border: 10 2021-01-30 11:17:50: oggm.cli.prepro_levels: Number of glaciers: 5151 2021-01-30 11:17:50: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:18:03: oggm.workflow: Execute entity task glacier_statistics on 5151 glaciers 2021-01-30 11:18:16: oggm.cli.prepro_levels: L0 done. Writing to tar... 2021-01-30 11:18:16: oggm.workflow: Execute entity task gdir_to_tar on 5151 glaciers 2021-01-30 11:18:17: oggm.cli.prepro_levels: Running prepro on ALL sources 2021-01-30 11:18:17: oggm.cli.prepro_levels: Running prepro on sources: GIMP 2021-01-30 11:18:17: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:18:29: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:19:03: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:19:03: oggm.cli.prepro_levels: Running prepro on sources: ARCTICDEM 2021-01-30 11:19:04: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:19:16: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:20:20: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:20:20: oggm.cli.prepro_levels: Running prepro on sources: RAMP 2021-01-30 11:20:20: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:20:33: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:21:16: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:21:17: oggm.cli.prepro_levels: Running prepro on sources: TANDEM 2021-01-30 11:21:17: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:21:30: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:22:20: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:22:21: oggm.cli.prepro_levels: Running prepro on sources: AW3D30 2021-01-30 11:22:21: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:22:34: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:26:52: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:26:52: oggm.cli.prepro_levels: Running prepro on sources: MAPZEN 2021-01-30 11:26:53: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:27:06: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers N/A% of 290.2 KiB | | Elapsed Time: 0:00:00 ETA: --:--:-- 44% of 290.2 KiB |############################################################### | Elapsed Time: 0:00:00 ETA: 0:00:00 88% of 290.2 KiB |############################################################################################################################### | Elapsed Time: 0:00:00 ETA: 0:00:00 100% of 290.2 KiB |################################################################################################################################################| Elapsed Time: 0:00:00 Time: 0:00:00 N/A% of 261.5 KiB | | Elapsed Time: 0:00:00 ETA: --:--:-- 48% of 261.5 KiB |###################################################################### | Elapsed Time: 0:00:00 ETA: 0:00:00 97% of 261.5 KiB |############################################################################################################################################ | Elapsed Time: 0:00:00 ETA: 0:00:00 100% of 261.5 KiB |################################################################################################################################################| Elapsed Time: 0:00:00 Time: 0:00:00 2021-01-30 11:30:14: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:30:14: oggm.cli.prepro_levels: Running prepro on sources: DEM3 2021-01-30 11:30:14: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:30:27: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:31:44: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:31:44: oggm.cli.prepro_levels: Running prepro on sources: ASTER 2021-01-30 11:31:44: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:31:57: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:33:25: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:33:25: oggm.cli.prepro_levels: Running prepro on sources: SRTM 2021-01-30 11:33:26: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:33:38: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:34:36: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:34:36: oggm.cli.prepro_levels: Running prepro on sources: REMA 2021-01-30 11:34:37: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:34:50: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:35:44: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:35:45: oggm.cli.prepro_levels: Running prepro on sources: ALASKA 2021-01-30 11:35:45: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:35:58: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:37:20: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:37:20: oggm.cli.prepro_levels: Running prepro on sources: COPDEM 2021-01-30 11:37:20: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:37:34: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 11:39:11: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 11:39:11: oggm.cli.prepro_levels: Running prepro on sources: NASADEM 2021-01-30 11:39:12: oggm.workflow: Execute entity task GlacierDirectory on 5151 glaciers 2021-01-30 11:39:25: oggm.workflow: Execute entity task define_glacier_region on 5151 glaciers 2021-01-30 12:33:56: oggm.workflow: Execute entity task _rename_dem_folder on 5151 glaciers 2021-01-30 12:33:56: oggm.workflow: Execute entity task rasterio_glacier_mask on 5151 glaciers 2021-01-30 12:34:10: oggm.workflow: Execute entity task gdir_to_tar on 5151 glaciers 2021-01-30 12:34:12: oggm.cli.prepro_levels: OGGM prepro_levels is done! Time needed: 01:16:35 Copying files... sending incremental file list ./ b_010/ b_010/package_versions.txt b_010/L0/ b_010/L0/RGI60-10/ b_010/L0/RGI60-10/RGI60-10.00.tar b_010/L0/RGI60-10/RGI60-10.01.tar b_010/L0/RGI60-10/RGI60-10.02.tar b_010/L0/RGI60-10/RGI60-10.03.tar b_010/L0/RGI60-10/RGI60-10.04.tar b_010/L0/RGI60-10/RGI60-10.05.tar b_010/L0/summary/ b_010/L0/summary/glacier_statistics_10.csv b_010/L1/ b_010/L1/RGI60-10/ b_010/L1/RGI60-10/RGI60-10.00.tar b_010/L1/RGI60-10/RGI60-10.01.tar b_010/L1/RGI60-10/RGI60-10.02.tar b_010/L1/RGI60-10/RGI60-10.03.tar b_010/L1/RGI60-10/RGI60-10.04.tar b_010/L1/RGI60-10/RGI60-10.05.tar sent 382.66M bytes received 325 bytes 153.06M bytes/sec total size is 382.56M speedup is 1.00 SLURM DONE