Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
d436882
Merge pull request #370 from TUDelftGeodesy/main
Simon-van-Diepen Aug 25, 2026
1c858c5
Rename snap_run to snap, snap_permissions to snap_fix_permissions
Simon-van-Diepen Aug 27, 2026
4e9cd6b
Rename all cropping submodule jobs, merge cropping submodule and core…
Simon-van-Diepen Aug 27, 2026
9c4251d
Rename deinsar to doris_v4, doris to doris_v5, doris_cleanup to doris…
Simon-van-Diepen Aug 27, 2026
35d829a
Rename jobs of PSI-batch submodules
Simon-van-Diepen Aug 27, 2026
2d74ef7
Change names in docs
Simon-van-Diepen Aug 27, 2026
f38c902
Re-alphabetize preparation.py
Simon-van-Diepen Aug 27, 2026
56eed2c
Update docs and images to v4.0.0
Simon-van-Diepen Aug 28, 2026
3cbdf41
Add loop exit to identify_s1_orbits_in_aoi, remove reference to doris
Simon-van-Diepen Aug 28, 2026
4564c1b
Fix names of parameters in NEW_CONFIG_KEYS_ALLOWED
Simon-van-Diepen Aug 28, 2026
ad4a86d
Bump asf_search version to v13.0.0
Simon-van-Diepen Aug 28, 2026
ccbf40a
Fix bugged name links
Simon-van-Diepen Sep 21, 2026
0364e42
Add missing dash
Simon-van-Diepen Sep 21, 2026
1b10ef1
Fix leftover previous name in cleanup
Simon-van-Diepen Sep 21, 2026
c488c97
Fix portal upload flag check in email generation
Simon-van-Diepen Sep 22, 2026
9069068
Add note in job definitions, update example user file to reflect new …
Simon-van-Diepen Sep 22, 2026
d449bc0
Update date timestamp
Simon-van-Diepen Sep 22, 2026
a382d93
Merge branch 'main' into 291-jobs-names
Simon-van-Diepen Sep 22, 2026
d4bf2b5
Add parameter file changes
Simon-van-Diepen Sep 22, 2026
c00a907
Merge branch '291-jobs-names' of github.com:TUDelftGeodesy/caroline i…
Simon-van-Diepen Sep 22, 2026
8669c45
Add fix on depsi_post and portal_upload separation to changelog
Simon-van-Diepen Sep 22, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 31 additions & 2 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,11 +25,40 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
-

-->
## [v3.2.3](https://github.com/TUDelftGeodesy/caroline/tree/main) (28-Aug-2026, [diff](https://github.com/TUDelftGeodesy/caroline/compare/e46493f87582bfbdb2a8ae17dd46da4879538b27...main))
## [v4.0.0](https://github.com/TUDelftGeodesy/caroline/tree/main) (22-Sep-2026, [diff](https://github.com/TUDelftGeodesy/caroline/compare/888f022ba797e4cb63b5904854efacbdc4cc9f6c...main))

### Changed
- `snap_run` now runs on 12 cores instead of 8
- `crop_to_raw` has been renamed to `reduce_SLC_matlab` (abbr. `RM`)
- `crop_to_zarr` has been renamed to `reduce_SLC_python` (abbr. `RP`)
- `znap_to_raw` has been renamed to `merge_to_stack_matlab` (abbr. `MM`)
- `znap_to_zarr` has been renamed to `merge_to_stack_python` (abbr. `MP`)
- `doris` has been renamed to `doris_v5`
- `deinsar` has been renamed to `doris_v4`
- `doris_cleanup` has been renamed to `doris_v5_cleanup`
- `snap_run` has been renamed to `snap` (abbr. `SN`)
- `snap_permissions` has been renamed to `snap_fix_permissions` (abbr. `SF`)
- `depsi` has been renamed to `depsi_matlab` (abbr. `DM`)
- `stm_generation` has been renamed to `generate_partitioned_stm` (abbr. `GS`)
- `mrm` has been renamed to `create_mrm` (abbr. `CM`)
- `tarball` has been renamed to `create_tarball` (abbr. `CT`)
- `portal_upload` has been renamed to `set_portal_upload_flag`
- The Coregistration submodule and Cropping submodule have been merged into the Stack Generation submodule
- `asf_search` dependency version bumped to `v13.0.0` to avoid an error being thrown during `utils.identify_s1_orbits_in_aoi`
- All instances of job names in variable names have been replaced by their new names
- The parameter group `stm_generation:stm_generation-settings:ps-selection:initialization-settings` has been renamed to `generate_partitioned_stm:generate_partitioned_stm-settings:ps-selection:init-settings`
- The parameter `stm_generation:stm_generation-settings:ps-selection:initialization-settings:initialization-length` has been renamed to `generate_partitioned_stm:generate_partitioned_stm-settings:ps-selection:init-settings:init-length`
- The parameter `stm_generation:stm_generation-settings:partitioning:undifferenced-output-layers` has been renamed to `generate_partitioned_stm:generate_partitioned_stm-settings:partitioning:undifferenced-output-lyrs`
- The parameter `stm_generation:stm_generation-settings:partitioning:single-difference-output-layers` has been renamed to `generate_partitioned_stm:generate_partitioned_stm-settings:partitioning:single-difference-output-lyrs`
- The parameter `stm_generation:stm_generation-settings:incremental-statistics:recalibration-jump-size` has been renamed to `generate_partitioned_stm:generate_partitioned_stm-settings:incremental-statistics:recal-jump-size`

### Fixed
- Separate `create_mrm` and `depsi_post` on one side, and `set_portal_upload_flag` on the other side into different step machine fields, so that it is possible to run `depsi_post` without pushing to the portal


## [v3.2.3](https://github.com/TUDelftGeodesy/caroline/tree/888f022ba797e4cb63b5904854efacbdc4cc9f6c) (28-Aug-2026, [diff](https://github.com/TUDelftGeodesy/caroline/compare/e46493f87582bfbdb2a8ae17dd46da4879538b27...888f022ba797e4cb63b5904854efacbdc4cc9f6c))

### Changed
- `snap_run` now runs on 12 cores instead of 8

## [v3.2.2](https://github.com/TUDelftGeodesy/caroline/tree/e46493f87582bfbdb2a8ae17dd46da4879538b27) (07-Aug-2026, [diff](https://github.com/TUDelftGeodesy/caroline/compare/d7a236c3a1a1464d77e26d7f1a37f4ef833818ad...e46493f87582bfbdb2a8ae17dd46da4879538b27))

Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ Welcome to the CAROLINE Project source code repository.

CAROLINE (Contextual and Autonomous processing of satellite Radar Observations for Learning and Interpreting the Natural and built Environment) is an InSAR data processing system that automates the InSAR processing chain from download to final output. It allows for continuous product generation, where predefined products are created as new datasets are downloaded, as wel as ad-hoc product creation.

The current documentation still partly pertains to v0.1.0. In v3.X, the continuous and ad hoc product generation is functional, but the database integration with docker-compose.yml is still missing.
The current documentation still partly pertains to v0.1.0. In v4.X, the continuous and ad hoc product generation is functional, but the database integration with docker-compose.yml is still missing.

**Table of Contents**

Expand Down
2 changes: 1 addition & 1 deletion caroline/jobarray_preparation.py
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ def jobarray_preparation_scheduler_hook(parameter_file: str, njobs_function: str
return eval(f"{njobs_function}('{parameter_file}')")


def njobs_snap_run(parameter_file: str) -> int:
def njobs_snap(parameter_file: str) -> int:
"""Figure out how many jobs are necessary in the array to successfully run the job run_snap.

Parameters
Expand Down
2 changes: 1 addition & 1 deletion caroline/parameter_file.py
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
CONFIG_PARAMETERS = get_config()
# Only in the following list of keys, new keys in the configuration are allowed (as here tracks can be added)
# The ':' character is used as a split between keys to allow for going deeper into the dictionaries
NEW_CONFIG_KEYS_ALLOWED = ["deinsar:input:data-directories", "depsi:depsi-settings:general:ref-cn"]
NEW_CONFIG_KEYS_ALLOWED = ["doris_v4:input:data-directories", "depsi_matlab:depsi_matlab-settings:general:ref-cn"]


def generate_full_parameter_file(
Expand Down
Loading
Loading