Problem temporal search for SWOT_L2_HR_PIXC_2.0

[nushrat_yeasmin]

Hi,
I am using python package "podaac-data-subscriber" (version 1.15.2) to search and download 'SWOT_L2_HR_PIXC_2.0' data products. I want to search for PIXC products for a specific pass id but for a range of time (with --start-date and --end-date argument). However, the search results showing all available cycles for that specific pass. For example I am using the following command:

!podaac-data-downloader -c SWOT_L2_HR_PIXC_2.0 -d ./SWOT_L2_HR_PIXC -gr SWOT_L2_HR_PIXC_???_348_073L_* --start-date 2024-04-01T00:00:00Z --end-date 2024-07-01T00:00:00Z --dry-run

The above command should give me the search results for few cycles within the selected date range. But it is returning the following search result (with all the available cycles for this pass)

[2024-09-30 14:20:30,333] {podaac_data_downloader.py:317} INFO - Found 23 total files to download
[2024-09-30 14:20:30,333] {podaac_data_downloader.py:325} INFO - Dry-run option specified. Listing Downloads.
[2024-09-30 14:20:30,333] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_021_348_073L_20240922T221933_20240922T221944_PIC0_01.nc
[2024-09-30 14:20:30,333] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_020_348_073L_20240902T013427_20240902T013438_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_019_348_073L_20240812T044922_20240812T044933_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_018_348_073L_20240722T080417_20240722T080428_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_017_348_073L_20240701T111912_20240701T111923_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_016_348_073L_20240610T143408_20240610T143420_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_015_348_073L_20240520T174903_20240520T174914_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_014_348_073L_20240429T210358_20240429T210409_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_013_348_073L_20240409T001853_20240409T001904_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_012_348_073L_20240319T033348_20240319T033400_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_011_348_073L_20240227T064846_20240227T064857_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_010_348_073L_20240206T100341_20240206T100352_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_009_348_073L_20240116T131835_20240116T131846_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_009_348_073L_20240116T131835_20240116T131846_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_009_348_073L_20240116T131835_20240116T131846_PGC0_02.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_007_348_073L_20231205T194825_20231205T194836_PIC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_007_348_073L_20231205T194825_20231205T194836_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_006_348_073L_20231114T230319_20231114T230331_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_005_348_073L_20231025T021814_20231025T021825_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_004_348_073L_20231004T053309_20231004T053320_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_003_348_073L_20230913T084808_20230913T084819_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_002_348_073L_20230823T120301_20230823T120312_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:327} INFO - https://archive.swot.podaac.earthdata.nasa.gov/podaac-swot-ops-cumulus-protected/SWOT_L2_HR_PIXC_2.0/SWOT_L2_HR_PIXC_001_348_073L_20230802T151756_20230802T151807_PGC0_01.nc
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:328} INFO - Dry-run option specific. Exiting.
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:177} INFO - Success Count: 0
[2024-09-30 14:20:30,334] {podaac_data_downloader.py:186} INFO - END

Am I doing something wrong while executing the command?

Thanks in advance

[PODAAC - celiaoued]

Hello,

You are not doing anything wrong with this command. Unfortunately, we currently have an issue with the two options -gr and time range in our python package. The issue is that these two options do not work together, and instead results in the time range being ignored.

My next best recommendation is, as long as your desired time range is not too large, to run multiple commands. Since time range in your example spans 3 months over cycles 13 to 16, then I would either run this command for cycles 10 to 19:

Code: Select all

podaac-data-downloader -c SWOT_L2_HR_PIXC_2.0 -d ./SWOT_L2_HR_PIXC -gr SWOT_L2_HR_PIXC_01?_348_073L_* --dry-run

or one command per cycle such as

Code: Select all

podaac-data-downloader -c SWOT_L2_HR_PIXC_2.0 -d ./SWOT_L2_HR_PIXC -gr SWOT_L2_HR_PIXC_013_348_073L_* --dry-run

When you are interested in a different time range (but similar size), then I would run your original command with the dry-run option, just to get the listing of granules. Then manually identify the cycle range, and determine if the pattern requires one command per cycle, or if it can be covered well enough by a pattern like the first command ('SWOT_L2_HR_PIXC_01?'). Apologies for it being a more manual process than if the time range option were able to work in conjunction with granule name.

[nushrat_yeasmin]

Thanks for the suggestions.