Search found 82 matches

by earthengine_urs
Wed May 14, 2025 9:57 pm America/New_York
Forum: Home
Question: Number of parallel reads from CMR API?
Replies: 0

Number of parallel reads from CMR API?

Question: how many parallel reads from the CMR API are you okay with? We are currently limiting our catalog scans to 10 parallel workers, and with the increasing number of datasets we read, it's starting to take longer and longer to just find the next batch of assets. Would 20 parallel workers be ok...
by earthengine_urs
Wed May 14, 2025 6:36 pm America/New_York
Forum: Home
Question: CMR errors
Replies: 5

Re: CMR errors

Thank you, Danielle, everything is working again.
by earthengine_urs
Tue May 13, 2025 6:08 pm America/New_York
Forum: Home
Question: CMR errors
Replies: 5

CMR errors

Hi - we are seeing "internal error" responsed to API queries like https://cmr.earthdata.nasa.gov/search/granules.json?downloadable=true&collection_concept_id[]=C2545314541-LPCLOUD&page_size=1000&revision_date[]=2023-08-19T05:44:51.667000,2025-05-13T18:05:42.398841&sort_key=...
by earthengine_urs
Mon Sep 30, 2024 8:50 am America/New_York
Forum: Home
Question: MOD11A2 Terra vs Aqua shift
Replies: 5

Re: MOD11A2 Terra vs Aqua shift

Hi There,

We're seeing 1-2 pixel shifts. As each pixel represents 1000 meters so that is the displacement.

You can refer to the script

https://code.earthengine.google.com/67dac3a2dbc456730fd15363ef870a1f
by earthengine_urs
Thu Sep 26, 2024 5:43 am America/New_York
Forum: Home
Question: MOD11A2 Terra vs Aqua shift
Replies: 5

Re: MOD11A2 Terra vs Aqua shift

Hi There,

We have tried with random files and we see the same issue in these two datasets.

MYD11A2.A2022249.h12v10.061.2022258145454.hdf
MOD11A2.A2022249.h12v10.061.2022258143859.hdf
by earthengine_urs
Thu Aug 29, 2024 3:42 pm America/New_York
Forum: Home
Question: MYD03.061 CMR entry changed, but the file didn't
Replies: 5

Re: MYD03.061 CMR entry changed, but the file didn't

The problem is that not every dataset uses the filename to indicate the data version (and if they do, there's no consistenvcy - eg, SMAP uses _01, _02, _03 etc instead of the timestamp). So it would have been better to rely on more structured entries in CMR, but I realize that achieving consistency ...
by earthengine_urs
Wed Aug 28, 2024 6:33 pm America/New_York
Forum: Home
Question: MYD03.061 CMR entry changed, but the file didn't
Replies: 5

Re: MYD03.061 CMR entry changed, but the file didn't

Thank you, noted. I would argue that because the actual data haven't changed, the "updated" field shouldn't change - the switch from one storage system to another is an implementation detail. Instead, the "revisionDate" field indicating the CMR metadata update time should change....
by earthengine_urs
Tue Aug 27, 2024 7:44 pm America/New_York
Forum: Home
Question: MYD03.061 CMR entry changed, but the file didn't
Replies: 5

MYD03.061 CMR entry changed, but the file didn't

Hi, We just noticed that some MYD03.061 entries like MYD03.A2010123.2320.061.2018059034522.hdf have new values of the "updated" field in CMR. Eg, https://cmr.earthdata.nasa.gov/search/granules.json?collection_concept_id=C1379841358-LAADS&temporal=2010-05-03T23:20:00 shows the "upd...
by earthengine_urs
Sat Aug 17, 2024 1:35 pm America/New_York
Forum: Home
Question: NLDAS Version 002 (GRIB-1 files) are no longer being updated after 23Z on August 1, 2024
Replies: 2

Re: NLDAS Version 002 (GRIB-1 files) are no longer being updated after 23Z on August 1, 2024

Hi, A couple of notes: 1. The grib files had temperature in C, while the netcdf files are in K. The rest of the values are the same. 2. Here's the map from grib bands to netcdf subdataset names (the order of netcdf subdatasets is not the same as the order of the grib bands): 'temperature': 'Tair', '...
by earthengine_urs
Tue May 14, 2024 3:47 pm America/New_York
Forum: Home
Question: LANCE FIRMS CMR ids?
Replies: 1

LANCE FIRMS CMR ids?

Hi, I'm trying to find the CMR ids for MODIS and VIIRS FIRMS datasets in CMR. 1. Looks like https://cmr.earthdata.nasa.gov/search/granules.json?collection_concept_id=C1942970257-LANCEMODIS has suomi-npp-viirs-c2. 2. https://cmr.earthdata.nasa.gov/search/granules.json?collection_concept_id=C135561536...