Changes to Ocean color data web portal

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
jstum
Posts: 78
Joined: Mon Jul 04, 2005 4:54 am America/New_York
Answers: 0

Changes to Ocean color data web portal

by jstum » Thu May 19, 2022 5:42 am America/New_York

Hello,

Following the information on a change in the direct data access URLs, we would like to know when this change will be effective. For the time being, the two following URLs are still valid to download VIIRS/SNPP L1 data :

URL://oceandata.sci.gsfc.nasa.gov/directaccess/VIIRS-SNPP/L1/2022/139/ (old one)
https://oceandata.sci.gsfc.nasa.gov/directdataaccess/Level-1A/SNPP-VIIRS/2022/139/ (new one)

Thanks !

Jacques

Tags:

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1393
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1

Re: Changes to Ocean color data web portal

by OB.DAAC - SeanBailey » Thu May 19, 2022 1:10 pm America/New_York

Jacques,

Correct, both URLs are still active, although the older one is deprecated. We will likely discontinue support for the older path on June 1st (but haven't set that in stone yet). Just know it WILL go away and relatively soon.

Regards,
Sean

jstum
Posts: 78
Joined: Mon Jul 04, 2005 4:54 am America/New_York
Answers: 0

Re: Changes to Ocean color data web portal

by jstum » Wed May 25, 2022 6:21 am America/New_York

Hello,

I started to modify my scripts to be ready on June 1st ;)
I noticed one problem :
wget https://oceandata.sci.gsfc.nasa.gov (/directdataaccess/Ancillary/GLOBAL/2022/) returns an html file with the list of directories for the days of year 2022, but the names of these directories are href='/directdataaccess/./Ancillary/GLOBAL/2022/047/' instead of href='/directdataaccess/Ancillary/GLOBAL/2022/047/'

with the older URLs, wget https://oceandata.sci.gsfc.nasa.gov (/directaccess/Ancillary/Meteorological/2022/) returns correct subdirectory names (i.e., without the ./).

Are you going to modify it, or do I have to manage it ?

Regards,
Jacques

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1393
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1

Re: Changes to Ocean color data web portal

by OB.DAAC - SeanBailey » Wed May 25, 2022 8:50 am America/New_York

Jacques,

It doesn't' need modifying (or dealing with on your end). The paths are resolvable (otherwise the html links wouldn't work). Sure that extra "./" seems odd (and is superfluous), but the link works the same as if it wasn't there.

The directdataaccess URL is primarily intended for human traversal. While you can write a scrapper script to traverses the pages non-interactively, it would probably be more efficient to use the file_search API for that. We are working to improve the file_search endpoint, so if you've chosen to scrap the HTML pages because of a lack of functionality with the file_search approach, let us know what you use case is and we can see what can be done to meet your needs better.

Regards,
Sean

jstum
Posts: 78
Joined: Mon Jul 04, 2005 4:54 am America/New_York
Answers: 0

Re: Changes to Ocean color data web portal

by jstum » Wed May 25, 2022 12:55 pm America/New_York

Thank you Sean, I finally made a small modification to manage the ./ returned by the wget commands
Jacques

OB.DAAC - amscott
User Services
User Services
Posts: 269
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 5 times
Been thanked: 2 times

Re: Changes to Ocean color data web portal

by OB.DAAC - amscott » Wed May 25, 2022 2:19 pm America/New_York

The cause of this was located and remediated on our end, as well. It should not appear in future queries.

Post Reply