Is there a way to download all the files on https://asdc.larc.nasa.gov/data/CALIPSO/LID_L3_Tropospheric_APro_AllSky-Standard-V4-20/ but exclude the files "D.hdf" and so only download the "N.hdf" ?
Sure, you can use the "--accept" or "--reject" arguments to filter out the data you want. To use "--accept", just add the "--accept *N.hdf" argument to the command. Alternatively, you could use "--reject" by adding "--reject *D.hdf" to the command. You can read more about these commands here: https://www.gnu.org/software/wget/manual/html_node/Types-of-Files.html#:~:text=The%20argument%20to%20%27%20%2D%2Daccept,%5B0%2D9%5D*%20%27.
I don't know of a way to request a longer life token, it may be worth asking Earthdata using the Feedback button in the top-right. Another option would be to have your script use the API to check generate a new token when your current one has expired, you can find an example on this page:
I hope that helps.
The error is as follows:
#I have used the token as mentioned in the first post
# wget script
wget --header "Authorization: Bearer $TOKEN" --recursive --no-parent --reject "index.html*" --execute robots=off $URL
--2023-10-10 14:03:43-- https://asdc.larc.nasa.gov/data/MISR/MIL3MAEN.004/
Resolving asdc.larc.nasa.gov (asdc.larc.nasa.gov)... 22.214.171.124, 2001:4d0:2340:4001::7e
Connecting to asdc.larc.nasa.gov (asdc.larc.nasa.gov)|126.96.36.199|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘asdc.larc.nasa.gov/data/MISR/MIL3MAEN.004/index.html.tmp’
asdc.larc.nasa.gov/data/MISR/MIL3MAEN.004/index.ht [ <=> ] 12.38K 47.6KB/s in 0.3s
2023-10-10 14:04:45 (47.6 KB/s) - Read error at byte 12678 (Success).Retrying.
# This error keeps on repeating
Any help is much appreciated. Thank you.