Challenges Downloading IONEX Data from CDDIS Servers in Singapore
Posted: Sat Jan 11, 2025 9:45 pm America/New_York
Hi everyone,
I am encountering some difficulties when trying to download IONEX data (e.g., VTEC, C1PG) from the CDDIS servers while based in Singapore.
While manually downloading files through the website, some pages don’t load properly unless I use a VPN, which comes with the drawback of slower speeds.
The bigger issue is that downloads frequently fail or stop halfway through. When I try downloading automatically with a Python script, the same issue persists. I handle this by checking if the file is complete or interrupted after each download and retrying until it is complete. While this approach works, the process is extremely slow. Sometimes, it takes 10-20 retries in a row because the fetched file is incomplete.
Has anyone else faced similar issues or found a way to deal with this? Is this a geographical problem, or am I doing something wrong in my script? If needed, I can share my code to show how I’ve been trying to handle the downloads.
Thanks in advance for any advice!
I am encountering some difficulties when trying to download IONEX data (e.g., VTEC, C1PG) from the CDDIS servers while based in Singapore.
While manually downloading files through the website, some pages don’t load properly unless I use a VPN, which comes with the drawback of slower speeds.
The bigger issue is that downloads frequently fail or stop halfway through. When I try downloading automatically with a Python script, the same issue persists. I handle this by checking if the file is complete or interrupted after each download and retrying until it is complete. While this approach works, the process is extremely slow. Sometimes, it takes 10-20 retries in a row because the fetched file is incomplete.
Has anyone else faced similar issues or found a way to deal with this? Is this a geographical problem, or am I doing something wrong in my script? If needed, I can share my code to show how I’ve been trying to handle the downloads.
Thanks in advance for any advice!