webisoget is a tool by Jim Fox that allows to download a SSO protected page via the command line. It supports Shibboleth authentication.
Before using it, the user has to compile it from source. This was straightforward in our case.
There is a config file, let's name it demo.login, that has to be custom-tailored to the WAYF/Discovery service used and the login page. Some keys of the key-value pairs are ids of HTML form fields. Credentials have to be stored in this file too. An example for the WAYF of the SWITCHaai test federation, using the demo identity provider looks like this:
domain=wayf-test.switch.ch; name=IdPList; user_idp=https://aai-demo-idp.switch.ch/idp/shibboleth;
name=j_loginform; j_username=demostudent; j_password=demo;
name=shibboleth;
name=; submit_value=Continue;domain=aai-demo-idp.switch.ch
The program can be executed for example like this:
webisoget -verbose -out researchdatahttp.txt -formfile demo.login -url http://kelimutu.switch.ch/aai/research-data.txt