🚀 go-pugleaf

Z dniem dzisiejszym Cyfronet zablokowal mozliwosc sciagania wgetem stron z
poza Polski:

surf:~> wget -t0 http://www.cnn.com/
--02:09:28--  http://www.cnn.com:80/
           => `index.html.1'
Connecting to www.cnn.com:80... connected!
HTTP request sent, fetching headers...
Read error (Connection reset by peer) in headers.
Retrying.

--02:11:29--  http://www.cnn.com:80/
  (try: 2) => `index.html.1'
Connecting to www.cnn.com:80... connected!
HTTP request sent, fetching headers...

... i tak w kolko...

Oczywiscie "fachowcy" z Cyfronetu nie przewidzieli takiej ewentualnosci:

surf:~> wget -t0 --header "User-Agent: Mozilla/4.0 \(Compatibile, MSIE 4.01,
Win
dows98\)" http://www.cnn.com/

--02:14:21--  http://www.cnn.com:80/
           => `index.html.1'
Connecting to www.cnn.com:80... connected!
HTTP request sent, fetching headers... done.
Length: unspecified [text/html]

    0K -> .......... .

itd.

W takim razie "fachowcy" z Cyfronetu ZMUSZAJA mnie do NIE UZYWANIA programu.
Czy to jest zgodne z prawem?

--
Bye,
Macko
---------------------------------------------------------------------------
"Mostly though it gave us hope that there can always be new beginnings...
even for people like us."
   -- Anla'shok Susan Ivanova, "Babylon 5 Epilogue"
_
Maciek Dobrzanski, macko@pds.net.pl, http://macko.pds.net.pl/
Entil'Zha Valen, valen@pds.net.pl, http://valen.pds.net.pl/

Wojciech Palacz napisał(a) w wiadomości:
<7b49su$iif$1@info.cyf-kr.edu.pl>...
>Jaroslaw Rafa (RAJ@inf.wsp.krakow.pl) wrote:
>> Dnia 24 Feb 99 o godz. 21:58, Wojciech Palacz napisal(a):
>>
>> > Rzeczywiscie kontynuowal transmisje od miejsca w ktorym poprzednio
>> > ja zerwal? Czy moglbys mi powiedziec jaki to byl serwer - bo mnie
>> > przy testach za kazdym razem zaczynal sciagac od poczatku. Niewazne,
>> > czy dodawalem --header "Pragma: no-cache" czy tez --header
>>
>> --header="Pragma: no-cache". Moze wget'owi ten znak rownosci robi
roznice...
>>
>> > "Cache-Control: no-cache". Wygladalo to tak, jakby cache nie byl
>> > w stanie zrozumiec naglowkow "Range:" i je zjadal...
>>
>> www.sunpack.com. Zreszta dokladny URL jest w liscie, ktory wyslalem
wczoraj
>> na polipa opisujac moje problemy z tym cache'm.
>> Sam piszesz, ze Shift+Reload ci w pewnym momencie zadzialalo.
>> A Shift+Reload wysyla wlasnie "Pragma: no-cache", ZTCW.
>
>OK, dzieki. Odszukalem ten URL i troche z nim powalczylem, zeby
>ostatecznie sprawdzic, czy sciaganie na raty dziala czy tez nie.
>Zdaje sie, ze dziala, ale natknalem sie na naprawde dziwna rzecz,
>ktorej nie umiem wyjasnic.
>
>Odpalilem wget, ale sie pomylilem i zamiast 'Pragma' wklepalem
>'Prgama'. Zorientowalem sie troche pozno, i walnalem ^C dopiero
>po jakichs 150KB. Poprawilem, uruchomilem jeszcze raz...
>i owe pierwsze 150KB przelecialo jak blyskawica, a dalej
>sie ciagnelo w normalnym tempie. Odruchowo znowu ^C,
>i probowalem dalej.
>Wyszlo mi na to, ze Cyfronet zaczal ignorowac "Pragma: no-cache".
>Za to obecnie jest inteligentniejszy, i jesli na dysku ma tylko
>poczatek pliku, to zwraca ten poczatek, a potem reszte w miare
>pobierania jej z serwera WWW. Popatrzcie zreszta sami na czasy
>transmisji - zapis moich testow jest ponizej. To czy po --header
>byl znak rownosci czy tez nie nie gralo zadnej roli.
>
>Na samym koncu jest pokazane wymuszone przeze mnie sciaganie
>w dwoch czesciach. Pierwsza czesc znowu szla z cache'a (musicie
>mi uwierzyc na slowo), a druga juz z oryginalnego serwera.
>Przynajmniej tyle dobrze, ze 'Range' dziala...
>
>Potem probowalem z netszkapa i paroma jpegami z geocities.
>Dzialalo dobrze - po Reload przeladowywuje sie z cache'a,
>po SHIFT-Reload z geocities.
>
>Co ja tutaj robie zle? Czyzby cache rozpoznawal czy laczy sie
>wget czy szkapa? A moze to 'features' swiezo wymienionego
>oprogramowania cache'a (poprzednio 'Date' bylo samymi duzymi
>literami, teraz jest poprawnie)?
>
>Jesli ktos inny tez moglby poswiecic chwile czasu na eksperymenty
>z "Pragma: no-cache" i podrzucic na polipa swoje wyniki, bylbym
>wdzieczny. Chociaz z tym moze lepiej chwile poczekac, az Cyfronet
>oglosi ze przestal wymieniac oprogramowanie.
>
>Wojciech Palacz
>wojtek@virgo.ii.uj.edu.pl
>
>
>---------- tutaj bawilem sie wget 1.4.5, ktory mamy zainstalowany
>
>virgo% wget --header="Prgama: no-cache"
http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>--17:34:42--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .^Cvirgo%
>virgo%
>virgo%
>virgo% ^Prga^Prag
>wget --header="Pragma: no-cache"
http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>--17:42:48--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz.1'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .........^Cvirgo%
>virgo%
>virgo%
>virgo% rm r2*
>rm: remove r2hsparcsol414.tar.gz? y
>rm: remove r2hsparcsol414.tar.gz.1? y
>virgo% !wg
>wget --header="Pragma: no-cache"
http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>--17:45:34--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .......... .......... .......... ..........
>  250K -> .......... .......... .......... .......... ..........
>  300K -> .......... .......... .......... ....
>
>17:46:49 (4.46 KB/s) - `r2hsparcsol414.tar.gz' saved [342146/342146]
>
>virgo% rm r2*
>rm: remove r2hsparcsol414.tar.gz? y
>virgo% !wg
>wget --header="Pragma: no-cache"
http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>--17:47:03--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .......... .......... .......... ..........
>  250K -> .......... .......... .......... .......... ..........
>  300K -> .......... .......... .......... ....
>
>17:47:04 (337.50 KB/s) - `r2hsparcsol414.tar.gz' saved [342146/342146]
>
>virgo% !rm
>rm r2*
>rm: remove r2hsparcsol414.tar.gz? y
>virgo% wget --header "Pragma: no-cache"
http://www.sunpack.com//RTF/latest/r2hsparcsol414.tar.gz
>--17:47:52--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .......... .......... .......... ..........
>  250K -> .......... .......... .......... .......... ..........
>  300K -> .......... .......... .......... ....
>
>17:47:53 (428.37 KB/s) - `r2hsparcsol414.tar.gz' saved [342146/342146]
>
>virgo% wget --header "Pragma: no-cache"
http://www.sunpack.com/RTF/latest/r2hsparcsol414.tar.gz
>--17:49:23--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz.1'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .......... .......... .......... ..........
>  250K -> .......... .......... .......... .......... ..........
>  300K -> .......... .......... .......... ....
>
>17:49:24 (431.69 KB/s) - `r2hsparcsol414.tar.gz.1' saved [342146/342146]
>
>virgo% !rm
>rm r2*
>rm: remove r2hsparcsol414.tar.gz? y
>rm: remove r2hsparcsol414.tar.gz.1? y
>virgo%
>virgo%
>virgo% !wg
>wget --header "Pragma: no-cache"
http://www.sunpack.com/RTF/latest/r2hsparcsol414.tar.gz
>--17:49:48--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .......... .......... .......... ..........
>  250K -> .......... .......... .......... .......... ..........
>  300K -> .......... .......... .......... ....
>
>17:49:49 (435.06 KB/s) - `r2hsparcsol414.tar.gz' saved [342146/342146]
>
>virgo% wget --header="Pragma: no-cache"
http://www.sunpack.com/RTF/latest/r2hsparcsol414.tar.gz
>--17:50:12--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz.1'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .......... .......... .......... ..........
>  250K -> .......... .......... .......... .......... ..........
>  300K -> .......... .......... .......... ....
>
>17:50:13 (370.43 KB/s) - `r2hsparcsol414.tar.gz.1' saved [342146/342146]
>
>virgo% ^Pragma^Cache-Control
>wget --header="Cache-Control: no-cache"
http://www.sunpack.com/RTF/latest/r2hsparcsol414.tar.gz
>--17:50:25--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz.2'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, fetching headers... done.
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... ..........
>   50K -> .......... .......... .......... .......... ..........
>  100K -> .......... .......... .......... .......... ..........
>  150K -> .......... .......... .......... .......... ..........
>  200K -> .......... .......... .......... .......... ..........
>  250K -> .......... .......... .......... .......... ..........
>  300K -> .......... .......... .......... ....
>
>17:50:25 (427.82 KB/s) - `r2hsparcsol414.tar.gz.2' saved [342146/342146]
>
>
>---------- a tu swiezutko skompilowanym 1.5.3
>
>
>virgo% ./wget --header="Pragma: no-cache"
http://www.sunpack.com/RTF/latest/r2hsparcsol414.tar.gz
>--18:34:05--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, awaiting response... 200 OK
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... .......... [ 14%]
>   50K -> .......... .......... .......... .......... .......... [ 29%]
>  100K -> .......... .......... .......... .......... .......... [ 44%]
>  150K -> .......... .......... .......... .......... .......... [ 59%]
>  200K -> .......... .......... .......... .......... .......... [ 74%]
>  250K -> .......... .......... .......... .......... .......... [ 89%]
>  300K -> .......... .......... .......... ....                  [100%]
>
>18:34:07 (360.83 KB/s) - `r2hsparcsol414.tar.gz' saved [342146/342146]
>
>virgo% ./wget --header "Cache-Control: no-cache"
http://www.sunpack.com/RTF/latest/r2hsparcsol414.tar.gz
>--18:37:27--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>           => `r2hsparcsol414.tar.gz.1'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, awaiting response... 200 OK
>Length: 342,146 [application/x-tar]
>
>    0K -> .......... .......... .......... .......... .......... [ 14%]
>   50K -> .......... .......... .......... .......... .......... [ 29%]
>  100K -> .......... .......... .......... .......... .......... [ 44%]
>  150K -> .......... .......... .......... .......... .......... [ 59%]
>  200K -> .......... .......... .......... .......... .......... [ 74%]
>  250K -> .......... .......... .......... .......... ...^Z
>Stopped
>virgo% fg
>./wget --header Cache-Control: no-cache  ...
>....    [ 89%]
>
>18:51:31 (361.14 B/s) - Read error at byte 304572/342146 (No such file or
directory). Retrying.
>
>--18:51:31--  http://www.sunpack.com:80/RTF/latest/r2hsparcsol414.tar.gz
>  (try: 2) => `r2hsparcsol414.tar.gz.1'
>Connecting to www.sunpack.com:80... connected!
>HTTP request sent, awaiting response... 206 Partial content
>Length: 342,146 (37,574 to go) [application/x-tar]
>
>          [ skipping 250K ]
>  250K -> ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,,,, ,,,,,,,... [ 89%]
>  300K -> .......... .......... .......... ....                  [100%]
>
>18:52:17 (924.08 B/s) - `r2hsparcsol414.tar.gz.1' saved [342146/342146]