It could be the server is blocking your header to prevent web scrapping , try to change the default user-agent from the urlib header use Request.add_header
It could be the server is blocking your header to prevent web scrapping , try to change the default user-agent from the urlib header use Request.add_header