Skip to content

Commit e14a6d0

Browse files
committed
Error fix - couldn't join parse object in urljoin.
1 parent ee70c79 commit e14a6d0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

PyCrawler.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -192,7 +192,7 @@ def queue_links(self, url, links, cid, curdepth):
192192
elif link.startswith('#'):
193193
continue
194194
elif not link.startswith('http'):
195-
link = urlparse.urljoin(urlparse.urlunparse(url),link)
195+
link = urlparse.urljoin(url.geturl(),link)
196196

197197
if link.decode('utf-8') not in crawled:
198198
try:

0 commit comments

Comments
 (0)