Skip to content

Commit ca0e28c

Browse files
committed
feat: added logs to wikiteam crawler!
1 parent e69b1be commit ca0e28c

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

hivemind_etl/mediawiki/wikiteam_crawler.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,9 @@ def crawl(self, api_url: str, dump_path: str) -> None:
5959
else:
6060
params.extend([f"--{key}", str(value)])
6161

62+
logging.info(f"Crawling mediawiki dump from {api_url} to {dump_path}")
63+
logging.info(f"Parameters: {params}")
64+
6265
# Directly call the DumpGenerator static __init__ method which will parse these parameters,
6366
# execute the dump generation process, and run through the rest of the workflow.
6467
DumpGenerator(params)

0 commit comments

Comments
 (0)