Skip to content

Commit 6404d0f

Browse files
committed
fixup! Skip Writing Zero Frequency Pages on CSV
1 parent 51260f5 commit 6404d0f

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

Search-Engine-and-Crawler/Crawler/search.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -106,11 +106,12 @@ def main():
106106
logger.info("Final dictionary appended!")
107107

108108
# prepend the current URL onto the frequencies dict object
109-
final_csv_dict[0]['frequency_sum'] = sum(final_csv_dict[0].values())
109+
freq_sum = sum(final_csv_dict[0].values())
110+
final_csv_dict[0]['frequency_sum'] = freq_sum
110111
final_csv_dict[0]['url'] = current_url
111112

112113
# ignore zero frequency_sum...
113-
if final_csv_dict[0]['frequency_sum'] == 0:
114+
if freq_sum == 0:
114115
pbar.update(1)
115116
continue
116117

0 commit comments

Comments
 (0)