[DATABASE] HOST = cloudberry05.ics.uci.edu, CONNECTION COUNT = 18, MAXIMUM = 100
Crawler Started
Sending a Request to Twitter Get Status API
Returning twitter.Status count: 0
Total crawled count 416018
[DATABASE] HOST = cloudberry05.ics.uci.edu, CONNECTION COUNT = 21, MAXIMUM = 100
Total data inserted into records: 373360, Total data with locations inserted into records: 42466
self._insert_ids([(i,) for i in data_list])
File "/extra/yicongh10/CoronavirusTwiCrawler/dumper/twitter_dumper.py", line 54, in _insert_ids
extras.execute_values(cur, TweetDumper.INSERT_LOCATION_QUERY, ids)
File "/extra/yicongh10/CoronavirusTwiCrawler/venv/lib64/python3.6/site-packages/psycopg2/extras.py", line 1281, in execute_values
cur.execute(b''.join(parts))
psycopg2.errors.DeadlockDetected: deadlock detected
DETAIL: Process 23821 waits for ShareLock on transaction 46067403; blocked by process 23931.
Process 23931 waits for ShareLock on transaction 46067402; blocked by process 23821.
HINT: See server log for query details.
CONTEXT: while inserting index tuple (1444912,63) in relation "records"
Main : thread 0 done```
