post processing stopped working

[phynias]

Before submitting an issue...

• Enable debug logging in settings/server.

• Repeat the actions required to reproduce the error.

Provide all information requested below. Issues without adequate information will be closed without response.

** Commit: 22a68e0
** Operating System: freebsd
** Python Version [python -V]: 3.6.1
** What happened: post processing has stopped working. from sabnzbd script it get a 500 error and then the log i sent you.
** Logs: emailed

[nilsbebelaar]

I am having the same issue, below are my logs. Feel free to ask for more info if needed.

As far as I can tell the post processor does find the correct data from imdb, but then just crashes.

Any thoughts?

INFO [2018-06-05 23:32:53,368] CPTaskScheduler._task.265: == Finished Scheduled Task: PostProcessing Scan ==
KeyError: 'filters'
filters = json.loads(movie_details['filters'])
File "/srv/Watcher3/core/searchresults.py", line 70, in score
search_result = searchresults.score([search_result], imported=True)[0]
File "/srv/Watcher3/core/library.py", line 909, in searchresults
if Manage.searchresults(data['guid'], 'Finished', movie_info=data):
File "/srv/Watcher3/core/postprocessing.py", line 485, in complete
response = self.complete(data)
File "/srv/Watcher3/core/postprocessing.py", line 200, in default
pp.default(**d)
File "/srv/Watcher3/core/scheduler.py", line 129, in scan_directory
self.task()
File "/srv/Watcher3/core/cp_plugins/taskscheduler.py", line 254, in _task
Traceback (most recent call last):
WARNING [2018-06-05 23:32:53,358] CPTaskScheduler._task.256: Scheduled Task PostProcessing Scan Failed:
INFO [2018-06-05 23:32:53,358] core.searchresults.score.38: Scoring 1 releases.
INFO [2018-06-05 23:32:53,357] core.searchresults.generate_simulacrum.446: Creating "fake" search result for imported movie The Layover
INFO [2018-06-05 23:32:53,357] core.library.searchresults.897: Guid postprocessing5468652e4c61796f not found in SEARCHRESULTS, attempting to create entry.
INFO [2018-06-05 23:32:53,356] core.library.searchresults.884: Marking guid postprocessing5468652e4c61796f as Finished.
INFO [2018-06-05 23:32:53,356] core.postprocessing.complete.481: Marking guid as Finished.
INFO [2018-06-05 23:32:53,355] core.postprocessing.default.198: Post-processing as Complete.
INFO [2018-06-05 23:32:52,876] core.movieinfo._search_tmdbid.157: Searching TMDB https://api.themoviedb.org/3/movie/339404?language=en-US&append_to_response=alternative_titles,external_ids,release_dates
INFO [2018-06-05 23:32:52,876] core.movieinfo._search_tmdbid.153: Searching TheMovieDB for TMDB ID: 339404.
INFO [2018-06-05 23:32:52,425] core.movieinfo._search_title.97: Searching TMDB https://api.themoviedb.org/3/search/movie?page=1&include_adult=false&query=the layover&year=2017
INFO [2018-06-05 23:32:52,425] core.movieinfo._search_title.86: Searching TheMovieDB for title: The Layover 2017.
INFO [2018-06-05 23:32:52,425] core.movieinfo.search.59: Searching TheMovieDB for The Layover 2017
INFO [2018-06-05 23:32:52,416] core.library.parse_media.450: Parsing codec data from file /media/Films_Series/Completed/Films/The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT/The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT.mkv.
INFO [2018-06-05 23:32:52,416] core.library.parse_filename.512: Found {'title': 'The Layover', 'resolution': '1080p', 'release_name': 'The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT', 'codec': 'H264', 'year': 2017, 'quality': 'WEB-DL', 'audio': 'DD5.1', 'group': 'FGT'} in filename.
INFO [2018-06-05 23:32:52,416] core.library.parse_filename.504: Parsing directory name for movie information: The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT.
INFO [2018-06-05 23:32:52,415] core.library.from_file.380: Gathering metadata for /media/Films_Series/Completed/Films/The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT/The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT.mkv.
INFO [2018-06-05 23:32:52,415] core.postprocessing.get_movie_info.334: Unable to find local data for release. Using only data found from file.
INFO [2018-06-05 23:32:52,415] core.postprocessing.get_movie_info.316: Unable to find local release info by release name.
INFO [2018-06-05 23:32:52,414] core.postprocessing.get_movie_info.311: Searching local database for release name The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT
INFO [2018-06-05 23:32:52,414] core.postprocessing.get_movie_info.295: Guid not found.
INFO [2018-06-05 23:32:52,414] core.postprocessing.get_movie_info.292: Unable to find local release info by guid.
INFO [2018-06-05 23:32:52,412] core.postprocessing.get_movie_info.287: Searching local database for guid.
INFO [2018-06-05 23:32:52,412] core.postprocessing.default.190: Gathering release information.
INFO [2018-06-05 23:32:52,412] core.postprocessing.get_movie_file.265: Largest file in directory /media/Films_Series/Completed/Films/The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT is /The.Layover.2017.1080p.WEB-DL.DD5.1.H264-FGT.mkv, processing this file.
INFO [2018-06-05 23:32:52,412] core.postprocessing.get_movie_file.240: Finding movie file.
INFO [2018-06-05 23:32:52,411] core.postprocessing.default.158: #################################
INFO [2018-06-05 23:32:52,411] core.postprocessing.default.157: Post-processing request received.

[nosmokingbandit]

Should be good to go in 53a0d3b.

…

On Mon, Jun 4, 2018 at 12:27 AM phynias ***@***.***> wrote: Before submitting an issue... - Enable debug logging in settings/server. - Repeat the actions required to reproduce the error. Provide all information requested below. Issues without adequate information will be closed without response. ** Commit: 22a68e0 <22a68e0> ** Operating System: freebsd ** Python Version [python -V]: 3.6.1 ** What happened: post processing has stopped working. from sabnzbd script it get a 500 error and then the log i sent you. ** Logs: emailed — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#253>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AKX1ScDdNWwDW_tifBPxsOESg-ch2qScks5t5LdNgaJpZM4UYbg6> .

[phynias]

broken again in the latest commit again.

INFO [2018-08-16 21:49:51,799] core.postprocessing.default.156: #################################
INFO [2018-08-16 21:49:51,815] core.postprocessing.default.157: Post-processing request received.
INFO [2018-08-16 21:49:51,816] core.postprocessing.default.158: #################################
INFO [2018-08-16 21:49:51,816] core.postprocessing.map_remote.622: Changing remote path from /media/couchpotato/Stargate.The.Ark.Of.Truth.2008.1080p.Bluray.DTS.x264-eViAN-4P to /mnt/incoming/Stargate.The.Ark.Of.Truth.$
INFO [2018-08-16 21:49:51,816] core.postprocessing.get_movie_file.236: Finding movie file.
INFO [2018-08-16 21:49:51,818] core.postprocessing.get_movie_file.260: Largest file in directory /mnt/incoming/Stargate.The.Ark.Of.Truth.2008.1080p.Bluray.DTS.x264-eViAN-4P is /mnt/incoming/Stargate.The.Ark.Of.Truth.2$
INFO [2018-08-16 21:49:51,818] core.postprocessing.default.186: Gathering release information.
INFO [2018-08-16 21:49:51,818] core.postprocessing.get_movie_info.284: Searching local database for guid.
INFO [2018-08-16 21:49:51,845] core.postprocessing.get_movie_info.289: Unable to find local release info by guid.
INFO [2018-08-16 21:49:51,845] core.postprocessing.get_movie_info.292: Guid not found.
INFO [2018-08-16 21:49:51,845] core.postprocessing.get_movie_info.294: Searching local database for downloadid.
INFO [2018-08-16 21:49:51,850] core.postprocessing.get_movie_info.303: Unable to find local release info by downloadid.
INFO [2018-08-16 21:49:51,850] core.postprocessing.get_movie_info.308: Searching local database for release name Stargate.The.Ark.Of.Truth.2008.1080p.Bluray.DTS.x264-eViAN-4P
INFO [2018-08-16 21:49:51,856] core.postprocessing.get_movie_info.313: Unable to find local release info by release name.
INFO [2018-08-16 21:49:51,856] core.postprocessing.get_movie_info.331: Unable to find local data for release. Using only data found from file.
INFO [2018-08-16 21:49:51,856] core.postprocessing.default.194: Post-processing as Complete.
INFO [2018-08-16 21:49:51,856] core.postprocessing.complete.478: Marking guid as Finished.
INFO [2018-08-16 21:49:51,856] core.postprocessing.complete.525: Imdbid not supplied or found, unable to update Movie status.
ERROR [2018-08-16 21:49:51,856] cherrypy.error.34511872968.error.219: [16/Aug/2018:21:49:51] HTTP
Traceback (most recent call last):
  File "/usr/local/Watcher3/lib/cherrypy/_cprequest.py", line 670, in respond
    response.body = self.handler()
  File "/usr/local/Watcher3/lib/cherrypy/lib/encoding.py", line 220, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/usr/local/Watcher3/lib/cherrypy/lib/jsontools.py", line 61, in json_handler
    value = cherrypy.serving.request._json_inner_handler(*args, **kwargs)
  File "/usr/local/Watcher3/lib/cherrypy/_cpdispatch.py", line 60, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/usr/local/Watcher3/core/postprocessing.py", line 196, in default
    response = self.complete(data)
  File "/usr/local/Watcher3/core/postprocessing.py", line 529, in complete
    data.update(Metadata.convert_to_db(data))
  File "/usr/local/Watcher3/core/library.py", line 556, in convert_to_db
    logging.info('Converting movie metadata to database structure for {}.'.format(movie['title']))
KeyError: 'title'
INFO [2018-08-16 21:49:51,929] cherrypy.error.34511872968.error.219: [16/Aug/2018:21:49:51] HTTP
Request Headers:
  Remote-Addr: 192.168.1.203
  ACCEPT-ENCODING: identity
  HOST: 192.168.1.212:9090
  CONNECTION: close
  USER-AGENT: Mozilla/5.0
  Content-Type: application/x-www-form-urlencoded
  Content-Length: 378

[xGBHxPegasus]

Get the same on mine, I thought it was something to do with the file so chalked it up to that.

Apparently not.

[nosmokingbandit]

Are you log lines truncated? I ask because of the line that ends with /mnt/incoming/Stargate.The.Ark.Of.Truth.2$.

It seems like it isn't getting the title from the movie file, which should be impossible since the title has a default value set.

[nosmokingbandit]

Ignore that, should be ok in 6d964a9

To make a long story slightly less long, when I test I run some manual processing since I can't really download a movie and have a download client send a request every time I change something in the processing methods. Except that things are handled slightly differently if the movie is already in the db or if it is being added to Watcher as it is being processed and that isn't always covered by manual processing requests.