Able to download but not export library #115
Comments
|
It seams you version of |
|
You're right. My downloading script automaticly sets the virtual environment. My library export script never had that built in. |
No problem at all. I am pleased to hear that my project is of use. But sometimes I lack a good idea of what else can be improved.
What columns would not be exported? |
|
Rename the file to tsv, had to rename it to txt to upload it. Like I said, I am currently "timed out" so to speak by getting the "license_response" error when trying to download so I'm not sure if that is the cause, but you will see that it got all the asin numbers but not all the titles. If you sort by "date_added" it seems like there was a period where it just stopped getting the info (and then starts again towards the end) These are 99.999% audible plus catelog if that matters. I think only the newest 6 are not. I think these "license_response" errors seem to end after 24hours-ish, so I will report if you'd like on what it does tomorrow. And honestly - not much can be improved. It's a great tool that does what it is supposed to! |
|
The export function should be independent from any rate limit. Can you try to export the list in json format. I've an idea what is going wrong. |
|
Again, please rename to json |
|
Can you run the following command and check, if there is a title and subtitle?! audible api -m GET -p "response_groups=contributors,media,price,product_attrs,product_desc,product_extended_attrs,product_plan_details,product_plans,rating,sample,sku,series,reviews,ws4v,origin,relationships,review_attrs,categories,badge_types,category_ladders,claim_code_url,is_downloaded,is_finished,is_returnable,origin_asin,pdf_url,percent_complete, provided_review" -i 4 library/B09G7D69CXif there is no title or subtitle can you try to set a specific marketplace like audible api -m GET -p "response_groups=contributors,media,price,product_attrs,product_desc,product_extended_attrs,product_plan_details,product_plans,rating,sample,sku,series,reviews,ws4v,origin,relationships,review_attrs,categories,badge_types,category_ladders,claim_code_url,is_downloaded,is_finished,is_returnable,origin_asin,pdf_url,percent_complete, provided_review" -i 4 -c ca library/B09G7D69CXMy suggestion is that the asin does not response correctly for your marketplace. |
|
I am located in the ca marketplace. Both commands output the exact same. It did include the title in this extract. |
|
That’s really strange. Requesting the whole library via Using the |
|
Honestly it's not that big of a deal to me - I just like to use the export to see where I am on syncing my library. On another note - what is the current limit for downloaded books per day? It seems extremely random where sometimes I max out at 70, other times at 250 so I can't seem to figure it out. I generally let it go till I get the "error: 'license_response'" |
|
Oh I saw that the export function will sort the results by asin. So they are not in order they are come in from the API response. This way I can’t validate, if the issue begins at the start of a new bunch.
That’s something I can’t tell to you. I have around 130 books in my library. So I don’t reach any rate limit yet. The "error: 'license_response'" is a |
|
I've implement a better error handling for license requests in the master branch. Maybe you can test this out? |
|
Sure. What do I do to install the new version? I assume it's a dev branch? |
|
|
Thanks - here is the output. I removed my user ID. |
|
Can you run The |
|
It seams you don’t have the rights to download this titles. Edit: Do you can download these titles to your Audible APP (for mobile devices or desktop)? |
|
Yes I can download these on the android app. |
|
I'm not sure if you want me to run those commands you requested anymore as I have now successfully downloaded those (I assume not). So i have replaced the asin with the new ones (see the next post for the output of that) |
|
It seams you have the rights for the books. But one thing is striking. You got the xml error first before the license denied error comes. Maybe you can verify something for me? Do you have the voucher file for the books, where you got the |
|
I've made some changes to this branch. This will improve the reuse of existing voucher files! Can you test this out? |
This was
linked to
pull requests
Sep 1, 2022
Merged
|
@johnlescault |
|
Hi sorry for the delay in getting back to you. I installed the new branch, got the following errors: Just so you don't have to check yourself, asin B071HP5P91 = The_Great_Debate_Advocates_and_Opponents_of_the_American_Constitution-AAX_22_64 (one of the ones giving the XML errors). So that part is definately fixed, however I still believe there is a limit per day causing this as when I try tomorrow to download, it will work. For your question regarding what files I have, specific to The_Great_Debate book here they are: |
|
Fortunately, the XML errors are gone. Do you know how many voucher files you could download before the Thank you very much for your help. PS: |
|
This morning when I ran the first download it was 76, but I believe it may be a rolling 24 hour period (or 12 hours) as I will most likely have some more downloads by tonight. debug gives the following: (output after all the books it skipped) |
|
That's really strange. You got audible api -p "response_groups=delinquency_status,customer_benefits,customer_segment,subscription_details_payment_instrument,plan_summary,subscription_details,directed_ids" -p "source=Credit" -i 4 account/informationand verify that you are member in any plan?! |
|
I ran that command, and the "status" is Active so I assume that is all good. I can still download on my Android, so I assume the limit is device based? All the different virtual environments I run all point to the same login info so I assume to the audible server it looks like the same device. I have a VM I could test it on with a fresh install (of the dev branch you made + a new "device), give me a couple hours and I'll let you know how that goes. |
|
After writing that message I thought of instead of going through the trouble of doing it from a VM I just created a new profile in audible-cli using the same credentials, simulating a second device. This does not seem to have worked. Prior to doing that, I ran another download though and got the following amounts (not the same as last time): |
|
I take it back. My android device is not letting me download once I hit that "limit". I was sure it was a week ago though. Must be account based (maybe something had changed). |
|
This is not a solution, at least we now know why. A rate limit. However, this realization raises further questions. When does the rate limit take effect? I've redownloaded my library and that library from a family member over night. ~450 aaxc files could be downloaded without any errors. But all this titles where buyed (no AYCL). Maybe you can try on the end only, if you can download a buyed item, if you reached your rate limit again. |
|
I don't think the limit is a easy one to figure out. I believe my first "download run" goes much longer than when I am continually trying. It seems once I hit that max, I only get between 70 and 150 books at a time every 12 to 24 hours. It could be done by file size rather than file count, which would make it hard to calculate as well. I'm not sure it's worth totally understanding the limit other than for you to be aware it's there for any future tickets that get created on github - if it ever happens. That being said, if you want me to test anything further I'm totally willing to help. FYI: I don't believe cover files count to the max as I just downloaded 400+ while I was "locked out" |
|
I still suspect that it only concerns AYCL titles. I think I will set up a counter for testing purposes, where you can help to test ;) |
|
I've created this new branch to count aycl files. Can you test this out and report please. |
|
Last night around 10pm (for time keeping). Didn't seem to get near as many as I normally do. |
|
The last two errors you got before you cancel the execution have nothing todo with a rate limit. The meaning is: These two voucher files are downloaded for some weeks. You can remove them and rerun the execution or simply don't halt on these errors. Update: |
The errors were there for 10 hours, it was definately stopped already. I ran a new one since 6am now (it is 8:40am now) and got the following output (it is stuck again): I will update and test out the refresh! |
|
I've extend the |
|
Is this a new update or the same (count-aycl-files branch) one from when I commented last? |
|
That's a new one with extended ignore error option (if provided)! |
|
Ok - I ran the new one with --ignore error, it gave me something that I assume is an HTML error page (over 4000 lines). I think the books that say "is not downloadable" are audible plus books that haven't been released yet - it seems audible now allows you to add to library before released which I think is new and my script added them. |
That’s the reason for this error. Try to download them as aaxc, successfully raises an error that it is not downloadable. But if he try to download the pdf, there is no such error detection. He will then open a page like this which will be outputted in the cli. I can’t add a not released book to my library. How do you do it? Edit: |
|
The asin B09TRVD2B5 (True Heart Intuitive Tarot) have multiple dates for the release. A I think the first one is the right to check the release date?! What do you think? |
On the .ca website it shows "Included in your membership This title will be released on 2022-11-11, but you can add it to your Library now." I have a tampermonkey script that adds them, it just looks for the "Add to library" button on it's own and loops through all the pages. Didn't know it was possible over the API! That would be much easier... Might have to figure out how to do that. |
I mean they all point to the same day, except two are datetime vs one being just date. Is there any way to have the program just ignore anything not yet released? Maybe it can throw an error, but just move on? |
|
Is there a reason that every time I run the script (I should be all caught up in downloads now) I seem to catch 1 or 2 new books? I get similar results to the following (without adding new books) I've done this about 4-5 times now and seems like its finding random new books... Edit: after running those 4-5 times it seems to have finally found them all. |
You can add a title via this endpoint. I've tested this only with
In case of the book mentioned, the dates are equal. But is there a difference in
I will implement this. But which key from above I should use if they are not identical?
There can be multiple reasons for this.
You can try this out next time by providing the |
|
I think I would use publication_datetime. Seems like it would be more streamline, especially considering it seems like pre-order is new. Thanks. I don't have any podcasts in the library but will add that option. I've also noticed another issue, my downloads get "stuck" it seems quiet often on large download files. I am running -v debug as I was hoping it would show anything but nothing. This has been stuck at 614M for the past 6 hours now. I have bad internet here, so I assume that may be the issue. Would there be a way to make the script check if the download hasn't changed in say something like 10minutes, it either retries, restarts or skips the file and throw an error so we can monitor? |
Great. That’s my intention too.
|
|
I've added a check for the publication date in the latest count-aycl-branch. If this is working for you I will move all changes to the master branch. Should I let in the AYCL counter?! |
|
Everything seems to be working good! |
|
That sounds great. I will make the AYCL messages as debug messages and merge them later this day. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
I can download the books successfully, but when I try to export the library as csv I get the following:
The text was updated successfully, but these errors were encountered: