-
Notifications
You must be signed in to change notification settings - Fork 43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ERROR SCARPING FEED #21
Comments
i think ['feed']['media']['nodes'] is no longer valid .... i changed it to ['graphql']['user']['edge_web_feed_timeline']['edges'] in operation.py in line 167 but got this error File "/home/shoutoutsng/content.py", line 34, in get_next_media |
try it out, should be working Instagram changed their json response with feed media. |
Yes works fine,,, Sorry for disturbing... It get pictures on feed
randomly,, I want it to get only recently uploaded picture,,, keep Scraping
until it finds a new one,,,
…On Mar 3, 2017 7:37 PM, "Mateusz Pawlak" ***@***.***> wrote:
try it out, should be working Instagram changed their json response with
feed media.
👍
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#21 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AUPGkvk5xaaJWCmVULsMEmVAEEsUPCEaks5riF3WgaJpZM4MP2oV>
.
|
How can I fix this please :(
…On Mar 8, 2017 5:22 PM, "Abiodun Oyetomi" ***@***.***> wrote:
Yes works fine,,, Sorry for disturbing... It get pictures on feed
randomly,, I want it to get only recently uploaded picture,,, keep Scraping
until it finds a new one,,,
On Mar 3, 2017 7:37 PM, "Mateusz Pawlak" ***@***.***> wrote:
> try it out, should be working Instagram changed their json response with
> feed media.
> 👍
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <#21 (comment)>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/AUPGkvk5xaaJWCmVULsMEmVAEEsUPCEaks5riF3WgaJpZM4MP2oV>
> .
>
|
Well it works that way if i remember correctly so it is not about fixing
but rather scripting new functionality.
W dniu śr., 8.03.2017 o 17:32 virginsince1997 <notifications@github.com>
napisał(a):
How can I fix this please :(
On Mar 8, 2017 5:22 PM, "Abiodun Oyetomi" ***@***.***> wrote:
> Yes works fine,,, Sorry for disturbing... It get pictures on feed
> randomly,, I want it to get only recently uploaded picture,,, keep
Scraping
> until it finds a new one,,,
> On Mar 3, 2017 7:37 PM, "Mateusz Pawlak" ***@***.***>
wrote:
>
>> try it out, should be working Instagram changed their json response with
>> feed media.
>> 👍
>>
>> —
>> You are receiving this because you authored the thread.
>> Reply to this email directly, view it on GitHub
>> <
#21 (comment)
>,
>> or mute the thread
>> <
https://github.com/notifications/unsubscribe-auth/AUPGkvk5xaaJWCmVULsMEmVAEEsUPCEaks5riF3WgaJpZM4MP2oV
>
>> .
>>
>
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#21 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AR1lf18VRzHhnGRfn5BovANXQzZZ_VYhks5rjtf-gaJpZM4MP2oV>
.
--
010100000110111101111010011001000111001001100001011101110110100101100001011011010010110000001101000010100100110101100001011101000110010101110101011100110111101000100000010100000110000101110111011011000110000101101011
|
Alright then
…On Mar 8, 2017 6:45 PM, "Mateusz Pawlak" ***@***.***> wrote:
Well it works that way if i remember correctly so it is not about fixing
but rather scripting new functionality.
W dniu śr., 8.03.2017 o 17:32 virginsince1997 ***@***.***>
napisał(a):
> How can I fix this please :(
> On Mar 8, 2017 5:22 PM, "Abiodun Oyetomi" ***@***.***> wrote:
>
> > Yes works fine,,, Sorry for disturbing... It get pictures on feed
> > randomly,, I want it to get only recently uploaded picture,,, keep
> Scraping
> > until it finds a new one,,,
> > On Mar 3, 2017 7:37 PM, "Mateusz Pawlak" ***@***.***>
> wrote:
> >
> >> try it out, should be working Instagram changed their json response
with
> >> feed media.
> >> 👍
> >>
> >> —
> >> You are receiving this because you authored the thread.
> >> Reply to this email directly, view it on GitHub
> >> <
> https://github.com/mpawlak2/instalike-instagram-bot/
issues/21#issuecomment-284034289
> >,
> >> or mute the thread
> >> <
> https://github.com/notifications/unsubscribe-auth/
AUPGkvk5xaaJWCmVULsMEmVAEEsUPCEaks5riF3WgaJpZM4MP2oV
> >
> >> .
> >>
> >
>
> —
> You are receiving this because you commented.
>
>
> Reply to this email directly, view it on GitHub
> <https://github.com/mpawlak2/instalike-instagram-bot/
issues/21#issuecomment-285091611>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/
AR1lf18VRzHhnGRfn5BovANXQzZZ_VYhks5rjtf-gaJpZM4MP2oV>
> .
>
--
010100000110111101111010011001000111001001100001011101110110
100101100001011011010010110000001101000010100100110101100001
011101000110010101110101011100110111101000100000010100000110
000101110111011011000110000101101011
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#21 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AUPGkqqcDj0zQF1EqsVzMdM5EtTcwiSqks5rjulNgaJpZM4MP2oV>
.
|
Could you please add it?
…On Mar 9, 2017 1:34 AM, "Abiodun Oyetomi" ***@***.***> wrote:
Alright then
On Mar 8, 2017 6:45 PM, "Mateusz Pawlak" ***@***.***> wrote:
> Well it works that way if i remember correctly so it is not about fixing
> but rather scripting new functionality.
>
> W dniu śr., 8.03.2017 o 17:32 virginsince1997 ***@***.***>
> napisał(a):
>
> > How can I fix this please :(
> > On Mar 8, 2017 5:22 PM, "Abiodun Oyetomi" ***@***.***>
> wrote:
> >
> > > Yes works fine,,, Sorry for disturbing... It get pictures on feed
> > > randomly,, I want it to get only recently uploaded picture,,, keep
> > Scraping
> > > until it finds a new one,,,
> > > On Mar 3, 2017 7:37 PM, "Mateusz Pawlak" ***@***.***>
> > wrote:
> > >
> > >> try it out, should be working Instagram changed their json response
> with
> > >> feed media.
> > >> 👍
> > >>
> > >> —
> > >> You are receiving this because you authored the thread.
> > >> Reply to this email directly, view it on GitHub
> > >> <
> > https://github.com/mpawlak2/instalike-instagram-bot/issues/
> 21#issuecomment-284034289
> > >,
> > >> or mute the thread
> > >> <
> > https://github.com/notifications/unsubscribe-auth/AUPGkvk5xa
> aJWCmVULsMEmVAEEsUPCEaks5riF3WgaJpZM4MP2oV
> > >
> > >> .
> > >>
> > >
> >
> > —
> > You are receiving this because you commented.
> >
> >
> > Reply to this email directly, view it on GitHub
> > <https://github.com/mpawlak2/instalike-instagram-bot/issues/
> 21#issuecomment-285091611>,
> > or mute the thread
> > <https://github.com/notifications/unsubscribe-auth/AR1lf18VR
> zHhnGRfn5BovANXQzZZ_VYhks5rjtf-gaJpZM4MP2oV>
> > .
> >
> --
> 010100000110111101111010011001000111001001100001011101110110
> 100101100001011011010010110000001101000010100100110101100001
> 011101000110010101110101011100110111101000100000010100000110
> 000101110111011011000110000101101011
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <#21 (comment)>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/AUPGkqqcDj0zQF1EqsVzMdM5EtTcwiSqks5rjulNgaJpZM4MP2oV>
> .
>
|
How would that work? Like every picture from your feed? |
The script likes randomly,,,, likes pictures from my feed that are hours
old,,, want it to get only recently uploaded picture,,, rather than random
Pictures,,, that way it likes from bottom to top
…On Mar 9, 2017 8:42 AM, "Mateusz Pawlak" ***@***.***> wrote:
How would that work? Like every picture from your feed?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#21 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AUPGknyK-1n_AEwi8fCG2n5Y9w7rDq_rks5rj617gaJpZM4MP2oV>
.
|
hmm i see what you mean. Would that be good: every time bot is about to like picture (say every 30-40s depends on settings) it then downloads ONE most recent picture and likes it, what do you think? Whereas now it persists e.g. 5 most recent pictures and then like every picture with these time delays thats why it may seem like bot likes old posts. |
"Would that be good: every time bot is about to like picture (say every
30-40s depends on settings) it then downloads ONE most recent picture and
likes it, what do you think?"
Yes exactly what I meant,,,, SCRAPE FEED - --> GET RECENT PICTURES ON FEED
- - - >Delay,
…On Mar 9, 2017 11:25 AM, "Mateusz Pawlak" ***@***.***> wrote:
hmm i see what you mean. Would that be good: every time bot is about to
like picture (say every 30-40s depends on settings) it then downloads ONE
most recent picture and likes it, what do you think?
Whereas now it persists i.e. 5 most recent pictures and then like every
picture with these time delays thats why it may seem like bot likes old
posts.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#21 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AUPGku-ndLzeEUyXuHaKnzHpq7S9KxNQks5rj9OFgaJpZM4MP2oV>
.
|
But if there's no new picture on feed,,,, It should keep Scraping until it
finds one... But the delay should help keep that in check
…On Mar 9, 2017 1:02 PM, "Abiodun Oyetomi" ***@***.***> wrote:
"Would that be good: every time bot is about to like picture (say every
30-40s depends on settings) it then downloads ONE most recent picture and
likes it, what do you think?"
Yes exactly what I meant,,,, SCRAPE FEED - --> GET RECENT PICTURES ON FEED
- - - >Delay,
On Mar 9, 2017 11:25 AM, "Mateusz Pawlak" ***@***.***>
wrote:
> hmm i see what you mean. Would that be good: every time bot is about to
> like picture (say every 30-40s depends on settings) it then downloads ONE
> most recent picture and likes it, what do you think?
>
> Whereas now it persists i.e. 5 most recent pictures and then like every
> picture with these time delays thats why it may seem like bot likes old
> posts.
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <#21 (comment)>,
> or mute the thread
> <https://github.com/notifications/unsubscribe-auth/AUPGku-ndLzeEUyXuHaKnzHpq7S9KxNQks5rj9OFgaJpZM4MP2oV>
> .
>
|
Due to recent instagram changes , am unable to scrape feed with the bot ,,,, i keep getting this error
File
"/home/shoutoutsng/instabot.py", line 76, in startself.like_bot.act()
File "/home/shoutoutsng/instalike.py", line 54, in act
media = self.content_manager.get_next_media()
File "/home/shoutoutsng/content.py", line 34, in get_next_media
if(not self.scrap_media()):
File "/home/shoutoutsng/content.py", line 83, in scrap_media
response = self.scrap_feed_media() or response
File "/home/shoutoutsng/content.py", line 101, in scrap_feed_media
feed_media = self.operation.get_feed_media()
File "/home/shoutoutsng/operation.py", line 167, in get_feed_media
json_feed = json.loads(feed_media.group(1))['entry_data']['FeedPage'][0]['feed']['media']['nodes']
KeyError: 'feed'`
The text was updated successfully, but these errors were encountered: