Thread replies: 6
Thread images: 1
Thread images: 1
File: unnamed.png (48KB, 300x300px) Image search:
[Google]
48KB, 300x300px
What is the simplest way to parse an HTML page that's only accessible after logging in /g/ ?
I only used Python scripts before, but I imagine that this time I'll have to handle all the login and cookie aspect myself, so I figured it would be simpler to let the browser do it.
Are extensions like Tampermonkey the way to go ?
>>
beautifulsoup if you like python
>>
>>61096141
Selenium. You can also POST to the page with requests and parse the results with bs4.
>>
>>61096165
I already use that, the problem is the login part.
>>61096183
Will try, thank you
>>
>>61096293
what do you mean login?
>>
>>61096141
pretty much have to use ghost.py, phantomjs/casperjs, selenium, etc
if not now when they flip on cloudflare you will
Thread posts: 6
Thread images: 1
Thread images: 1