[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

Web Scraping

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.
  1. Home
  2. /g/ - Technology
  3. Web Scraping
Thread replies: 7
Thread images: 1

Anonymous
Web Scraping 2016-08-31 15:50:25 Post No. 56356281
[Report] Image search: [Google]
File: lia69.jpg (7KB, 183x275px) Image search: [Google]
lia69.jpg
7KB, 183x275px
Web Scraping Anonymous 2016-08-31 15:50:25 Post No. 56356281 [Report]
I have a textbook I want to scrape through and upload. It's on one of those online textbook viewers, I'm pretty sure its all javascript. Aside from manually going through , or writing a script to , flip through each page and screenshot how do I go about downloading the book?
>>
Anonymous 2016-08-31 16:01:43 Post No.56356427
[Report]
Anonymous 2016-08-31 16:01:43 Post No.56356427 [Report]
>>56356281
Link?
>>
Anonymous 2016-08-31 16:09:59 Post No.56356528
[Report]
Anonymous 2016-08-31 16:09:59 Post No.56356528 [Report]
>>56356427
To the Textbook? It's through webassign and it requires a login. That's why I want to download it and share. It's a really expensive calc 1 book.
>>
Anonymous 2016-08-31 16:13:52 Post No.56356574
[Report]
Anonymous 2016-08-31 16:13:52 Post No.56356574 [Report]
Use the browser debug console to see what requests are made. Usually they're easy to replicate, you just have to carry the cookies from your browser.
>>
Anonymous 2016-08-31 16:14:51 Post No.56356586
[Report]
Anonymous 2016-08-31 16:14:51 Post No.56356586 [Report]
>>56356528
Post a pastebin with source code and requests/responses
>>
Anonymous 2016-08-31 16:43:40 Post No.56357012
[Report]
Anonymous 2016-08-31 16:43:40 Post No.56357012 [Report]
>>56356586
http://pastebin.com/7P5wyrRT

I don't know much about web dev but this is the js code.
>>
Anonymous 2016-08-31 16:50:13 Post No.56357094
[Report]
Anonymous 2016-08-31 16:50:13 Post No.56357094 [Report]
>>56357012
libgen is your friend

http://gen.lib.rus.ec/book/index.php?md5=F20BA0D8324C9142606EC640BDDB5DAC
Thread posts: 7
Thread images: 1
[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.