[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

is there a windows program that will download and sync a thread

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 23
Thread images: 5

File: w.jpg (30KB, 684x570px) Image search: [Google]
w.jpg
30KB, 684x570px
is there a windows program that will download and sync a thread (viewable as html) to my computer until the thread 404's? i want to collect some /mu/ charts.
>>
yep
>>
sent ;-)
>>
function 4chan() {

if [[ $# -ne 1 ]]
then
echo 'No URL specified! Give the URL to thread as the ONLY argument'
return 1
fi

url=$1

grep 'boards\.4chan\.org/[a-z0-9]\{1,4\}/thread/[0-9]\{4,12\}.*' <<< $url 2>&1 > /dev/null
exit_code=$?
if [[ $exit_code -ne 0 ]]
then
echo 'Malformed URL! Give the URL to thread as the ONLY argument'
return 2
fi

curl -k -f -s $url 2>&1 > /dev/null
exit_code=$?
if [[ $exit_code -ne 0 ]]
then
echo 'Invalid URL! Or you don`t have permission to view the page'
return 3
fi

if [[ $(grep '^http' <<< $url) ]] # If thread doesn't have any protocol, add https
then
:
else
url=$(sed 's/^/https:\/\//' <<< $url)
fi

if [[ $(grep '^http:' <<< $url) ]]
then
url=$(sed 's/^http\(.*\)$/https\1/' <<< $url)
fi

total=$(curl -k -s $url | grep -o '\/\/i\.4cdn\.org\/.\{1,4\}\/[0-9]\{6,15\}\.[a-z]\{3,4\}' | uniq | wc -l)
counter=1

for image_url in $(curl -k -s $url | grep -o '\/\/i\.4cdn\.org\/.\{1,4\}\/[0-9]\{6,15\}\.[a-z]\{3,4\}' | uniq | sed 's/^/https:/')
do
echo -n Downloading image $counter of $total...
wget --no-check-certificate -q -nc $image_url
echo ' Done'
counter=$(($counter + 1))
done
}
>>
>>61868806
add that to your shell's rc file or whatever then just call it in a loop until you notice 404 error messages lol

Might be smarter to stop once the thread becomes archived since they archive way before 404 usually
>>
>>61868806
>>61868824
wait you didn't want just pics you just wanted the page itself?

How retarded are you, just use one of the mirror sites like
https://rbt.asia/mu/
>>
File: wMslByx.jpg (35KB, 500x597px) Image search: [Google]
wMslByx.jpg
35KB, 500x597px
>>61868824
>shell's rc
>>
>>61868871
well, i want to have the thread permanently on my pc so i can browse by thread name when i want some new album to listen to. should i just bookmark a thread and look it up on /mu/ archive after it's dead? i know that 4chan x redirects to archive automatically but the archive probably deletes images after a while.
>>
>>61868736
>/mu/
>listens to retarded nigger garbage
Get the fuck away
>>
>>61869038
download it from the archive after the thread dies on 4chan, nothing new will be added.

just press ctrl - s on the page lmao
>>
>>61869108
that doesn't save the images fag
>>
warosu.org/mu
>>
File: win2.webm (3MB, 1272x988px) Image search: [Google]
win2.webm
3MB, 1272x988px
>>61868970
?
>>61869163
So just use a little bash script or DownThemAll and then save. Are you new to the Internet?
>>
>>61869195
dude what am going to do with images somewhere and html somewhere else? am i going to edit them for the html myself?
https://www.youtube.com/watch?v=9Deg7VrpHbM
>>
https://github.com/bibanon/BASC-Archiver
>>
File: Capture.png (90KB, 1014x568px) Image search: [Google]
Capture.png
90KB, 1014x568px
>>61869222
So you want something like this?
>>
>>61869272
yass. this is enough. wish it renamed folders with the tab's name though.
>>61869293
that only saves images what the hell
>>
>>61869373
so you want more than images? For what purpose!?!
>>
>>61869396
to see what the thread is about
>>
>>61869222
replace every image url in html with url to downloaded image using a script and you have the same functionality
>>
>>61868736
>i want to collect some /mu/ charts.
haha nigga just like go on scaruffi.com haha
>>
File: Screenshot_20170812-205609.png (411KB, 1440x2560px) Image search: [Google]
Screenshot_20170812-205609.png
411KB, 1440x2560px
>>61869630
ahaha
>>
>>61869293
Whay a gay ass theme jej

Install GNU/Linux
Thread posts: 23
Thread images: 5


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.