[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y ] [Search | Free Show | Home]

does this crap blow anyone else's mind? imo bayesian ne

This is a blue board which means that it's for everybody (Safe For Work content only). If you see any adult content, please report it.

Thread replies: 22
Thread images: 4

does this crap blow anyone else's mind? imo bayesian neural networks are the coolest thing since sliced bread.

>Having recovered the latent manifold and assigned it a coordinate system, it becomes trivial to walk from one point to another along the manifold, creatively generating realistic digits all the while

http://blog.fastforwardlabs.com/post/149329060653/under-the-hood-of-the-variational-autoencoder-in
>>
no, but im mentally handicapped so i dont rly understand it tbqh
>>
What is this?
>>
File: 1*sHa8ND6BPGn6r0GBcaSB2A.png (357KB, 600x300px) Image search: [Google]
1*sHa8ND6BPGn6r0GBcaSB2A.png
357KB, 600x300px
>>8455247
it's the process of using neural networks to uncover the latent manifold on which some collection of data lies, once you have said manifold you can do things like hop around on it and sample fake data that closely resembles real data.

for example, here are some generated images of bedrooms from a bedroom manifold.

and here's a paper that improves superresolution techniques by projecting an enhanced image onto a manifold of natural images
https://arxiv.org/abs/1609.04802
>>
>>8455255
This isn't new though, dimension reduction via manifolds been around for more than a decade. Isomap/SE are well studied and based in theory, rather than black boxes too.
>>
>>8455349
It's never worked this well before to my knowledge.
>>
>>8454950
faking images has never been so easy
>>
>>8455255
dont you have this pic in lower resolution m8 I can still see parts of your point..
>>
>>8455255
Whad. How does knowledge that it's a manifold help? Manifold isn't some magic word, lol, it's just a type of a topological space.
>>
>>8455826
By manifold they just mean some arguably continuous subset of pixel space which is just [math]\mathbb{R}^n[/math] for some large n depending on the width and height of your images. The neural network parameterizes this space via optimization of a generative network and a discriminator network over your dataset so that crap like random noise is not on it but nice pictures of bedrooms are.
>>
>>8455846
>The neural network parameterizes this space via optimization of a generative network and a discriminator network over your dataset so that crap like random noise is not on it
How does it do it?
>>
>>8455882
By having the generative and discriminator networks compete.

Very roughly because I don't fully understand it is that the generator produces some image and the discriminator is fed some combination of these generated images and real images from the dataset and has to decide which are real and which are fake. Fooling the discriminator propagates a positive reward signal through the generator and a negative reward signal through the discriminator and correctly classifying generated images propagates a positive reward signal through the discriminator and a negative reward signal through the generator.

That's for DCGANs. The other common method (VAE) I'm not sure about but you can read about here and other places
https://openai.com/blog/generative-models/
>>
>>8454950
Looks interesting, how much CS is one supposed to know to implement/understand this?
>>
>>8455923
Very little computer science. Lots of probability and statistics and the ability to write Python programs.
>>
File: captcha.jpg (48KB, 398x270px) Image search: [Google]
captcha.jpg
48KB, 398x270px
>>8455894
Yeah thank you I think it's posterior probability being used here
https://en.wikipedia.org/wiki/Posterior_probability

Although I myself don't fully understand wtf it is supposed to mean (I know the usual bayes formula ofc) and the explanations I've googled are just fucked up.
>>
>>8455928
damn, I don't really like probability ):
>>
>>8454950
idk who posted pic related originally but it is possibly the best post on 4chan ever
>>
>>8455531
This result was shown in a few papers circa 08, with pictures of hands. In a 2D space moving in a direction coresponded with either a orientation of hand or more open/closed
>>
>>8454950
autoencoders are nothing new famalam
>>
>>8456240
>If it's not new it's not good
>>
>>8456240
Vanilla autoencoders don't really work. It's the new Bayesian spin on them that get the whole enterprise rolling again.
>>
>>8456426
>implying Bayesian autoencoders are any better than convolutional autoencoders
Thread posts: 22
Thread images: 4


[Boards: 3 / a / aco / adv / an / asp / b / bant / biz / c / can / cgl / ck / cm / co / cock / d / diy / e / fa / fap / fit / fitlit / g / gd / gif / h / hc / his / hm / hr / i / ic / int / jp / k / lgbt / lit / m / mlp / mlpol / mo / mtv / mu / n / news / o / out / outsoc / p / po / pol / qa / qst / r / r9k / s / s4s / sci / soc / sp / spa / t / tg / toy / trash / trv / tv / u / v / vg / vint / vip / vp / vr / w / wg / wsg / wsr / x / y] [Search | Top | Home]

I'm aware that Imgur.com will stop allowing adult images since 15th of May. I'm taking actions to backup as much data as possible.
Read more on this topic here - https://archived.moe/talk/thread/1694/


If you need a post removed click on it's [Report] button and follow the instruction.
DMCA Content Takedown via dmca.com
All images are hosted on imgur.com.
If you like this website please support us by donating with Bitcoins at 16mKtbZiwW52BLkibtCr8jUg2KVUMTxVQ5
All trademarks and copyrights on this page are owned by their respective parties.
Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.
This is a 4chan archive - all of the content originated from that site.
This means that RandomArchive shows their content, archived.
If you need information for a Poster - contact them.