Rap Song Writing Neural Network

>>59192613
Oh yeah, forgot to mention - I need a clever name for the network.

So far I have "Notorious I.B.M.", which is alright, but let me know some more names please.

that's fucking hilarious but why not have it read a bunch of rappers lyrics instead of just kanye?

Lol they couldn't be any worse than Kanye originals. Post some examples.

>>59192613
you don't really need a nueral network to make rap tho

like a depth 3 makorov chain will do it as well as real rappers

>>59192694
>makarov
lol

can a depth three markov chain rhyme/count syllables? I think not - although they're quite useful I don't know how well they'd assist in this specific matter.

>>59192663
Well, if you go to the github page you'll find you can just fill "lyrics.txt" with lyrics of your choosing (newline delimited) - and it'll work with whatever you feed it. I just found a HUGE dataset of ~6,000 kanye lyrics and decided to use that as an example.

>>59192665
give me a second

>>59192665
Funny story - originally i tried it with "Lil' B" - he's a horrible rapper and my goal was to get a neural network to write better raps than the human it learned from, and i figured that using Lil' B would make this the easiest for me.

I moved to Kanye lyrics after someone linked me to the dataset (it's in the github repo as 'kanye_lyrics.txt' - and again if you don't want to use kanye lyrics you can just fill 'lyrics.txt' with anything you like as long as it's newline delimited).

Some examples of good stuff it's written are:
http://pastebin.com/raw/MUDc9Unt
http://pastebin.com/raw/5y1x9vHk

>>59192694
uhhhh... no it won't?
like he said they can't rhyme and stuff - and if they were as good as normal rappers we'd be listening to them already...

>>59192635
Lil' Compy
Compy West

File: born-to-meme.jpg (27KB, 344x344px) Image search: [Google]

27KB, 344x344px

>le babby's first neural network

this impresses only the uninitiated.

>>59192613
Find a voice that doesnt sound like shit

>>59192665
Kanye is unironically a great rapper. Youre taste is objectively shit

>>59193378
Agreed - Kanye is really great imo.

>>59193373
I think you're right and I do need to, to an extent though. I don't want it to sound like a person (like a super realistic tts)- because i still want it to be obvious that it's not a human rapping but rather a neural network (the voice makes this obvious, and is slightly more true to my vision for the project than a realistic one), but i do believe that you're right in the respect that the voice needs to be *understandable*.

I'll look around and see what i can find, thanks!

File: question-mark.jpg (28KB, 525x492px) Image search: [Google]

28KB, 525x492px

>>59192613
Where is a good place to learn about using neural networks? I want to get into them as they seem very interesting. I used to make chatbots which used markov chains, but i've never messed around much with neural networks.

Any suggestions?

MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS
MACHINE LEARNING

NEURAL NETWORKS

>>59192635
NiggerNet Explorer

>>59192613
This is nice. Suggestions? Look into formant speech synthesis. You could maybe make your own voice.

File: ice.png (1MB, 1280x800px) Image search: [Google]

1MB, 1280x800px

WHERE DO I SIGN UP FOR TURING POLICE TO STAND MY GROUND / SERVE AND PROTECT AGAINST THIS CLEARLY THREAT TO PUBLIC SAFETY???

>>59192635
Notorious HTTP.
Puff Lappy
NAS
Networks With Attitude
Algaholics
x0rbit
RIAA-quan
.man()

As a kanye stan can i get a copy of the lyrics

>>59192613
>markov chains
>"""""""""""""deep""""""""""""" learning

>>59192635
>IBM
literally just call yourself Big Blue.
It's a rapper-ish name.

>>59193237
come off it, he's 18

what the fuck were you coding at that age?

>>59192635
Call it "gay fish"

>>59195061
multilayer perceptron if you will

>>59192613
run the speech through some autotune

>>59193929
MACHINE NETWORKS
NEURAL LEARNING

>>59192770
>>59192957
God damn are you guys retarded or just social inept? How can a joke go that far over someones head. He's joking about rap and the vocabulary used. Not funny if it has to be spelled out for you.

>>59193237
Let's see you provide something at least as meme as this with your technical skills.

File: hqdefault(2).jpg (10KB, 480x360px) Image search: [Google]

10KB, 480x360px

>>59195404
This.

>>59195010

I am fucking dying

File: 1472759676364.gif (2MB, 400x395px) Image search: [Google]

2MB, 400x395px

>>59195010

>>59193890
just learn python and then read the documentation for pybrain - worked for me

>>59195061
i don't know what you're
>implying
but yes i used markov chains, and no that isn't why i consider it deep learning - but rather because i used a deep recurrent neural net.

>>59192613
nice work, this sounds better than i exepted

>>59197270
thanks!

>>59193237
>implying that it's easy to code a neural network

fuck off

>>59193237
ur an fagit

>>59195499
nice dubs - i really do think that neural nets and machine learning are slightly more than a meme/buzzword/fad.

They've been around for a real long time - but they're getting popular now because of a lot of open source libraries/projects/etc that make it easy for anyone to develop them, and also the hardware we have today enables us to train neural nets practically.

So yes, they're popular now, and they may seem like a fad, but I believe we'll be seeing a lot of important developments regarding neural nets / machine learning in the immediate future.

>>59199802
They've definitely improved from where they were, but I think we'll hit another wall as to what they're capable of doing within the next few years. Of course this doesn't mean people shouldn't play around with them, and push them to the limit of what they can do.

>>59199940
Well, there's always stuff like the https://en.wikipedia.org/wiki/Universal_approximation_theorem , which states that a neural network with a finite amount of neurons can approximate *any* function- after making a few humble assumptions first, but still - i don't think the issue is going to be something like "neural networks are too dumb to do x, y, and z".

Personally, I think that the two challenges that we're faced with today are
>being able to see what neural networks are "thinking" - being able to see what is going on inside of them, rather.
>finding a more elegant way to link neural networks together

who knows, maybe it won't be neural networks, maybe another machine learning model that will make the difference, but i guess only time will tell. It's real interesting stuff.

>>59200056
Ah, the naive optimism of youth, I hope you truly relish the feeling of that being crushed out of you over the next twenty to thirty years

>>59192613
Neat!

The lyrics are actually decent. Not that I understand a word about it. Cuz its all in the beat.

You know. You can sell this directly to Kanye and get payed in millions! Then he dont need them rap writers anymore since its painfully obvious that modern singers dont write their own songs today.

>>59200306
Jesus Christ anon, wouldn't it just be easier and more dignified to offer him your boipussy directly?

>>59192613
>You the number one I'mma beat my brother

TOPKEK

This is cool.
A tip for naming: it can be fun to pick a fun name from a technical description.
I came across this one recently:
Annotation QUick Analysis for PhylOgeNY, "AQUA PONY".

>>59192613

>Bust a playa with the kids I never had
>All his time, all he had, all he had, all he had

Wew what a great song OP, you totally shouldn't kill yourself!

File: anal beads.png (53KB, 700x700px) Image search: [Google]

53KB, 700x700px

Going to add a word-by-word method instead of letter-by-letter to the one I made for 4chan.

>>59200306
i wouldn't want to sell it and make money... i'd rather just publish it open source...

>>59200414
lmfao

>>59200226
>the universal approximation theorem is naive optimism of youth

>>59192613
>>59201926
>>59202008
>Namefag
>replies using multiple short posts
Perhaps you should have built one that diagnoses cancer instead, then we could figure out exactly what your problem is

>>59202109
>namefag
i'm not even using a tripcode - only using my name so you can tell who i am (it's sort of relevant to discussion).

>getting mad over posting style
c'mon...

>>59192817
Didyou fucking dare disrespect the basedGod!

>>59199802
AI has seen a recent surge due to advances in deep learning brought about by geoffrey hinton. you clearly have no idea what you'e talking about and you're just an arrogant child brute forcing with a library until you see some sort of results. not necessarily a bad thing but stop being so arrogant and continue learning.

>>59192613
https://www.youtube.com/watch?v=mMBCeOnMt18

>>59202325
Sorry - you're right, my reply does make it seem that way (i typed it in like, a minute on my phone between classes at school) - and you aren't completely wrong.

I'm quite familiar with geoffrey hinton - the guy is crazy good;
>first to use back propagation
>invented boltzmann machines
>time-delay networks
>a bunch of other stuff i can't quite understand yet

I really don't know if i would attribute the ENTIRE recent surge of AI/ML to him though - although he definitely is responsible for a vast majority of it.

As for being an arrogant child - you're pretty much right about me being an arrogant child, but I haven't just been 'brute forcing with a library until i see some sort of results', I like to think it's been a little bit more sophisticated than that. Anyways - care to point me in the right direction for learning? What sort of thing should I be trying to learn, any materials that helped you grow out of the arrogant child phase? Should I read up more on the actual inner-workings of ANNs and machine learning models? Maybe try and write my own functions instead of using a library? Help me out.

I thought the surge in AI/learning is due to the vast corpus it now can draw from

>>59202325
read \/
>>59202620
its a combo of this, computer power, the internet, open source projects, rapidly spreading interest, corporations pouring a shit ton of money into ml, and a plethora of other factors. geoffrey hinton is cool but you're a faggot
>you're just an arrogant child brute forcing with a library
you can be wrong but don't be a bitch about it

File: 1403837987365.png (48KB, 400x389px) Image search: [Google]

48KB, 400x389px

>memerap track starts
>producer screaming his name in my ears
>rap man tells me I'm not ready for this one
>rap man reminds me what album I'm listening to
>rap man reminds me which year said album was recorded in
>rap man reminds me where he is in the "rap game" (at the top, of course)
>rap man tells me his name, moniker, "rap name", or all three
>rap man tells me he's "going in" before starting a verse
>rap man tells me how much money he has
>rap man says "uh... yeah"
>rap man name drops a bunch of clothing lines and automobile companies

can't understand shit because of the stupid voice

>>59202898
I'm working on the voice - if anyone reading this knows of good tts libraries hit me up.

here are the lyrics; http://pastebin.com/raw/MUDc9Unt

File: Capture.png (112KB, 1375x888px) Image search: [Google]

112KB, 1375x888px

>>59197143
>google their website
>see this

I think their site is having a meltdown right now lel

>>59203146
anyone got a link to a 3rd party site lol

>>59203146
>>59203822
https://github.com/pybrain/pybrain
the documentation is in the 'docs' folder

>>59202875
>he listens to ASAP rocky

>>59204239
Much appreciated

>>59203146
http://scikit-learn.org/stable/modules/neural_networks_supervised.html

How long does it take for it to finish making a song?

>>59195303
Kill yourself, you dumb fucking shit stain.

>>59200056
>>59200226
This. I was basically OP at his age (though I wouldn't have been retarded enough to post my full name and photo on 4chan). Now I'm currently taking ML, CV, and AI courses and my dreams are being crushed as time goes on. Don't get me wrong though. There are constant breakthroughs and new applications for any combination of these topics which are interesting to learn about.

>>59197892
>code
there is nothing being coded here
he literally imported a python lib and fed it a dataset

>>59205365
about 5 minutes on my old thinkpad (using the already trained one)

>>59205481
if you could have done anything differently - what would you have done?

>>59205734
Whelp, I'm getting an issue with Dataset being empty

>posts cool thing you did on 4chan
>Hundred people see it
>20% call you retarded
>posts cool thing on reddit
>Millions of people see it
>1% call you retarded

I don't think this is the best place to post your stuff op

>>59205749
Not been an arrogant cunt?

>>59205749
I'm a CS student and I would have started talking to professors during their office hours earlier in my university career. I only really started going regularly during the latter part of my third year. I regret not going in to talk to them earlier because they have such great insight on whatever you might be interested in and will always encourage you to learn. Your professors will likely be on the forefront of research as well, and they love to talk about their work if you are truly interested.

>>59206002
Not me

>>59205752
have you filled lyrics.txt with lyrics? (just paste some rap lyrics in there)

>>59206016
i'm taking some classes at the nearby uni and i LOVE stopping by and seeing them during office hours - you're 100% right. I'll do that more with my data professor - as he's the one who knows about neural networks and such. thank you

>>59206361
yes, it runs but it doesn't do anything it just stalls half way through. rip

>>59205833
just go back to rebbit

>>59205833
i'll post it there - which board though? i'm not very familiar with reddit...

>>59206459
Probably /r/programming or /r/compsci not /r/machinelearning though, they would rip you to shreds.

Straight outta Computer

>>59205833
>hundred
more like 16 geeks on g or if you go to pol like 24 smelly viral marketers see it. b is a porn board now so it will be invisible.

How long should this take? Mine has been sitting here for around five minutes saying it's writing the rap.

>>59206392
nono - let it go, does it "stall" after it makes the list of possible rhymes? it'll come at you all at once and generate the rap like, 5 minutes after that.

>>59207825
give it a few more minutes - it'll work. maybe try cutting the dataset down to ~1000 lines? (just backspace in lyrics.txt)

also changing word by word to 0 at the top makes it run considerably faster...

if that still doesn't work open an issue on github please

>>59207845
It stalls after saying " *Writing the rap 'word by word'* "

>>59193378
You are unironically a wanker

>>59206002
How has OP "robbie" been at all arrogant? He's answered all your "yor a dum fagit" critiques of him without getting wound up like a little bitch you are now. Grow a set and stop being a coward.

>>59193378
No one who actually knows anything about hiphop thinks Kanye is a great rapper. He's not even close to the top.

>>59208548
>t. robbie

Robbie,

please stop coming here. You're young, pretty/moderately talented (it's still too early to judge that, but you seem really passionate). I've seen your work mentioned on other media outlets recently. You have just learned python and you've still a long way to go.

Just don't fuck up and stop asking for validations here. You'll find little to zero valid input or contribution here and literally every project which crossed its road with 4chan vanquished or rotted badly.

My two cents:
- the robotic voice is horrible
- I'd plow your mouth (no homo)

it's funny but this >>59205554

>>59207942
Make an issue on github please - i'd really like to get this worked out ASAP.

>>59208617
i know you won't believe it, but surprisingly >>59208548 wasn't me.

>>59208682
thank you this is actually very good advice. I don't think i'll come to 4chan for a while after this - nothing wrong with this thread in particular but i do see your point, and i'll heed your advice.

Also
>I've seen your work mentioned on other media outlets recently.
!?!? what, where? Link me?

As for your two cents; - i'm working on the robotic voice i swear, and i'm glad you said no homo :^)

>>59208825
>!?!? what, where? Link me?
https://boingboing.net/2017/02/14/rhymes-from-a-machine-learning.html

>>59192635
"Notorious cmd"

>>59208870
holy crap what why would someone write an article about that

File: stallman_gtg.jpg (131KB, 1473x1080px) Image search: [Google]

131KB, 1473x1080px

>>59192613
Saw something similar to this a couple of months ago, it was an artificial intelligence using machine learning to develop lyrical music.

Looked through your code, and I have to say, pretty neat what you're doing here, definitely keep it up.

I'm your age at the moment, started teaching myself programming at 8th grade and it branched into EE, CE, cryptography and mathematics more and more each subsequent year, though I try to keep everything tied together in my projects.

I'm more of an engine guy myself, programming things like interpreters, graphical engines, development environments, you know the lot.

Been playing around with synthesizers recently as a means of practicing EE in the same sort of independent way I've taught myself CS, definitely recommend you to check those out if you're interested.

If I ever see you in the future, I'll say hi. You seem like a great person to work with, so good day to you.

File: 1435983119882.jpg (104KB, 336x500px) Image search: [Google]

104KB, 336x500px

>>59192613

Hey how do you get actual words out of a NN?
Do you encode each word in binary or a list of words that get elected?

>>59209156
sounds good - if you ever want to talk or email me or anything my email is on my github, and just send me an email & let me know who you are, i'd be more than happy to.

>>59208682
Dude, making a self-circlejerk post like this is probably the most pathetic thing you can do on an imageboard, especially posting the irrelevant site you got mentioned in afterwards to show off to a bunch of anonymous men. My two cents would be to stop samefagging like that in your own threads, you're destroying your ego's stability and are paving the road to major delusions (and schizo).

Also, don't make ego-centered threads like this, no one wants to read your blogs as you're not giving anyone any value.

>>59209498
i know the 55 posters / 103 posts is sort of suspicious, and i wish there was a way to prove it to you, but i'm not samefagging.

Also, as for the 'irrelevant site' i got mentioned on- you're absolutely right, it is pretty irrelevant but i hadn't read that article before. i'm a little bit flattered by it, but i'm not too proud or anything because i could be doing a lot better.

anyways, i do appreciate your concern, but i'm truly not samefagging - i don't know how i could prove it to you, so i'm not going to try very hard to.

>>59209498 also are you >>59208682 ?

>>59192613
Notorious RIG.

>>59192635
See >>59209679

File: e2_0.png (208B, 88x64px) Image search: [Google]

208B, 88x64px

>>59193237
always the edgy edge-lord

I'll look into the code some other time, but I'm kind of surprised to see that the sentences generated are in some form coherent, and not just some mad rambling.
It kind of knows how to use adjectives and verbs properly.
You just let it learn on the lyrics, and not did some tricks for the generated lyrics to be more correct?

>>59210071
well, obviously i had to do some feature extraction (functions that let the neural net know what the ending rhyme of a sentence is, functions that let it know how many syllables a sentence/word has, very basic stuff like that). Besides some feature extraction, it's purely a neural net and a markov chain.

Glad you like it!

>>59210122
Yeah, saw it just now while going over the code.
I wanted to do some NN shit for fun too, since it's kind of become the in-thing to code.
Maybe I'll work on it this weekend.
Still have to think about what to do though.

Also just on a side note. (Since this topic has overcome this thread)
Don't listen to the naysayers. They are just basically retards.
But don't get overwhelmed by praise either.
It's a nice project, and you can be proud of it, but realize this is still just a toy. A pretty nice toy.

>>59210223
>Also just on a side note. (Since this topic has overcome this thread)
>Don't listen to the naysayers. They are just basically retards.
>But don't get overwhelmed by praise either.
>It's a nice project, and you can be proud of it, but realize this is still just a toy. A pretty nice toy.

thank you - this is very solid advice - although a bit optimistic (some of the naysayers do have good points), i'll still keep it in mind.

As for a weekend project, once you get the hang of neural nets i'd love to see like, abstract art generation. I'm trying to work on that currently, but if you come up with anything email me! (email is on my github)

>>59192957
>we'd be listening to them already
What's this "we" shit you fucking wigger

>>59195404
omg anon please do!

>>59205438
I see, you're not even 18

>>59208617
>t. Cuck

This gives me the idea of using neural networks to generate the perfect shitposts

>>59212460
It already exists

>>59195010
>NAS
kek

File: It-must-be-Italian.png (8KB, 259x75px) Image search: [Google]

8KB, 259x75px

>>59192613
>How could I improve it?
Make it count syllables correctly.

Mister Barrat, here is a (You). Take it, call your mother, and tell her there is serious doubt about you ever becoming a programmer.

>>59212466
>>59212460
True story. Last time the guy posted an update something like 40-50% of posts on /g/ were from it.

>>59209498
I'm not your dude and I'm not OP. Think about your own ego and your own delusions. The post you're quoting was my first post in this thread and if you had 4chanX you would have had it marked as a new post from a new IP. But hey, you could then say that it's mobile or something, there's no end for paranoid schizos like you.

>>59209615
I am >>59208682 and the "Dude you're making a self-circlejerk" guy is not me. Once people did not get triggered that much for a name, especially if a name was really pertinent to the thread (like this case). Hell, even a trip could be justified here.
As I told you, stop coming here for anything but memes and uninformed shitposting.

>>59213565
Hi Robbie!

>>59192635
>FBI - CP

>>59209498
stop being a faggot, faggot. here's your (you)

>>59192635
Bacon & HMM

>>59208909
seconding

>>59205554
That's not all not you fucking mong.

Did you even look at the repo?

>>59202109
Why are you getting so buttmad fampai?

>>59212790
>that file name
11/10

>>59205554
exactly

another BTW I'M 18 AND I CODE ;) faggot who thinks he's shit because he followed a youtube tutorial word-for-word without using his imagination at all

nigga, in my country they teach you C++ from age 15

you're not special

>>59192613
Great job, just make sure it stays away from after 2012 uk grime because it would be rapoin about gunfingers non-stop

>>59192635
rap genie

>>59202109
also

>HELLO I'M A TEEN CODER (18, THAT'S RIGHT NIGGA)

as if that matters, when some kids program in assembly long before that age

>>59205749
in the united states in particular, many specialists with a background in engineering tend to isolate themselves from humanities education

a stat that comes to mind is how at Stanford, despite having poached some of the best faculty in every realm of the arts from all the other old institutions in places with worse weather (new haven, oxfordshire), some astonishingly low percentage of undergraduates ever interface with the higher-lever content that these faculty members offer (if i recall it was around 20% in 2012~)

it speaks to the insulation of big tech, which has expanded in the silicon valley in a manner similar to that of finance in new york, industrial manufacturing in chicago/detroit and pretty much every other hub that has been at the center of an economic system

despite that, there is a very strong attitude within the professional realm of CS that behaves in a way that suggests they think the valley is special! unique! different from all the other cases where a new profession has emerged and achieved social dominance

people here talking about your idealism being crushed or your excitement about this tech may seem a little salty and jaded, but that's because a lot of the stuff you've been posting is kinda tied to the meme marketing side of engineering (that brogrammer startups survive off of) rather than the more purely intellectual pursuit of compsci that the major nerds do

so my advice would be to temper your passion for engineering with other disciplines so that you are able to more accurately integrate your specific knowledge into viewpoints regarding the world around you

also it was pretty dumb to post full name and stuff on 4chan. good thing people here are less interested in fucking up random posters :)

>>59192613
>What do you think? How could I improve it?
Use Aesop Rock as a basis for lyrics instead of Kanye.
>Kanye
Seriously, fucking why? His lyricism is terrible. Godly production tho'.

>>59192613
good stuff dude

what's an easy way to grab lyrics?

File: theSop.png (221KB, 1154x705px) Image search: [Google]

221KB, 1154x705px

>>59218259
>Aesop Rock
noice, had the same idea.

>>59218270
follow the repo - sometime mid next week i'll put a script up that just grabs lyrics of artists automatically.

>>59218259
he was just the available dataset - i'm working on making a script to get rap lyrics given an author - read my response right above this one.

>>59192613
>In this thread I see some people actually using maths and graph theory to write "RAP" songs.
You guys are worst than poo in loos. GO eat your own shit

>>59192613
>2017
>python 2.x

why is this allowed

>>59215760
are you Russian))))

>>59192613
I think assigning songs themes and having the network construct songs pulled from the same themes would be a way to go with this. It's also not really learning in any way, unless you have a way to tell it what good examples it made are so it can attempt to develop itself around that...

Just came to say that Lil B doesn't even claim to be a rapper. His based freestyles are intentionally incoherent. With over 1800 songs, it's going to be difficult to say that everything he puts out is good, but the beats he can flow over are oftentimes not even rap beats. If you take "george clooney" for instance, he's killing some beach boys shit, like wtf.

Even young thug's music doesn't make sense at first, but if you listen to more and more you'll bick up on his slang and see how it all really does make sense.

>>59221776
it is learning - i feed it rap songs which it takes in as "good examples" and with more training, it gets better.