Doing a IT project with caffe. We have to create tasks for students that never worked with neural networks before.
For my Bachelor I will work with M$ new network CNTK. checking out which ways of learning with that toolkit are able to produce the best results with word prediction. I don't know which texts to chose though. There is a bible bot on twitter for example that randomly generates a new verse every few hours. I plan on doing the same thing with my network, just a different topic.
Hunter Rogers
bump
Tyler Kelly
Info on your pic related? Looks interesting and I would like to know more about mofifying raw input
I'd give that a go. If nothing else it will give you a general idea of the field so you know what to google in future.
Bentley Reed
whens waifus?
Jose Gonzalez
The inputs were the simplified level in the top left. Enemies were represented with just a black box. It would have worked better if it used the original screen as the input, but training would have went from 1 day to weeks or months for good results. For some of the objects, they don't even show up. I don't think the balls thrown by the sport things show up in the inputs. The checkpoint doesn't either.
Blake Lopez
Saved your post for later reading when I am bothered to learn machine learning.
Jose Thomas
Hmm
Xavier Fisher
I agree.
Henry Hughes
The ball shows up, it's a black box.
Josiah Wilson
shit thread
Elijah Howard
You are shit
Noah Kelly
How can I update a NN without the backpropogation bullshit?
Juan Nelson
>Without backpropogation Use 1 layer.
Justin Bell
can someone please seed them books
Dominic Cook
You don't update it
Nathaniel Campbell
ok. Like how does an actual brain make and remove connections? I have no idea how to update the weights on these nodes.
Samuel Carter
For every output there's an error, so for each error you go back to each neuron of the previous layer and change the weight according to the learning rate and error. Then you do the same for each previous layer.
Blake Peterson
lad...
Jace Fisher
My knowledge on the matter is pretty superficial and I have no idea what that picture even is, but know error backpropagation is not something that happens biologically. Atleast not in the same way as basic MLPs.
Austin Evans
>>/mlp/
Asher Harris
Isn't that just brute forcing the game?
Jace Diaz
Maybe if you're a retard that doesn't know what "brute forcing" means.
Julian Anderson
It uses an evolutionary algorithm.
Brute forcing would be randomized input and opening a ton of instances or speeding up the game an enormous amount. And then saving the best run
Andrew Taylor
No, but like all university level machine learning projects it's an incredibly slow, inefficient way to achieve a "complete" result from scratch that inevitably winds up with the bot doing stupid shit over and over yet still "winning" because the fitness function is overly simplistic. They aren't brute forcing the game, as in trying every input combination at every frame until they find a path that works, but they ARE brute forcing some pre-programmed mutators. So the generation that favoured moving right failed, lets mutate it with the generation that stood still and jumped so now we have one that just walks right and jumps over and over. Holy crap that made it 25% of the way through. Merge with the one that crouches constantly... 2 mins and no progress, fail, merge with the one that taps Y... 30%... holds Y in spurts, 50%... They usually fervently deny that's what they are doing, but it's just because they've written such incredibly convoluted code that they've confused themselves into thinking they've made some important insight into "machine learning."
Aiden Murphy
Oh, an AI thread, neat. I have nothing to add, but I've always wanted to get into it. Thanks for the links.
Julian Bennett
Not really. It won't decide "let's now jump over and over", it does input based on the blocks around the character, assigns weights to the types of blocks and their relative position.
Christian Lee
this is still simply a more convoluted brute forcing,
Andrew Gomez
I can't find the previous thread right now, so I'll ask it again.
What's your opinion on Expert Systems? I've got to study them for my university AI course, and I'm going to go deep into CLIPS. Is there still room left for improvements in rule-based systems or is everything just >muh deep NN now?
Zachary Harris
>Fun Video
> wasting all this time effort and apparently talent on a fucking video game...
Juan Ward
>thinking it's a colossal effort of genius to make a basic NN It might be, for some people, I guess.
Nicholas Davis
Yes. Also known as evolution
Cameron Gray
How does the NN deal with varying quantities of inputs?
Chase Lopez
It's not, but he specifically said he was researching a scholarly paper and implemented the genetic algorithms himself.
Time, effort, and apparently some talent.
Easton Wilson
>convoluted brute forcing
Sure, just like AlphaGo
Colton Allen
again, maybe for some people. But that's not an uncommon thing, you know.
Juan Reyes
Any teenager can implement an ANN. It's not that hard. Using a game is a fun way to learn it. I learned how to do it with boring shit like malignant/benign mole stats
Tyler Brooks
You can kill usrelf honey! ;^)
Tyler Walker
I'm trying to make an ANN that's more similar to a natual NN. Not like "layers" of neurons that only connect to the next layer, but a large blob of neurons that can be connected in whichever way to each other. I have signal propagation relatively complete, I just don't know how to train the network.
Each grid space is probably an input 0/1 for an enemy, and maybe another grid of 0/1 as a set of inputs for standing positions? There are also techniques to use 0,1,2 for enemy/standing tiles/empty, but from what I've seen it doesn't work as well as discrete inputs unless you do significant normalization or preprocessing.
Starting on thursday we'll start going over some of the learning material relevant to machine learning and try to increase our knowledge and skills together. We'll meet once a week from 5PM PST to 7PM PST.
For this first lesson i'm thinking that a review of linear algebra is in order so i've taken the liberty of finding some videos and books to help us.
If you're interested, you know.
Jason Price
I've got exams coming so i will probably catch up and lurk around later this summer, it would be cool if you can keep a pastebin or something with materials etc.
Charles Green
Yeah i'll start compiling one.
Kayden Lee
MIT OCW has good linear algebra material
Cooper Long
Also for quick math stuff, codecogs.com/latex/eqneditor.php this is good. Default though is transparent bg gif which looks kind of bad, so it's best to change that.
Cooper Hill
Oh btw, forgot to add.
This is going to be on the discord server so that we can all just talk and communicate easily. It'll also give that a reason to exist.
Christopher Gomez
I know that's what I was planning to use.
Alexander Butler
>Do you mean a hopsfield network? That looks somewhat similar to the network I set up. I'll check to see how it gets trained and see if I can apply it to mine.
Michael Cook
Fuck off Seth. Every single person I've shown your videos to points out how annoying your fucking face is for some reason. Within the first 10 minutes.
>Sup Forums fixates on NNs and shits on "university book lernt projects" Typical. NN is just weighted functions, stuffed into a black box called a layer. Come back when you've done something beyond watching some pop sci YouTube vids
David Collins
> using NN for a classification problem > falling for the meme this hard
Nolan Adams
Sadly this is more hill climbing to brute force the level.
I don't understand what the fuck is going on in that video.
Xavier Green
Does that learn how to play the game or just how to beat that level?
Daniel Roberts
Explanation here: tasvideos.org/5076S.html >tl;dr After the initial setup (which takes 01:33.26) the game has been reprogrammed to brute force the final bowser fight by trying every single possible combination of input for 1 frame then 2 frames then 3 frames then 4 frames... The game was reprogrammed to reset state back to start of fight between each try and it will detect when the game is completed and eventually stop.
Gavin Gomez
The hexadecimal you see over sprites is external and is there to help the runner get it setup by exposing the internal state of the game in a visual way. It's left in the video so you can see what's going on. You could play this TAS on an actual console and you wouldn't see that but it would bruteforce the game eventually.
Isaac Barnes
He just wants to make a name for himself.
William Butler
I love linear algebra, so I'll be around here, but not in the discord, sorry. The MIT OCW site for the linear algebra course has problems and solutions and exams and stuff, too.
Christopher Rogers
> I'm trying to make an ANN that's more similar to a natual NN. Not like "layers" of neurons that only connect to the next layer, but a large blob of neurons that can be connected in whichever way to each other. I have signal propagation relatively complete, I just don't know how to train the network.
You can evolve it or apply any other stochastic algorithm (e.g. simulated annealing). It will be slow, but it works.
Brody Mitchell
1) There is still no evidence that there is NO backprop in the brain 2) Backprop is a good optimizer, it shows good results for training deep neural networks. 3) Features learned with backprop are similar to biological features (google scholar it).
Stupid memer.
Nolan Harris
>Is there still room left for improvements in rule-based systems or is everything just >muh deep NN now?
If you can make your expert systems learn then sure, it will be an improvement. No working learning algorithms is a main disadvantage of rule based systems.
Jacob Hughes
All of machine learning is hill climbing
Landon Wood
Evolution generally is brute-forcing. If you have the time to spare, you are basically guaranteed a solution for your fitness function so it's not like it doesn't have it's place in AI
Josiah Lopez
Evolution is actually pretty fast compared to more accurate algorithms, like simplex
Bentley Rivera
Hill climbing as in unnecessary abstractions
Matthew Nelson
That depends on the complexity of the problem. Testing the fitness in time-based scenarios you are capped by the amount of real time it takes to test the system if you're running it in for instance a physics simulation. So testing the inefficiency of flood gate designs is going to take as long as it takes to simulate fluid dynamics for each spawn, for each generation over the lifetime of evolution. There are other ways to solve such problems of course but evolution isn't always fast
Brody Lopez
Bump
Carson Sanders
FUCK YOU I SAID BUMP!
John Long
nice that this thread still lives.
Angel Butler
so what the "solution" was in the end is just jumping and spinning all the time. someone build them a AI developer AI pls
