#Angband list of items Patch#

Design the bot as choosing randomly among a variety of 'elementary behaviors'. What you could try would be trying to do it at the 'meta' level. coming up the stairs on level 1, or deliberately falling in traps to reach Gehennom). Some of those 'almost bad' actions are required to win the game (e.g. There are very few actions which are always a bad idea most are also life-savers in the 'right' situation (an extreme example is eating a cockatrice: that's bad, unless you are starving and currently polymorphed into a stone-resistant monster, in which case eating the cockatrice is the right thing to do). I doubt bayesian analysis will get you far because most of NetHack is highly contextual. That is you need to be able to define the states that the bot is trying to get to, otherwise it will just continue forever. The one catch is that you do need to be able to define rewards to provide as the positive 'reinforcement'. The wikipedia article is pretty jargon heavy but this tutorial does a much better job translating the concepts into real world examples. But notice that you do get to keep track of some state so that your bot doesn't just keep trying to make a left term into a wall over and over again. Even a simpler model of where every piece is on the board is still a very large state space so you have to find a way to simplify what you keep track of. To put that in more concrete terms, if you were to build a chess bot you would probably have trouble if you tried to create a decision policy that made decisions based on all previous moves since the set of all possible combinations of chess moves grows really quickly. The trick then is maintain just enough state that helps the bot make good decisions without having a distinct point in your state 'space' for every possible combination of previous actions. It does this trying to figure out what the optimal action is at each state in the environment (where each state can include as many variables as needed, much more than just 'where am i'). Reinforcement learning is a type of online unsupervised learning that does really well in situations that can be modeled as an agent interacting with an environment, like a game (or robots). Most of the examples you'll find are usually just simple games anyway (like learning to navigate a map while avoiding walls, traps, monsters, etc). I would suggest looking into using q-learning instead. I would say for even the simplest games, this is a very inefficient way to go about learning the game. So each time you have to move, perform an action, etc, its completely independent of anything else you've done so far. That can work if you know specific cases to look for but in general, in a game environment, it means that you can't generally remember anything. Now one way people sometimes get around the independence assumption is to define variables that are technically combinations of things (like searching for the token 'buy viagra'). The interesting thing is that this assumption is quite obviously false when it comes to natural language but still manages to produce reasonable results. So for instance, in spam filtering each word is usually treated as a variable so this means assuming that if the email contains the word 'viagra', that knowledge does affect the probability that it will also contain the word 'medicine' (or 'foo' or 'spam' or anything else). It's still in a pretty primitive state but if anyone's interested.Īlthough Bayesian analysis encompasses much more, the Naive Bayes algorithm well known from spam filters is based on one very fundamental assumption: all variables are essentially independent of each other.

#Angband list of items Patch#

Over time it seems like you could generate a reasonably playable model.Ĭan anyone point us in the right direction of what a good start would be? Am I barking up the wrong tree or misunderstanding the idea of bayesian analysis?Įdit: My friend put up a github repo of his NetHack patch that allows python bindings. Recently I suggested using some kind of naive bayesian analysis, in very much the same way spam is created.īasically the bot would at first build a corpus, by trying every possible action with every item or creature it finds and storing that information with, for instance, how close to a death, injury of negative effect it was. In NetHack, the problem is much more difficult, because the game rewards ballsy experimentation and is built basically as 1,000 edge cases. There is a very good working bot for the similar game Angband, but it works partially because of the ease in going back to the town and always being able to scum low levels to gain items. A friend of mine is beginning to build a NetHack bot (a bot that plays the Roguelike game: NetHack).