Show HN: AI Planning for Starcraft(github.com)
github.com
Show HN: AI Planning for Starcraft
https://github.com/primaryobjects/strips#starcraft
6 comments
The problem with this type of planning is that it is not nearly powerful enough to address real problems in Starcraft (except for the given examples) because:
-discreteness: Well, I think it's safe to assume that every starcraft state is discrete (for sure it's binary representation is) but in general you cannot assume it.
- imperfect information: For planning, it's necessary to know or meaningfully guess the state of the enemy and that is not possible due to fog of war. Therefore, everything involving enemy interaction cannot be planned.
- dimensionality: There are so many actions available at each state that you shouldn't even be able to reach a depth of 3 of the planning tree in a reasonable amount of time. For instance, if you have 50 units, you can send each subset of them to attack or move to say 128x128 points on the map, you end up having 2^50 x 16k x 2 possible moves. And that doesn't include build units, build buildings + some more exotic stuff like patrol, set rally points, ...
You can prune some stuff (e.g., never attack with peons after minute 10, never move to or attack your own buildings) but the order of magnitude should stay the same.
So planning is nice but not for continuous problem spaces (real world), problems with imperfect information (every good card game) or problems with a high number of actions (something as "easy and simple" as Go), rendering it IMO not so useful after all.
-discreteness: Well, I think it's safe to assume that every starcraft state is discrete (for sure it's binary representation is) but in general you cannot assume it.
- imperfect information: For planning, it's necessary to know or meaningfully guess the state of the enemy and that is not possible due to fog of war. Therefore, everything involving enemy interaction cannot be planned.
- dimensionality: There are so many actions available at each state that you shouldn't even be able to reach a depth of 3 of the planning tree in a reasonable amount of time. For instance, if you have 50 units, you can send each subset of them to attack or move to say 128x128 points on the map, you end up having 2^50 x 16k x 2 possible moves. And that doesn't include build units, build buildings + some more exotic stuff like patrol, set rally points, ...
You can prune some stuff (e.g., never attack with peons after minute 10, never move to or attack your own buildings) but the order of magnitude should stay the same.
So planning is nice but not for continuous problem spaces (real world), problems with imperfect information (every good card game) or problems with a high number of actions (something as "easy and simple" as Go), rendering it IMO not so useful after all.
Planning is only one of the solutions you need for an RTS AI. Exploring a tech tree and having a ordered list of actions + cost is quite useful. Also, a fast planner can run every turn or more often with updated information and may e.g. output an attack plan with the units needed to eliminate a given enemy structure.
Processing 2^55 moves is not really needed to win a game. At least I believe a human brain uses a different approach. And an AI which wins on average only every second game is just right. Who - honestly - has fun with an unbeatable AI?
Processing 2^55 moves is not really needed to win a game. At least I believe a human brain uses a different approach. And an AI which wins on average only every second game is just right. Who - honestly - has fun with an unbeatable AI?
I agree. Meanwhile, screeps.com is a fairly interesting AI-only RTS. (At the moment it's more of a tower defense kind of game with more to come.)
Yep, I keep thinking that RTS game are the one field where AI assistants would be incredibly valuable.
But talking about AIs in RTS tournament, you may be interested in a tournament of AIs playing starcraft:
http://sscaitournament.com/
They have a live channel with often pretty cool fights.
But talking about AIs in RTS tournament, you may be interested in a tournament of AIs playing starcraft:
http://sscaitournament.com/
They have a live channel with often pretty cool fights.
Well, there was no GUI involved, but such man machine hybrid wars did often occur in MUDs, particularly ones with player killing and guilds. You would often have a set of alts controlled by scripts doing automated tasks like crafting iron from ingredients and selling it in town whereas meanwhile in combat you would have the mud client automatically drink health potions when low on health, auto attack when an enemy player walked in, etc..
I think World of Warcraft had a similar bot getting popular before it was banned.
I think World of Warcraft had a similar bot getting popular before it was banned.
The Iron Realms MUDs have a combat system that's so complex and demanding on reaction time that you can buy (with real world money, from other players) full curing systems that track how fast you can cure things, how close you are to inflicting limb breaks on your opponent and all sorts of other stuff.
Well, it would have to beat a human's micro first.
Remember, it's not just doing predictable actions every time. A lot of it is dancing back and forth and trying to bait your opponent.
So an AI might say "focus firing a stalker is the most efficient" and the human player blinks it away. Then it chooses the next target and the human player blinks that away as well. And so forth until the human player runs out of healthy stalkers and simply walks away with hurt stalkers having done enough damage.
The "correct" solution might have been actually to run past your opponent's army and to surround it spreading the damage. Even when you blink out you're still close to the enemy army because of blink's range.
There could be a mathematical model that predicts whether to run past or to attack or to stutter-step, but humans do this based on experience. AIs are not close to this level of sophistication.
Remember, it's not just doing predictable actions every time. A lot of it is dancing back and forth and trying to bait your opponent.
So an AI might say "focus firing a stalker is the most efficient" and the human player blinks it away. Then it chooses the next target and the human player blinks that away as well. And so forth until the human player runs out of healthy stalkers and simply walks away with hurt stalkers having done enough damage.
The "correct" solution might have been actually to run past your opponent's army and to surround it spreading the damage. Even when you blink out you're still close to the enemy army because of blink's range.
There could be a mathematical model that predicts whether to run past or to attack or to stutter-step, but humans do this based on experience. AIs are not close to this level of sophistication.
I think this is exactly the kind of situation that GP had in mind. A computer would be undoubtedly faster and more accurate concentrating fire on the weakest stalker, but a human is better at deciding whether to attack now or move into position.
So instead of 'attack this unit,' the player could command his units to 'attack the weakest stalker in range.' Or even, 'stutter step along this path, concentrating fire on the weakest anti-air unit.'
So instead of 'attack this unit,' the player could command his units to 'attack the weakest stalker in range.' Or even, 'stutter step along this path, concentrating fire on the weakest anti-air unit.'
In many cases, simply having the higher APM should be enough to win: https://www.youtube.com/watch?v=mrbYd4OFrWE#t=18
Nevermind the fact that while the computer is doing this micro, it is also able to do macro.
Nevermind the fact that while the computer is doing this micro, it is also able to do macro.
yeah, for kiting/splitting a bot can just do this easily
now think what the bot would have to do if it's controlling the banelings KNOWING that the other person is going to control the marines away and it's not as simple
now think what the bot would have to do if it's controlling the banelings KNOWING that the other person is going to control the marines away and it's not as simple
SpringRTS has this. You can write and use lua plugins. To assist you with various small tasks, and add more info to the HUD.
Intro: http://springrts.com/wiki/Lua_Widgets Forum: http://springrts.com/phpbb/viewforum.php?f=23&sid=83343bd3a4... List of plugins: http://widgets.springrts.de/
Intro: http://springrts.com/wiki/Lua_Widgets Forum: http://springrts.com/phpbb/viewforum.php?f=23&sid=83343bd3a4... List of plugins: http://widgets.springrts.de/
Don't forget that the AI already does things like shoot and pursue. Your AI could do other things, but it is not clear exactly what. Starcraft 1 has a lot of micromanagement tricks, for example shooting while moving, that appear to be deficiencies of the game engine. I think there is motivation to view such tedious tasks as limitations or the game engine rather than the AI, unless off course you like that sort of thing!
Don't get me wrong, I find it very cool that people try to popularize STRIPS planning among programmers and that automated planning gets more known. However, please don't say that you can "solve" Starcraft this way.
To get a decent starcraft AI you will need more than the ability to make plans to build battlecruisers: you will need the ability to choose the best plan for the recognized situation, to take decisions under uncertainty and to make compromises between objectives.
To get a decent starcraft AI you will need more than the ability to make plans to build battlecruisers: you will need the ability to choose the best plan for the recognized situation, to take decisions under uncertainty and to make compromises between objectives.
You can plan every single thing. Whats your real problem?
For chess to be called "solved" you would need to have a winning strategy for every winnable position. The same is true for Starcraft.
What this person provides is a (very non-optimal) algorithm to build anything within the tech tree of starcraft, but building is just one part of the game, and the only easily pannifiable one.
What this person provides is a (very non-optimal) algorithm to build anything within the tech tree of starcraft, but building is just one part of the game, and the only easily pannifiable one.
You can plan buildings, training & simple orders (go harvest crystal). You definitely cannot plan all the micro that any fight will involve.
Interesting. Although going over an abstract representation harms the performance in a RTS game. I finally chose Nau's HTN planner to plan entire villages in a few milliseconds. The core in JavaScript fits on one screen page:
https://github.com/agentx-cgn/Hannibal/blob/master/source/si...
https://github.com/agentx-cgn/Hannibal/blob/master/source/si...
I'm very happy that another guy got interested in AI and is backing it up with some code. Keep up the good work! But maybe join a free web AI course if you are really interested in this topic. A* on a decision graph is really an old thing for AI. Sorry to disappoint. It's one of the things you do for homework if you visit an AI course.
Note: This is not only related to Starcraft but planning problems in general. Starcraft is just one of the examples.
usually players build multiple SCVs to speed things up. Is there a reason why there's only one mining?
A few people have made genetic algorithm programs to calculate optimal (in terms of speed) build orders given certain conditions. Here's one I have used: https://code.google.com/p/evolutionchamber/
A genetic algorithm, of course, is much different than using AI to solve the problem, but I think it's an interesting project nonetheless.
A genetic algorithm, of course, is much different than using AI to solve the problem, but I think it's an interesting project nonetheless.
I suspect it has to do with the definition of "Optimal" in this case. It has likely been defined as "least number of steps". It would be cool to see how it would play if the goal was changed to "shortest amount of time".
I looked around a little, but didn't find any StarCraft-equivalent to Advanced Chess[1]. If such a thing doesn't exist, it's a shame. The combination of better strategy and ludicrous APM would completely change gameplay.
1. http://en.wikipedia.org/wiki/Advanced_Chess