Neural network AI

Discussion in 'Backers Lounge (Read-only)' started by Daddie, January 11, 2013.

  1. Daddie

    Daddie Member

    Messages:
    275
    Likes Received:
    21
    Hell yeah!!! :mrgreen: :mrgreen:

    Finally a game which learns!!

    edit: question already answered in the vid :mrgreen:
    Last edited: January 11, 2013
  2. BulletMagnet

    BulletMagnet Post Master General

    Messages:
    3,263
    Likes Received:
    591
    I... uhhh... how much attention were you paying to that video?
  3. Daddie

    Daddie Member

    Messages:
    275
    Likes Received:
    21
    Well.. I made this topic while watching the video ;)
  4. BulletMagnet

    BulletMagnet Post Master General

    Messages:
    3,263
    Likes Received:
    591
    lol. Carry on then.
  5. Daddie

    Daddie Member

    Messages:
    275
    Likes Received:
    21
    Yeah.. changed the topic start.. I still am very hyped on this feature :!:
  6. lafncow

    lafncow Active Member

    Messages:
    153
    Likes Received:
    103
    I loved the detail they went into here, you guys rock. @sorian - any time you want to post more nerdy about how the AI learns, I know I'd love to read it!
    Thanks!
  7. drtomb

    drtomb Member

    Messages:
    108
    Likes Received:
    17
    The AI learns alright... but not vs player. Imagine the ridiculous flow of data Sorian would have to deal with, not to mention the endless number of profiles.
  8. Daddie

    Daddie Member

    Messages:
    275
    Likes Received:
    21
    I am sure Sorian doesnt deal with the data but the neural net :mrgreen:
  9. garatgh

    garatgh Active Member

    Messages:
    805
    Likes Received:
    34
    You got it wrong.

    The neural net learns thats true, but it wont learn when playing against you or any other player. He will "teach" the neural net how to play before release (mainly by AI playing against AI doing random things until it figure out whats more and less effective).

    The AI we will run into in the end is set, it dosent evolve further on itself after release (They would have to patch it to improve it).

    (but it might change its tactics and such if units change in patches, since the neural net bases its decisions on the unit stats.)
  10. dukyduke

    dukyduke Active Member

    Messages:
    167
    Likes Received:
    40
    Yes, it is exactly the way that things are presented in the video but they also said that may be the AI will learn during the party.

    As nothing is done for the moment, it can be or not...
  11. Pawz

    Pawz Active Member

    Messages:
    951
    Likes Received:
    161
    I've always wondered how useful it would be for the AI to collate the data it makes while it plays against you, and then uploads that data to a grand central server to be merged into the main... Theoretically analyzing tactics that work well against human players and incorporating them into a better and better AI over time...

    Would be cool, but obviously the practical implementations may be a bit difficult :)
  12. Sorian

    Sorian Official PA

    Messages:
    998
    Likes Received:
    3,844
    I looked into the possibility of having the AI learn in the field for Supreme Commander 2. In that case the problem boiled down to making sure all players had the same set of neural net data.

    Once things solidify more for the PA AI I will look at this option again.
    lokiCML likes this.
  13. Sorian

    Sorian Official PA

    Messages:
    998
    Likes Received:
    3,844
    I made a post that went over my GDC 2012 talk about neural networks on my blog here: http://soriandev.blogspot.com/2012/03/gdc-2012.html

    You can watch my GDC presentation here (no GDC vault membership required): http://www.gdcvault.com/play/1015667/Of ... n-Path-Non

    Just click "Neural Networks in Supreme Commander 2 - Mike Robbins" from the list on the left side (you will have to scroll down to find it). I also end up getting most of the questions during the Q&A session at the end of the session (just scroll down to the end).
  14. baryon

    baryon Active Member

    Messages:
    156
    Likes Received:
    40
    just watched the gdc presentation.
    pretty interesting!
    perhaps this topic could be moved to the general discussion forum, since it may be interesting to non-backers to and also doesn't contain anything backer-exclusive information.
  15. garatgh

    garatgh Active Member

    Messages:
    805
    Likes Received:
    34
    It would be AWESOME if the AI continues to learn after release. :shock: *Holds thumbs*
  16. Sorian

    Sorian Official PA

    Messages:
    998
    Likes Received:
    3,844
    Is that like crossing your fingers?
  17. Daddie

    Daddie Member

    Messages:
    275
    Likes Received:
    21
    Well.. I do think the AI should learn a bit while the game is released. But more to prevent a situation where you can always beat the AI by doing a certain trick (eg a trick where the AI always makes a mistake). For example: you can always win against an AI using a certain plane, flying around his base and attack him from behind. The AI should recognize its mistake and take measures against it.
  18. garatgh

    garatgh Active Member

    Messages:
    805
    Likes Received:
    34
    Yes, basicly "hoping it happens/wishing for it".
  19. doud

    doud Well-Known Member

    Messages:
    922
    Likes Received:
    568
    I remember there was a game called "Conflict Zone" and developped by a company (MASA) specialized in AI. The AI was based on neural network and it was learning and improving itself after each game. This way you could not use the same strategy during next game because if so, then AI was smart enough not to fall into the same trap.

    it's an old game and probably AI was not so sofisticated. However having the feeling that AI was learning from its mistakes was really fun.
  20. nightnord

    nightnord New Member

    Messages:
    382
    Likes Received:
    0
    Isn't it much easier with PA, as it has client-server model? I mean - you don't need to actually automatically share learning information between servers and there is no enemy-AI computations on client side, isn't it?

    (This will also lead to servers split into some kind of "PvE/PvP" groups, which is also good)

Share This Page