Implementation of GPT-2 in pure CMake

(github.com)

23 points | by porridgeraisin 3 hours ago

6 comments

  • ahartmetz 1 hour ago
    FWIW, this is most likely not even fast enough to laugh at how slow it is - for that, you need to see something happening in less than an hour or so.

    It can only use one core at a time, but that is not the worst thing: CMake is interpreted and stringly typed, so every number will have to be converted string -> number and usually back on every use.

    • voxelghost 1 hour ago
      We just need to find a way to extend Moores law into the 4th dimension, and hardware will catch up to this.
      • ahartmetz 44 minutes ago
        Btw, I just realized that "cannot use all cores" has become a similar performance handicap to "is interpreted". So many cores now!
  • paaloeye 30 minutes ago
  • _menelaus 13 minutes ago
    AI is gonna keep us around because it would never think to do this kinda stuff
  • paaloeye 31 minutes ago
    Somebody has more time than sense
  • sirsinsalot 46 minutes ago
    A hellscape.
  • pkilgore 36 minutes ago
    disgusting (complementary)