TorchSharp NanoGpt #1379
GeorgeS2019
started this conversation in
Show and tell
TorchSharp NanoGpt
#1379
Replies: 2 comments 1 reply
-
|
Thank you @GeorgeS2019 ! I can almost feel the AGI now! |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
This is a nicely implemented version of Karpathy's first setup of reproducing GPT, but does not include the updates from GPT-2 such as some of the CUDA performance improvements, the checkmarks, and some minor tweaks to preactivation. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
@travisjj check these: |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
https://github.com/biegehydra/NanoGptDotnet/blob/master/src/NanoGpt/NanoGpt.cs
Beta Was this translation helpful? Give feedback.
All reactions