Skip to content
#

generative-pretrained-transformers

Star

Here is 1 public repository matching this topic...

Language: Python
Filter by language
All 2 Jupyter Notebook 1 Python 1

kanavgoyal898 / echoGPT

Star 0

echoGPT is a minimal GPT implementation for character-level language modeling with 25.4M parameters. Built with PyTorch, it includes multi-head self-attention, feed-forward layers, and position embeddings. Trained on text like tiny_shakespeare.txt to predict the next character.

python natural-language-processing deep-learning transformers pytorch neural-networks scratch-implementation research-implementation generative-pretrained-transformers
  • Updated Jan 11, 2025
  • Python

Improve this page

Add a description, image, and links to the generative-pretrained-transformers topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the generative-pretrained-transformers topic, visit your repo's landing page and select "manage topics."

Learn more