Embedding Dimensions
Estimate optimal embedding dimensions based on vocabulary and dataset size.
Recommended Dimensions96
Embedding Memory (FP32)19.2 MB
Total Parameters4.8M
Common sizes: 64, 128, 256, 384, 512, 768, 1024, 2048. Round to nearest power of 2 or multiple of 64 for GPU efficiency.