Text Generation Inference
2024/7/18 13:39:00
『Consuming Text Generation Inference』
2024/7/19 12:00:00
あれ
2024/7/18 14:12:00
podman run --gpus all --shm-size 1g -p 9389:80 -v $PWD/data:/data ghcr.io/huggingface/text-generation-inference:2.1.1 --model-id Qwen/Qwen2-0.5B