Please add GPU instances to your services. NN models are fairly baseline approaches today.

I would pay $1 million for this feature

Even small GPUs to speed up inference on local encoders would go a long way

I would use this

Having GPU instances would be very helpful to serve NN models and inferences to our customers.

2024, +1 GPU workload support for NLP pipelines on Render.

2024, waiting for this

Agree this is helpful for any LLM apps because otherwise if you want to use prompt compression then you have to pass it outside of render and then back

Would also love GPU instances and avoid having to go to AWS directly, as we host other services on Render.

Would really love this. My specific need is hosting a pre-existing model for inference workload. I know going to AWS directly is always an option but since I'm hosting my other services here, having my GPU service here would be very convenient.