llama2-production

Deployed

Llama-2-7B-Chat • aws • us-east-1

Requests

15,234

Avg Latency

124ms

Uptime

99.9%

Cost (24h)

$5.76

Endpoint

https://api.example.com/v1/models/llama2

Live Logs

Connected
1:42:51 AM[INFO]Starting deployment initialization...
1:42:51 AM[INFO]Container image pulled successfully
1:42:51 AM[INFO]Allocating resources: 2048 MB memory
1:42:51 AM[INFO]Starting model server on port 8080
1:42:51 AM[INFO]Model loaded successfully
1:42:51 AM[INFO]Health check passed ✓
1:42:51 AM[INFO]Deployment is now live and accepting requests

Configuration

Memory2048 MB
Provideraws
Regionus-east-1
Createdabout 1 year ago
Deployedabout 1 year ago

Quick Actions