Criterion GroqCloud Together AI
CategoryInference & Model HostingInference & Model Hosting
In one sentenceLow-latency inference API for open models running on Groq's LPU hardware.Cloud platform for running, fine-tuning and training open models on serverless APIs or rented GPUs.
Problem it solvesGetting fast responses from open models for real-time apps without hosting them.Running open models in production without buying and operating your own GPUs.
Free planYesNo
Developer APIYes — docsYes — docs
Open sourceNoNo
PlatformsWeb (Groq console), REST APIWeb, REST API
Pricing (summary)Free plan with rate limits, then usage-based pricing per 1M tokens on the Developer plan. For example, openai/gpt-oss-120b is $0.15 input / $0.60 output and gpt-oss-20b $0.075 / $0.30; some models are contact-sales.
Checked 2026-10-19		Usage-based. Serverless models are billed per 1M tokens (for example gpt-oss-120B $0.15 / $0.60, Kimi K3 $3 / $15). Dedicated endpoints and GPU clusters are billed per GPU-hour, and fine-tuning per 1M training tokens with minimum charges.
Checked 2026-10-19
Strengths
  • Speed-focused hardware
  • Free entry point
  • Simple per-token prices for gpt-oss models
  • Broad open-model catalogue
  • Transparent GPU-hour pricing
  • Inference, fine-tuning and training in one place
Limitations
  • Several models list pricing as 'Contact Sales'
  • Free-plan limits not published in docs
  • Preview models may be discontinued at short notice
  • Free credit amount is not stated on the pricing page
  • Some hardware is contact-sales only
  • Pricing page shows two fine-tuning tables without explaining which applies