Groq
Inference API known for low-latency open models.
Key features
- Single platform for infrastructure, inference, and control
- Runs AI inference using its LPU hardware
- LPX works with NVIDIA next-generation GPUs
- Building hundreds of megawatts of inference capacity
- Category
- LLM APIs
- Who it's for
- Developers running AI inference.
- Tags
- apiinferencellm-apiopen-modelsgpu
- Website
- groq.com
- Listed
- 2026-09-15
Sourced notes
Frequently asked questions
What is Groq used for?
Inference API known for low-latency open models. Typical uses: single platform for infrastructure, inference, and control; runs AI inference using its LPU hardware; lPX works with NVIDIA next-generation GPUs.
Related in LLM APIs
See all →- DeepInfra Hosted inference API for open models.
- Fireworks AI Inference platform for open models.
- Together AI Inference and fine-tuning API for open models.
- Amazon Bedrock AWS API for foundation models, including Anthropic and Amazon models.
- Anthropic Console Console and API for Claude models.
- Azure OpenAI OpenAI models hosted on Microsoft Azure.
