How this workload behaves
Document summarization workloads are input-heavy by nature: the model must ingest large volumes of text (e.g., legal contracts, research papers, or meeting transcripts) before generating concise summaries. Cost is driven primarily by the input token volume, as the summarization task typically requires minimal output tokens relative to input. The context window size matters for handling long documents, but in this case, the 1M token window of Gemini 1.5 Flash is more than sufficient for most summarization tasks, making it a non-factor in cost. The output token cost is secondary but still relevant for tasks requiring multi-paragraph summaries or structured outputs.
Compare against 5 alternatives
| Model | Vendor | Monthly cost | vs primary | Δ |
|---|---|---|---|---|
| Gemini 2.0 Flash | $1.35 | 1.00× | +$0.0000 | |
| Gemini 1.5 Pro | $22.50 | 16.67× | +$21.15 | |
| Mistral Small | Mistral | $3.20 | 2.37× | +$1.85 |
| GPT-4o mini | OpenAI | $2.70 | 2.00× | +$1.35 |
| Claude Haiku 4.5 | Anthropic | $20.00 | 14.81× | +$18.65 |
Recommendation
For document summarization, stick with **Gemini 1.5 Flash** as the primary model. It delivers the lowest cost ($1.35/month) while maintaining strong summarization quality for most use cases. The comparison models either offer no cost advantage (Gemini 2.0 Flash) or are significantly more expensive (e.g., Mistral Small at $3.20, GPT-4o mini at $2.70) without clear quality benefits for this specific task. The 16.67× cost increase of Gemini 1.5 Pro is unjustified unless higher accuracy is absolutely required, which is rare for summarization.
Cost-saving tactics for this workload
- Use **prompt caching** to store the document context in a cache, reducing input token costs for repeated summarizations of the same document.
- Batch multiple summarization requests into a single API call where possible to amortize the fixed costs of the request (e.g., summarize 10 documents in one call instead of 10 separate calls).
- For very long documents, **pre-process the text** to extract key sections or use a smaller model (e.g., Mistral Small) for initial filtering before passing to Gemini 1.5 Flash for summarization.
- Leverage **system prompts** to enforce concise output formats (e.g., bullet points, 3-sentence summaries) to minimize output token usage without sacrificing quality.
- Monitor token usage with **token-level logging** to identify and optimize high-volume summarization tasks (e.g., truncate documents to the most relevant sections).