Skip to main content
AI Productivity
View as Markdown Suggest changes

Strategic Model Selection in Cursor: Balancing Cost and Performance

· Reading time: 4 min
Strategic Model Selection in Cursor: Balancing Cost and Performance

Checking Cursor’s pricing and a leaderboard back and forth is tedious; using “the best” model for everything can lead to surprisingly high bills. A simpler approach uses one stronger model for planning and one cheaper model for execution.

The two-model strategy

Planning (understanding the task and designing steps) benefits from strong reasoning. You send context and get back a plan and a few key decisions; token volume is modest, so the extra cost is often worth it.

Execution (implementing the plan and writing code) can be done well by cheaper models when the plan is clear. This phase uses many more tokens, so keeping cost per token low matters.

You avoid both the “everything on the best model” bill and the “everything on the cheapest” quality hit.

Why it works

Planning is input-heavy (lots of context in, compact plan out); execution is output-heavy (lots of code generated). Arena Code benchmarks show that mid-tier models are close to the top on code tasks at a fraction of the cost. Use strong reasoning where it matters and lower cost where most tokens are spent.

Cost vs performance at a glance

The chart below plots cost (weighted $/1M tokens: 70% input, 30% output) against benchmark performance. Data comes from Cursor’s pricing and public benchmarks; the workflow updates it daily.

Loading chart…

Lower left means cheaper and weaker; upper right means pricier and stronger. Pick a planning model from the upper right and an execution model from the lower half.

Token usage complicates the comparison

The charts above and the recommendations below use price per 1M tokens, but total cost also depends on how many tokens each model uses for the same request. Some models are more verbose or expand the context more aggressively; others stay more compact.

Model usage analysis by model

The figure above shows that request volume and spend are distributed very unevenly across models: “auto” and a few heavily used models dominate total cost even when their list price is modest.

Token usage per request by model

Total tokens per request can differ by orders of magnitude between models for similar tasks. When you experiment with alternative models, watch price per token and Elo alongside response length and context use; that combination is what shows up on your bill.

How the recommendations are selected

The chart shows Pareto frontiers as dashed lines (purple for planning, green for execution).

Mathematical formulation:

Step 1: Minimum performance threshold

Elo1200\text{Elo} \geq 1200

Only models with Arena-Code or LMSYS Arena Elo scores qualify (no BigCodeBench-only models).

Step 2: Category criteria (not mutually exclusive)

Planning:Elo1300Execution:Elo1200Cost$2.5\text{Planning}: \text{Elo} \geq 1300 \quad|\quad \text{Execution}: \text{Elo} \geq 1200 \,\wedge\, \text{Cost} \leq \$2.5

Step 3: Pareto optimality (no dominated models)

Within each category, keep only Pareto-optimal models. A model qualifies only if no other model is both better-performing and cheaper, ensuring you never choose a strictly dominated option:

Pareto-optimal     model B:{EloBEloACostBCostAat least one >\text{Pareto-optimal} \iff \nexists \text{ model } B: \begin{cases} \text{Elo}_B \geq \text{Elo}_A \\ \text{Cost}_B \leq \text{Cost}_A \\ \text{at least one } > \end{cases}

Step 4: Rank by efficiency and select top picks

Efficiency=EloCost per 1M tokens\text{Efficiency} = \frac{\text{Elo}}{\text{Cost per 1M tokens}}

Models are ranked by Elo per dollar. Select 4 models by efficiency per category (or fewer if frontier is smaller).

This keeps strictly dominated models out of the recommendations. The formula runs daily via GitHub Actions.

Example workflow

  1. Start with the planning model. Describe the goal, attach files, ask for a step-by-step plan.
  2. Lock in the plan. Review, maybe one short follow-up, then switch model.
  3. Switch to the execution model. Refer to the plan and implement step by step; do most coding here.
  4. Use the planning model only when needed. For design decisions or subtle bugs, switch back briefly, then return to the cheaper model.

AI Chat

Messages you send are processed by the Google Gemini API to generate responses. Do not share sensitive personal data. See the privacy policy for details.