Skip to content

Add options to limit history content count included in LLM call #752

@ckl-axel

Description

@ckl-axel

Is your feature request related to a problem? Please describe.
Currently the LLM calls include all history from the session. Please add an option to cap the amount of history by time or count.

Describe the solution you'd like
An option on how much history to include, not just all or nothing.

Describe alternatives you've considered
I think it is possible to modify the history with callbacks but that seems hacky.

Metadata

Metadata

Assignees

Labels

core[Component] This issue is related to the core interface and implementation

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions