A server that manages context for LLM interactions, storing and providing relevant context for each user.
- In-memory storage of user contexts
- Context management with last 5 prompts
- RESTful API endpoints
- TypeScript support
-
Install dependencies:
npm install
-
Start the development server:
npm run dev
Add a new prompt to user's context and get updated context.
Request body:
{
"prompt": "Your prompt here"
}Response:
{
"context": "Combined context from last 5 prompts"
}Get current context for a user.
Response:
{
"context": "Current context"
}Clear context for a user.
Response:
{
"message": "Context cleared"
}npm run dev: Start development server with hot reloadnpm run build: Build TypeScript filesnpm start: Run built files