https://ankitmaurya.pages.dev/tags/llm/ Recent content in Llm on Ankit Maurya Hugo en Sat, 15 Jun 2024 00:00:00 +0000 https://ankitmaurya.pages.dev/projects/mcp-monitoring/ Sat, 15 Jun 2024 00:00:00 +0000 https://ankitmaurya.pages.dev/projects/mcp-monitoring/ <p>This project is a proxy-based monitoring system for inspecting LLM context during conversations. It provides visibility into what&rsquo;s being sent to and from AI models.</p> <h2 id="features">Features</h2> <ul> <li><strong>Context Inspection</strong>: Monitor all prompts and responses going to LLM APIs</li> <li><strong>Security Logging</strong>: Capture and store interaction data for security analysis</li> <li><strong>Real-time Monitoring</strong>: Live view of active conversations</li> <li><strong>Data Export</strong>: Export conversation logs for analysis</li> </ul> <h2 id="architecture">Architecture</h2> <p>The tool sits as a proxy between your application and the LLM API, intercepting all traffic for inspection.</p>