Spaces:
Running
Running
Commit History
-
feat: Enhance metrics collection and turn tracing for assistant responses
- Added new attributes in `PendingUserUtterance` and `TraceTurn` to track assistant response states and recovery from false turns. - Updated `MetricsCollector` to handle reopening user utterances and managing superseded speech IDs, improving the accuracy of conversation tracking. - Enhanced `TurnTracer` to support recovery of pre-response turns and ignore stale events, ensuring more reliable turn management. - Expanded unit tests to validate the new features and ensure proper functionality of the updated metrics and tracing mechanisms.cd02c6a -
feat: Enhance metrics collection and tracing for assistant text
- Introduced new methods in `MetricsCollector` for handling streamed assistant text, including delta submissions and flush observations. - Updated `TurnTracer` to support new flags and methods for tracking streamed assistant text and its correlation with conversation items. - Added new data classes `PendingAssistantItemRecord` and `PendingUnscopedStreamRecord` to manage assistant items and unscoped streamed text. - Enhanced session handling to install tracing for text output when metrics collector attributes are present. - Expanded unit tests to validate the new features and ensure proper functionality of the updated metrics and tracing mechanisms.a524a82 -
feat: Enhance metrics collection and assistant item correlation
- Added support for correlating conversation items with speech items in the `MetricsCollector`, allowing for improved tracking of assistant responses. - Introduced new data classes `AssistantItemSpeechBinding` and `PendingAssistantItemEvent` to manage the relationship between chat items and speech IDs. - Updated methods in `MetricsCollector` to handle the new item correlation logic, including adjustments to item addition and speech handling. - Enhanced `TurnTracer` to support new flags for tracking speech completion and assistant text observations. - Added unit tests to validate the new correlation features and ensure proper functionality of the updated metrics collection mechanisms.6549fd6
-
codex fixex
7fdafe4 -
feat: Enhance voice activity detection and turn tracing features
- Updated VAD parameters in `.env.example` for improved responsiveness and accuracy, including adjustments to `VAD_MIN_SILENCE_DURATION`, `VAD_THRESHOLD`, and endpointing delays. - Introduced a new `PendingUserUtterance` class in `metrics_collector.py` to manage user utterances more effectively, allowing for better tracking of speech-to-text transitions. - Refactored `TurnTracer` to support coalescing of user transcripts, enabling the merging of immediate continuations into prior turns for a more seamless conversation flow. - Updated settings in `settings.py` to reflect new defaults for voice processing and turn detection. - Enhanced tests to validate the new features and ensure proper functionality of the updated VAD and turn tracing mechanisms.4a03ace
-
feat: Add Deepgram STT provider support and enhance configuration options
- Introduced Deepgram as a new STT provider in `STTSettings`, including settings for model ID and language. - Updated `.env.example` and `README.md` to document the new Deepgram STT settings and their usage. - Enhanced the assistant's configuration summary to include details for the Deepgram STT provider. - Refactored the STT factory to support initialization of Deepgram STT engines, with appropriate logging for configuration. - Added tests to validate the integration of Deepgram STT and ensure proper handling of settings across different scenarios.c394e23 -
feat: Add support for Deepgram TTS provider and related configurations
- Introduced `TTS_PROVIDER` and `DEEPGRAM_API_KEY` settings in `VoiceSettings` to support Deepgram as a TTS option. - Updated `.env.example` to document the new TTS provider settings and their usage. - Refactored the assistant's configuration summary to include details for the selected TTS provider. - Enhanced session management to utilize the new TTS factory for creating TTS engines. - Added tests to validate the integration of Deepgram and ensure proper handling of TTS settings.9b5c112 -
feat: Introduce MCP startup greeting timeout and PocketTTS connection timeout settings
- Added `MCP_STARTUP_GREETING_TIMEOUT_SEC` to `LLMSettings` and `VoiceSettings` for controlling the startup greeting interruption behavior. - Introduced `POCKET_TTS_CONN_TIMEOUT_SEC` to define the timeout for PocketTTS synthesis attempts. - Updated `.env.example` and `README.md` to document the new timeout settings and their intended usage. - Refactored session management to utilize the new timeout settings for improved control over greeting and TTS behavior. - Enhanced tests to validate the new timeout configurations and ensure proper functionality.62404fa -
feat: Enhance LiveKit worker configuration and documentation
- Added `LIVEKIT_INITIALIZE_PROCESS_TIMEOUT_SEC` to `.env.example` and `LiveKitSettings` for configuring idle worker bootstrap timeout. - Updated `README.md` to document the new timeout setting and its intended usage. - Refactored server initialization in `session.py` to incorporate the new timeout setting. - Enhanced tests to validate the new LiveKit settings and ensure proper initialization behavior.60ef510 -
refactor: Consolidate LLM runtime configuration using LLMSettings
- Refactored the LLM runtime initialization to utilize a single LLMSettings object, simplifying parameter management. - Updated the assistant instructions to promote concise responses and clarify tool usage. - Enhanced test cases to validate the new LLMSettings integration and ensure proper functionality across different scenarios.1641cad -
feat: Add support for extra MCP server URLs and enhance assistant instructions
- Introduced to allow configuration of additional MCP servers in and settings. - Updated to document the new configuration option and its usage. - Enhanced the assistant's instructions to include a summary of the current configuration, improving user awareness of the system setup. - Implemented a new function to resolve and deduplicate MCP server URLs. - Added tests to validate the new functionality and ensure proper handling of MCP server configurations.6febd52 -
feat: Enhance assistant instructions and footer display for LLM providers
- Updated assistant instructions to include the current date and clarify capabilities and limitations. - Modified footer display in the Streamlit app to show LLM provider names alongside their models for better user clarity. - Added tests to ensure the new assistant instructions and footer display functionality work as intended.a24d5f0 -
feat: Update LLM and PocketTTS connection options in session management
- Added a new method to build connection options for LLM and PocketTTS requests, consolidating timeout and retry settings. - Updated README.md to reflect changes in connection behavior for both LLM and PocketTTS. - Enhanced .env.example with a comment clarifying shared API timeout/retry tuning parameters.3344a84
-
feat: Introduce turn pipeline summary and enhance tool execution metrics
- Added a new method to publish a detailed turn pipeline summary, including phases and tool execution metrics.0a97994
-
feat: Enhance metrics collection with event timestamps for assistant interactions
- Added event_created_at and item_created_at parameters to track timestamps for conversation items in MetricsCollector. - Updated _on_assistant_text and related methods to utilize these timestamps for improved tracing accuracy. - Refactored text extraction logic to return both the latest assistant text and its creation timestamp. - Introduced tests to validate the handling of delayed pre-tool assistant events and their timestamps.758164b -
feat: Enhance assistant behavior and tool feedback mechanisms
- Updated assistant instructions to prevent tool calls for self-description requests. - Introduced allowed_tool_names parameter to control tool usage in pre-tool feedback. - Enhanced MetricsCollector and TurnTracer to support tool step announcements and error handling. - Added tests to validate new assistant instructions and tool feedback behavior.c13fca7
-
feat: Add post-tool response timeout and enhance error handling in channel metrics
d0f8e17 -
refactor: Restructure agent components and remove unused files
- Updated directory structure in README to reflect new organization of agent components. - Refactored imports in to align with new module paths. - Removed obsolete files related to channel metrics, turn tracing, metrics collection, LLM runtime, STT factory, and tool feedback, streamlining the codebase. - Enhanced clarity and maintainability by consolidating related functionalities into dedicated directories.a1d8504