This commit is contained in:
2026-02-13 19:24:20 +01:00
parent 56d56395ee
commit 9dc2dff84a
22 changed files with 5897 additions and 528 deletions

119
README.md
View File

@@ -1,13 +1,66 @@
# AI Interview Assistant Chrome Extension
# AI Assistant Chrome Extension
## Overview
The AI Interview Assistant is a Chrome extension designed to help users during interviews or meetings by providing real-time AI-powered responses to questions. It listens to the audio from the current tab, transcribes the speech, identifies questions, and generates concise answers using OpenAI's GPT model.
AI Assistant is a Chrome extension for live meeting/interview support. It captures audio, transcribes speech, and generates concise AI responses with configurable chat and STT providers.
Current extension version: `1.1.0`
<div align="center">
<img src="screenshot.png">
<img src="Screenshot.png" alt="AI Assistant side panel">
</div>
## Screenshots
### Main side panel
<div align="center">
<img src="Screenshot.png" alt="Main side panel">
</div>
### Advanced setup
<div align="center">
<img src="Screenshot-advanced.png" alt="Advanced settings">
</div>
## Table of Contents
- [Documentation Index](#documentation-index)
- [Quick Start (2 Minutes)](#quick-start-2-minutes)
- [Features](#features)
- [Installation](#installation)
- [Usage](#usage)
- [Custom Sessions (Context Profiles)](#custom-sessions-context-profiles)
- [Automation in Side Panel](#automation-in-side-panel)
- [Plans & Roadmap](#plans--roadmap)
- [Recent Improvements](#recent-improvements)
- [Privacy and Security](#privacy-and-security)
- [Troubleshooting](#troubleshooting)
- [Contributing](#contributing)
- [License](#license)
- [Disclaimer](#disclaimer)
## Documentation Index
Use this `README.md` as the main entrypoint. Additional docs:
- Product roadmap and task tracking: `Plans_and_Todo.md`
- AI provider setup/details: `AI_PROVIDERS_GUIDE.md`
- New features and updates: `NEW_FEATURES_GUIDE.md`
- Local self-hosted STT bridge: `local_stt_bridge/LOCAL_STT_BRIDGE_GUIDE.md`
## Quick Start (2 Minutes)
1. Load the extension in `chrome://extensions` (Developer Mode → Load unpacked).
2. Open the side panel and set **AI Provider**, **Model**, and **API key**.
3. In **Assistant Setup**, choose **Speech-to-Text Provider** (`OpenAI`, `Local faster-whisper`, or `Browser`).
4. Configure STT quality controls (`Language Mode`, optional `Forced language`, `Task`, `VAD`, `Beam size`).
5. Use **Test STT Connection** to validate STT endpoint/key.
6. In **Session Context**, pick a profile (or create one in **Context → Manage Profiles**).
7. (Optional) Pick an **Automation Preset**.
8. Click **Start Listening**.
## Features
- Real-time audio capture (tab, mic, or mixed mode)
@@ -15,8 +68,12 @@ The AI Interview Assistant is a Chrome extension designed to help users during i
- AI-powered responses with multiple providers (OpenAI, Anthropic, Google, DeepSeek, Ollama)
- Persistent side panel interface
- Secure API key storage
- Context management (upload or paste documents for better answers)
- Context profiles (prebuilt + custom) with profile-scoped context isolation
- Context management (upload or paste documents per profile)
- Speed mode (faster, shorter responses)
- Automation preset selector in side panel (automatic or one selected automation)
- Separate STT settings (OpenAI Whisper, Browser STT, or local faster-whisper bridge)
- Multilingual STT controls (auto/forced language, task mode, VAD, beam size)
- Multi-device demo mode for remote access
- Overlay controls: drag, resize, minimize, detach, hide/show
- Mic monitor with input device selection and live level meter
@@ -38,21 +95,56 @@ The AI Interview Assistant is a Chrome extension designed to help users during i
4. Click on "Load unpacked" and select the directory containing the extension files.
5. The AI Interview Assistant extension should now appear in your list of installed extensions.
5. The AI Assistant extension should now appear in your list of installed extensions.
## Usage
1. Click on the AI Interview Assistant icon in the Chrome toolbar to open the side panel.
1. Click on the AI Assistant icon in the Chrome toolbar to open the side panel.
2. Enter your OpenAI API key in the provided input field and click "Save API Key".
2. Select your provider/model and save the provider API key.
3. Click "Start Listening" to begin capturing audio from the current tab.
3. In **Assistant Setup**, configure **Speech-to-Text Provider**:
- `OpenAI Whisper` for hosted tab/mixed transcription
- `Local faster-whisper bridge` for self-hosted STT (`local_stt_bridge/LOCAL_STT_BRIDGE_GUIDE.md`)
- `Browser SpeechRecognition` for mic-oriented local recognition
- Tune multilingual/quality options:
- `Language Mode`: `Auto-detect` or `Force language`
- `Forced language`: language code (for example `en`, `fr`, `de`, `ar`)
- `Task`: `Transcribe` or `Translate to English`
- `VAD`: enable/disable silence filtering
- `Beam size`: decoding quality/performance tradeoff (default `5`)
- Click **Test STT Connection** before starting live capture
4. As questions are detected in the audio, they will appear in the "Transcript" section.
4. In **Session Context**, choose a profile (Interview/Standup/Sales or your custom profile).
5. AI-generated responses will appear in the "AI Response" section.
5. (Optional) In **Automation Preset**, choose:
- `Automatic` to run all enabled automations that match each trigger, or
- a single automation to run only that one for session start/end.
6. Click "Stop Listening" to end the audio capture.
6. Click **Start Listening** to begin capturing audio from the current tab.
7. Click **Stop Listening** to end the audio capture.
## Custom Sessions (Context Profiles)
Custom session behavior is configured through **profiles**.
1. Open side panel → **Context****Manage Profiles**.
2. Click **New Profile**.
3. Set:
- Profile name (for example: `Interview (Backend)` or `Meeting (Sales Discovery)`)
- Mode (`interview`, `meeting`, `standup`, or `custom`)
- System prompt (instructions specific to this profile)
4. Click **Save Profile**.
5. Back in **Session**, select that profile in **Session Context** before clicking **Start Listening**.
Each profile uses its own scoped context store to reduce prompt/context leakage between use cases.
## Automation in Side Panel
- Use **Automation Preset** to choose how automations run for the current session.
- Use **Run Selected Automation Now** to manually test from the side panel.
- Use **Advanced Settings (⚙️)** for full automation editing (actions, MCP tools, webhook args, triggers, approval behavior).
## Plans & Roadmap
@@ -76,11 +168,14 @@ The AI Interview Assistant is a Chrome extension designed to help users during i
- Ensure you have granted the necessary permissions for the extension to access tab audio.
- If you're not seeing responses, check that your API key is entered correctly and that you have sufficient credits on your OpenAI account.
- If local STT on a public domain keeps failing with `Invalid HTTP request received`, check protocol mismatch:
- `http://` endpoints on HSTS domains may be auto-upgraded to `https://` by Chrome.
- Use a proper HTTPS reverse proxy in front of the STT service, or use localhost/IP for plain HTTP testing.
- For any issues, please check the Chrome developer console for error messages.
## Contributing
Contributions to the AI Interview Assistant are welcome! Please feel free to submit pull requests or create issues for bugs and feature requests.
Contributions to the AI Assistant are welcome! Please feel free to submit pull requests or create issues for bugs and feature requests.
## License