V2
This commit is contained in:
119
README.md
119
README.md
@@ -1,13 +1,66 @@
|
||||
# AI Interview Assistant Chrome Extension
|
||||
# AI Assistant Chrome Extension
|
||||
|
||||
## Overview
|
||||
|
||||
The AI Interview Assistant is a Chrome extension designed to help users during interviews or meetings by providing real-time AI-powered responses to questions. It listens to the audio from the current tab, transcribes the speech, identifies questions, and generates concise answers using OpenAI's GPT model.
|
||||
AI Assistant is a Chrome extension for live meeting/interview support. It captures audio, transcribes speech, and generates concise AI responses with configurable chat and STT providers.
|
||||
|
||||
Current extension version: `1.1.0`
|
||||
|
||||
<div align="center">
|
||||
<img src="screenshot.png">
|
||||
<img src="Screenshot.png" alt="AI Assistant side panel">
|
||||
</div>
|
||||
|
||||
## Screenshots
|
||||
|
||||
### Main side panel
|
||||
|
||||
<div align="center">
|
||||
<img src="Screenshot.png" alt="Main side panel">
|
||||
</div>
|
||||
|
||||
### Advanced setup
|
||||
|
||||
<div align="center">
|
||||
<img src="Screenshot-advanced.png" alt="Advanced settings">
|
||||
</div>
|
||||
|
||||
## Table of Contents
|
||||
|
||||
- [Documentation Index](#documentation-index)
|
||||
- [Quick Start (2 Minutes)](#quick-start-2-minutes)
|
||||
- [Features](#features)
|
||||
- [Installation](#installation)
|
||||
- [Usage](#usage)
|
||||
- [Custom Sessions (Context Profiles)](#custom-sessions-context-profiles)
|
||||
- [Automation in Side Panel](#automation-in-side-panel)
|
||||
- [Plans & Roadmap](#plans--roadmap)
|
||||
- [Recent Improvements](#recent-improvements)
|
||||
- [Privacy and Security](#privacy-and-security)
|
||||
- [Troubleshooting](#troubleshooting)
|
||||
- [Contributing](#contributing)
|
||||
- [License](#license)
|
||||
- [Disclaimer](#disclaimer)
|
||||
|
||||
## Documentation Index
|
||||
|
||||
Use this `README.md` as the main entrypoint. Additional docs:
|
||||
|
||||
- Product roadmap and task tracking: `Plans_and_Todo.md`
|
||||
- AI provider setup/details: `AI_PROVIDERS_GUIDE.md`
|
||||
- New features and updates: `NEW_FEATURES_GUIDE.md`
|
||||
- Local self-hosted STT bridge: `local_stt_bridge/LOCAL_STT_BRIDGE_GUIDE.md`
|
||||
|
||||
## Quick Start (2 Minutes)
|
||||
|
||||
1. Load the extension in `chrome://extensions` (Developer Mode → Load unpacked).
|
||||
2. Open the side panel and set **AI Provider**, **Model**, and **API key**.
|
||||
3. In **Assistant Setup**, choose **Speech-to-Text Provider** (`OpenAI`, `Local faster-whisper`, or `Browser`).
|
||||
4. Configure STT quality controls (`Language Mode`, optional `Forced language`, `Task`, `VAD`, `Beam size`).
|
||||
5. Use **Test STT Connection** to validate STT endpoint/key.
|
||||
6. In **Session Context**, pick a profile (or create one in **Context → Manage Profiles**).
|
||||
7. (Optional) Pick an **Automation Preset**.
|
||||
8. Click **Start Listening**.
|
||||
|
||||
## Features
|
||||
|
||||
- Real-time audio capture (tab, mic, or mixed mode)
|
||||
@@ -15,8 +68,12 @@ The AI Interview Assistant is a Chrome extension designed to help users during i
|
||||
- AI-powered responses with multiple providers (OpenAI, Anthropic, Google, DeepSeek, Ollama)
|
||||
- Persistent side panel interface
|
||||
- Secure API key storage
|
||||
- Context management (upload or paste documents for better answers)
|
||||
- Context profiles (prebuilt + custom) with profile-scoped context isolation
|
||||
- Context management (upload or paste documents per profile)
|
||||
- Speed mode (faster, shorter responses)
|
||||
- Automation preset selector in side panel (automatic or one selected automation)
|
||||
- Separate STT settings (OpenAI Whisper, Browser STT, or local faster-whisper bridge)
|
||||
- Multilingual STT controls (auto/forced language, task mode, VAD, beam size)
|
||||
- Multi-device demo mode for remote access
|
||||
- Overlay controls: drag, resize, minimize, detach, hide/show
|
||||
- Mic monitor with input device selection and live level meter
|
||||
@@ -38,21 +95,56 @@ The AI Interview Assistant is a Chrome extension designed to help users during i
|
||||
|
||||
4. Click on "Load unpacked" and select the directory containing the extension files.
|
||||
|
||||
5. The AI Interview Assistant extension should now appear in your list of installed extensions.
|
||||
5. The AI Assistant extension should now appear in your list of installed extensions.
|
||||
|
||||
## Usage
|
||||
|
||||
1. Click on the AI Interview Assistant icon in the Chrome toolbar to open the side panel.
|
||||
1. Click on the AI Assistant icon in the Chrome toolbar to open the side panel.
|
||||
|
||||
2. Enter your OpenAI API key in the provided input field and click "Save API Key".
|
||||
2. Select your provider/model and save the provider API key.
|
||||
|
||||
3. Click "Start Listening" to begin capturing audio from the current tab.
|
||||
3. In **Assistant Setup**, configure **Speech-to-Text Provider**:
|
||||
- `OpenAI Whisper` for hosted tab/mixed transcription
|
||||
- `Local faster-whisper bridge` for self-hosted STT (`local_stt_bridge/LOCAL_STT_BRIDGE_GUIDE.md`)
|
||||
- `Browser SpeechRecognition` for mic-oriented local recognition
|
||||
- Tune multilingual/quality options:
|
||||
- `Language Mode`: `Auto-detect` or `Force language`
|
||||
- `Forced language`: language code (for example `en`, `fr`, `de`, `ar`)
|
||||
- `Task`: `Transcribe` or `Translate to English`
|
||||
- `VAD`: enable/disable silence filtering
|
||||
- `Beam size`: decoding quality/performance tradeoff (default `5`)
|
||||
- Click **Test STT Connection** before starting live capture
|
||||
|
||||
4. As questions are detected in the audio, they will appear in the "Transcript" section.
|
||||
4. In **Session Context**, choose a profile (Interview/Standup/Sales or your custom profile).
|
||||
|
||||
5. AI-generated responses will appear in the "AI Response" section.
|
||||
5. (Optional) In **Automation Preset**, choose:
|
||||
- `Automatic` to run all enabled automations that match each trigger, or
|
||||
- a single automation to run only that one for session start/end.
|
||||
|
||||
6. Click "Stop Listening" to end the audio capture.
|
||||
6. Click **Start Listening** to begin capturing audio from the current tab.
|
||||
|
||||
7. Click **Stop Listening** to end the audio capture.
|
||||
|
||||
## Custom Sessions (Context Profiles)
|
||||
|
||||
Custom session behavior is configured through **profiles**.
|
||||
|
||||
1. Open side panel → **Context** → **Manage Profiles**.
|
||||
2. Click **New Profile**.
|
||||
3. Set:
|
||||
- Profile name (for example: `Interview (Backend)` or `Meeting (Sales Discovery)`)
|
||||
- Mode (`interview`, `meeting`, `standup`, or `custom`)
|
||||
- System prompt (instructions specific to this profile)
|
||||
4. Click **Save Profile**.
|
||||
5. Back in **Session**, select that profile in **Session Context** before clicking **Start Listening**.
|
||||
|
||||
Each profile uses its own scoped context store to reduce prompt/context leakage between use cases.
|
||||
|
||||
## Automation in Side Panel
|
||||
|
||||
- Use **Automation Preset** to choose how automations run for the current session.
|
||||
- Use **Run Selected Automation Now** to manually test from the side panel.
|
||||
- Use **Advanced Settings (⚙️)** for full automation editing (actions, MCP tools, webhook args, triggers, approval behavior).
|
||||
|
||||
## Plans & Roadmap
|
||||
|
||||
@@ -76,11 +168,14 @@ The AI Interview Assistant is a Chrome extension designed to help users during i
|
||||
|
||||
- Ensure you have granted the necessary permissions for the extension to access tab audio.
|
||||
- If you're not seeing responses, check that your API key is entered correctly and that you have sufficient credits on your OpenAI account.
|
||||
- If local STT on a public domain keeps failing with `Invalid HTTP request received`, check protocol mismatch:
|
||||
- `http://` endpoints on HSTS domains may be auto-upgraded to `https://` by Chrome.
|
||||
- Use a proper HTTPS reverse proxy in front of the STT service, or use localhost/IP for plain HTTP testing.
|
||||
- For any issues, please check the Chrome developer console for error messages.
|
||||
|
||||
## Contributing
|
||||
|
||||
Contributions to the AI Interview Assistant are welcome! Please feel free to submit pull requests or create issues for bugs and feature requests.
|
||||
Contributions to the AI Assistant are welcome! Please feel free to submit pull requests or create issues for bugs and feature requests.
|
||||
|
||||
## License
|
||||
|
||||
|
||||
Reference in New Issue
Block a user