Skip to content

benryanx/Voice_Assistant_With_Vision

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

Screenshot and Voice Assistant Features

  • Voice Interaction: Speak to the assistant to ask questions or give commands.
  • Screenshot Capture: Press F9 to capture a screenshot, which can be included in conversations for analysis.
  • Text-to-Speech: The assistant reads responses aloud using a Text-to-Speech engine.

Installation

Prerequisites

  • Python 3.8 or later installed on your system.
  • An OpenAI API key. Sign up and get your API key from OpenAI.

Steps

  1. Clone the repository:
    git clone https://github.com/n00gy/Voice_Assistant_With_Vision.git
  2. Navigate to the project folder:
    cd Voice_Assistant_With_Vision
  3. Create a virtual environment (optional but recommended):
    python -m venv venv
    source venv/bin/activate  # On Windows: venv\Scripts\activate
  4. Install the required dependencies:
    pip install -r requirements.txt
  5. Set your OpenAI API key as an environment variable:
    export OPENAI_API_KEY="your_openai_api_key"  # On Windows: set OPENAI_API_KEY=your_openai_api_key

Usage

Run the script:

python main.py

Interacting with the Assistant

  1. Speak into the microphone when prompted.
  2. Press F9 to capture a screenshot. The assistant will analyze the screenshot and include it in the conversation.
  3. Say "exit" or "quit" to stop the program.

Dependencies

The project relies on the following Python libraries:

  • openai – For AI-generated responses.
  • pyttsx3 – For Text-to-Speech conversion.
  • SpeechRecognition – For capturing and processing voice input.
  • keyboard – For detecting keypresses (e.g., F9).
  • Pillow – For capturing and handling screenshots.

Contributing

Contributions are welcome! Feel free to submit issues or pull requests for improvements.

License

This project is licensed under the MIT License. Feel free to use, modify, and distribute it as per the license terms.

Acknowledgments

  • OpenAI for the powerful API.
  • The Python community for the fantastic libraries used in this project.

About

A Python-based Ai voice assistant that listens to commands and captures screenshots

Topics

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages