A telegram bot that uses Google's Gemini Pro Vision API , Take a demo here. New Version support prompts along with Images, Add your prompt in Image caption before uploading the Image.
Gemini Pro Vision is a Gemini large language vision model that understands input from text and visual modalities (image and video) in addition to text to generate relevant text responses.
Gemini Pro Vision is a foundation model that performs well at a variety of multimodal tasks such as visual understanding, classification, summarization, and creating content from image and video. It's adept at processing visual and text inputs such as photographs, documents, infographics, and screenshots.
VisionScriptBot uses Google new Gemini Pro Model .
Gemini is Google's latest family of large language models.
You need Google Api key 🔐 for Gemini to run this model. Get your api key from https://makersuite.google.com/app/apikey
Google's Python SDK for the Gemini API, is contained in the google-generativeai package. Install the dependency using pip:
pip install -q -U google-generativeai
for complete guide refer
Deployed on Railway.app , do checkout their free hosting plans here
-
Visual information seeking: Use external knowledge combined with information extracted from the input image or video to answer questions.
-
Object recognition: Answer questions related to fine-grained identification of the objects in images and videos.
-
Digital content understanding: Answer questions and extract information from visual content like infographics, charts, figures, tables, and web pages.
-
Structured content generation: Generate responses based on multimodal inputs in formats like HTML and JSON.
-
Captioning and description: Generate descriptions of images and videos with varying levels of details.
-
Reasoning: Compositionally infer new information without memorization or retrieval.
If You find this project useful, Do support me here