GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — GitHub - codeproject/CodeProject.AI-MultiModeLLM

BranchesTags
Open more actions menu

Latest commit

 

History

45 Commits
45 Commits

Folders and files

NameName
Last commit message
Last commit date
.github/ISSUE_TEMPLATE
.github/ISSUE_TEMPLATE
 
 
.vscode
.vscode
 
 
test
test
 
 
.gitignore
.gitignore
 
 
LICENSE
LICENSE
 
 
MultiModeLLM.pyproj
MultiModeLLM.pyproj
 
 
README.md
README.md
 
 
__init__.py
__init__.py
 
 
explore.html
explore.html
 
 
install.bat
install.bat
 
 
install.sh
install.sh
 
 
modulesettings.json
modulesettings.json
 
 
modulesettings.macos.json
modulesettings.macos.json
 
 
multimode_llm.py
multimode_llm.py
 
 
multimode_llm_adapter.py
multimode_llm_adapter.py
 
 
package.bat
package.bat
 
 
package.sh
package.sh
 
 
phiv3.py
phiv3.py
 
 
post_install.bat
post_install.bat
 
 
post_install.sh
post_install.sh
 
 
requirements.cuda11_8.txt
requirements.cuda11_8.txt
 
 
requirements.cuda12.txt
requirements.cuda12.txt
 
 
requirements.macos.arm64.txt
requirements.macos.arm64.txt
 
 
requirements.macos.txt
requirements.macos.txt
 
 
requirements.txt
requirements.txt
 
 
requirements.windows.txt
requirements.windows.txt
 
 

Repository files navigation

Llama LLM Chat Module for CodeProject.AI Server

This is an LLM Chat module using the for CodeProject.AI Server. The actual module itself is downloadable via the CodeProject.AI Server's dashboard.

To develop and debug this code

  1. Clone the main server repo into a directory such as CodeProject/CodeProject.AI-Server

  2. Clone this LlamaChat repo into a separate folder CodeProject/CodeProject.AI-Modules

    You should now have

    CodeProject
      - CodeProject.AI-Server
         - demos
         - src
         - ... etc
      - CodeProject.AI-Modules
         - CodeProject.AI-LlamaChat (this repo)
    
  3. If you have NOT run dev setup on the server Run the server dev setup scripts by opening a terminal in CodeProject.AI-Server/src/ then, for Windows, run setup.bat, or for Linux/macOS run bash setup.sh.
    This will setup the server, and will also setup this module as long as this module sits under a folder named CodeProject.AI-Modules, with CodeProject.AI-Modules being at the same folder level as CodeProject.AI-Server.

    If you have already setup the server You can run the setup for just this module running the setup script from a terminal opened in this folder

    REM For Windows
    ..\..\CodeProject.AI-Server\src\setup.bat
    # For Linux/macOS
    bash ../../CodeProject.AI-Server/src/setup.sh
  4. Open the server repo in Visual Studio Code (or Visual Studio) and build and launch the server (Build and Launch server in the Run and Debug menu in VS Code). This will start the server, which in turn will load the settings file from this module.
    You can start this module directly from the CodeProject.AI Server dashboard, or you can run this module as a separate process via the 'Launch LlamaChat' Debug and Run option in VS Code.

To create a package for this module

Assuming the folder structure outlined above, run

REM For Windows
..\..\CodeProject.AI-Server\devops\build\create_packages.bat
# For Linux/macOS
bash ../../CodeProject.AI-Server/devops/build/create_packages.sh

About

No description, website, or topics provided.

Resources

Readme
License
Activity
Custom properties

Stars

1 star

Watchers

1 watching

Forks

4 forks
Report repository

Releases

Packages

Used by

Contributors

Languages

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.