Skip to content
/ aichat Public
forked from sigoden/aichat

Using ChatGPT/GPT-3.5/GPT-4 in the terminal.

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT
Notifications You must be signed in to change notification settings

tvl83/aichat

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AIChat: All-in-one AI CLI Tool

CI Crates Discord

AIChat is an all-in-one AI CLI tool featuring Chat-REPL, Shell Assistant, RAG, Function Calling, AI Agents, and More.

Install

Package Managers

  • Rust Developers: cargo install aichat
  • Homebrew/Linuxbrew Users: brew install aichat
  • Pacman Users: yay -S aichat
  • Windows Scoop Users: scoop install aichat
  • Android Termux Users: pkg install aichat

Pre-built Binaries

Download pre-built binaries for macOS, Linux, and Windows from GitHub Releases, extract them, and add the aichat binary to your $PATH.

Get Started

Upon its first launch after installation, AIChat will guide you through the initialization of the configuration file.

aichat-init-config

You can tailor AIChat to your preferences by editing the configuration file.

The config.example.yaml file provides a comprehensive list of all configuration options with detailed explanations.

Features

20+ Platforms

AIChat offers users a wide and diverse selection of Large Language Models (LLMs):

  • OpenAI: GPT-4/GPT-3.5 (paid, chat, embedding, vision, function-calling)
  • Gemini: Gemini-1.5/Gemini-1.0 (free, paid, chat, embedding, vision, function-calling)
  • Claude: Claude-3.5/Claude-3 (paid, chat, vision, function-calling)
  • Ollama: (free, local, chat, embedding)
  • Groq: Llama-3/Mixtral/Gemma (free, chat, function-calling)
  • Azure-OpenAI: GPT-4/GPT-3.5 (paid, chat, embedding, vision, function-calling)
  • VertexAI: Gemini-1.5/Gemini-1.0 (paid, chat, embedding, vision, function-calling)
  • VertexAI-Claude: Claude-3.5/Claude-3 (paid, chat, vision, function-calling)
  • Bedrock: Llama-3/Claude-3.5/Claude-3/Mistral (paid)
  • Mistral: (paid, chat, embedding)
  • Cohere: Command-R/Command-R+ (paid, chat, embedding, reranker, function-calling)
  • Perplexity: Llama-3/Mixtral (paid)
  • Cloudflare: (free, chat, embedding)
  • OpenRouter: (paid)
  • Replicate: (paid)
  • Ernie: (paid, chat, embedding, reranker, function-calling)
  • Qianwen: Qwen (paid, chat, embedding, vision, function-calling)
  • Moonshot: (paid, chat, function-calling)
  • Deepseek: (paid, chat)
  • ZhipuAI: GLM-4 (paid, chat, embedding, vision, function-calling)
  • LingYiWanWu: Yi-* (paid, chat, vision)
  • Jina: (free, paid, embedding, reranker)
  • VoyageAI: (paid, embedding, reranker)
  • OpenAI-Compatible Platforms

Shell Assistant

Simply input what you want to do in natural language, and aichat will prompt and run the command that achieves your intent.

aichat-execute

AIChat is aware of OS and shell you are using, it will provide shell command for specific system you have.

Role

Customizable roles allow users to tailor the behavior of LLMs, enhancing productivity and ensuring the tool aligns with specific needs and workflows.

aichat-role

Session

By default, AIChat behaves in a one-off request/response manner. With sessions, AIChat conducts context-aware conversations.

aichat-session

RAG

Seamlessly integrates document interactions into your chat experience.

aichat-rag

Function Calling

Function calling supercharges LLMs by connecting them to external tools and data sources. This unlocks a world of possibilities, enabling LLMs to go beyond their core capabilities and tackle a wider range of tasks.

We have created a new repository https://github.com/sigoden/llm-functions to help you make the most of this feature.

Tools

Here's a glimpse of How to use the tools.

aichat-tool

Agents

Agent = Prompt (Role) + Tools (Function Callings) + Knowndge (RAG). It's also known as OpenAI's GPTs.

Here's a glimpse of how to use the agents.

aichat-agent

Local Server

AIChat comes with a built-in lightweight http server.

$ aichat --serve
Chat Completions API: http://127.0.0.1:8000/v1/chat/completions
Embeddings API:       http://127.0.0.1:8000/v1/embeddings
LLM Playground:       http://127.0.0.1:8000/playground
LLM Arena:            http://127.0.0.1:8000/arena?num=2

Proxy LLM APIs

AIChat offers the ability to function as a proxy server for all LLMs. This allows you to interact with different LLMs using the familiar OpenAI API format, simplifying the process of accessing and utilizing these LLMs.

Test with curl:

curl -X POST -H "Content-Type: application/json" -d '{
  "model":"claude:claude-3-opus-20240229",
  "messages":[{"role":"user","content":"hello"}], 
  "stream":true
}' http://127.0.0.1:8000/v1/chat/completions

LLM Playground

The LLM Playground is a webapp that allows you to interact with any LLM supported by AIChat directly in your browser.

aichat-llm-playground

LLM Arena

The LLM Arena is a web-based platform where you can compare different LLMs side-by-side.

aichat-llm-arena

Custom Themes

AIChat supports custom dark and light themes, which highlight response text and code blocks.

aichat-themes

Documents

License

Copyright (c) 2023-2024 aichat-developers.

AIChat is made available under the terms of either the MIT License or the Apache License 2.0, at your option.

See the LICENSE-APACHE and LICENSE-MIT files for license details.

About

Using ChatGPT/GPT-3.5/GPT-4 in the terminal.

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Rust 81.7%
  • HTML 12.7%
  • Shell 4.0%
  • PowerShell 1.1%
  • Nushell 0.5%