# Welcome to the FOSAI Nexus!
**(v0.0.1 - Summer 2023 Edition)**
The goal of this knowledge nexus is to act as a link hub for software, applications, tools, and projects that are all FOSS (free open-source software) designed for AI (FOSAI).
If you haven't already, I recommend bookmarking this page ([the native one on lemmy.world](https://lemmy.world/post/814816)). It is designed to be periodically updated in new versions I release throughout the year. This is due to the rapid rate in which this field is advancing. Breakthroughs are happening weekly. I will try to keep up through the seasons while including links to each sequential nexus post - but it's best to bookmark this since it will be the start of the content series, giving you access to all future nexus posts as I release them.
If you see something here missing that should be added, let me know. I don't have visibility over everything. I would love your help making this nexus better. Like I said in my [welcome message](https://lemmy.world/post/67758), I am no expert in this field, but I teach myself what I can to distill it in ways I find interesting to share with others.
I hope this helps you unblock your workflow or project and empowers you to explore the wonders of emerging artificial intelligence.
Consider subscribing to [/c/FOSAI](https://lemmy.world/c/fosai) if you found any of this interesting. I do my best to make sure you stay in the know with the most important updates to all things free open-source AI.
[Find Us On Lemmy!](https://lemmy.world/c/fosai)
[!fosai@lemmy.world](https://lemmy.world/c/fosai)
---
## Fediverse Resources
**Lemmy**
- [Your Lemmy Crash Course to Free Open-Source AI](https://lemmy.world/post/76020)
- [!auai@programming.dev](https://programming.dev/c/auai)
---
## Large Language Model Hub
[Download Models](https://huggingface.co/TheBloke)
### [oobabooga](https://github.com/oobabooga/text-generation-webui)
text-generation-webui - a big community favorite gradio web UI by oobabooga designed for running almost any free open-source and large language models downloaded off of [HuggingFace](https://huggingface.co/TheBloke) which can be (but not limited to) models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and many others. Its goal is to become the [AUTOMATIC1111/stable-diffusion-webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui) of text generation. It is highly compatible with many formats.
### [Exllama](https://github.com/turboderp/exllama)
A standalone Python/C++/CUDA implementation of Llama for use with 4-bit GPTQ weights, designed to be fast and memory-efficient on modern GPUs.
### [gpt4all](https://github.com/nomic-ai/gpt4all)
Open-source assistant-style large language models that run locally on your CPU. GPT4All is an ecosystem to train and deploy powerful and customized large language models that run locally on consumer-grade processors.
### [TavernAI](https://github.com/TavernAI/TavernAI)
The original branch of software SillyTavern was forked from. This chat interface offers very similar functionalities but has less cross-client compatibilities with other chat and API interfaces (compared to SillyTavern).
### [SillyTavern](https://github.com/SillyTavern/SillyTavern)
Developer-friendly, Multi-API (KoboldAI/CPP, Horde, NovelAI, Ooba, OpenAI+proxies, Poe, WindowAI(Claude!)), Horde SD, System TTS, WorldInfo (lorebooks), customizable UI, auto-translate, and more prompt options than you'd ever want or need. Optional Extras server for more SD/TTS options + ChromaDB/Summarize. Based on a fork of TavernAI 1.2.8
### [Koboldcpp](https://github.com/LostRuins/koboldcpp)
A self-contained distributable from Concedo that exposes llama.cpp function bindings, allowing it to be used via a simulated Kobold API endpoint. What does it mean? You get llama.cpp with a fancy UI, persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios, and everything Kobold and Kobold Lite have to offer. In a tiny package around 20 MB in size, excluding model weights.
### [KoboldAI-Client](https://github.com/KoboldAI/KoboldAI-Client)
This is a browser-based front-end for AI-assisted writing with multiple local & remote AI models. It offers the standard array of tools, including Memory, Author's Note, World Info, Save & Load, adjustable AI settings, formatting options, and the ability to import existing AI Dungeon adventures. You can also turn on Adventure mode and play the game like AI Dungeon Unleashed.
### [h2oGPT](https://github.com/h2oai/h2ogpt)
h2oGPT is a large language model (LLM) fine-tuning framework and chatbot UI with document(s) question-answer capabilities. Documents help to ground LLMs against hallucinations by providing them context relevant to the instruction. h2oGPT is fully permissive Apache V2 open-source project for 100% private and secure use of LLMs and document embeddings for document question-answer.
---
## Image Diffusion Hub
[Download Models](https://civitai.com/)
### [StableDiffusion](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
Stable Diffusion is a text-to-image diffusion model capable of generating photo-realistic and stylized images. This is the free alternative to MidJourney. It is rumored that MidJourney originates from a version of Stable Diffusion that is highly modified, tuned, then made proprietary.
### [SDXL (Stable Diffusion XL)](https://clipdrop.co/stable-diffusion)
With [Stable Diffusion XL](https://stability.ai/stablediffusion), you can create descriptive images with shorter prompts and generate words within images. The model is a significant advancement in image generation capabilities, offering enhanced image composition and face generation that results in stunning visuals and realistic aesthetics.
### [ComfyUI](https://github.com/comfyanonymous/ComfyUI)
A powerful and modular stable diffusion GUI and backend. This new and powerful UI will let you design and execute advanced stable diffusion pipelines using a graph/nodes/flowchart-based interface.
### [ControlNet](https://github.com/lllyasviel/ControlNet)
ControlNet is a neural network structure to control diffusion models by adding extra conditions. This is a very popular and powerful extension to add to AUTOMATIC111's stable-diffusion-webui.
### [TemporalKit](https://github.com/CiaraStrawberry/TemporalKit)
An all-in-one solution for adding Temporal Stability to a Stable Diffusion Render via an automatic1111 extension. You must install FFMPEG to path before running this.
### [EbSynth](https://ebsynth.com/)
Bring your paintings to animated life. This software can be used in conjunction with StableDiffusion + ControlNet + TemporalKit workflows.
### [WarpFusion](https://github.com/Sxela/WarpFusion)
A TemporalKit alternative to produce video effects and animation styling.
---
## Training & Education
### LLMs
- [Oobabooga's text-generation-webui](https://github.com/oobabooga/text-generation-webui/blob/main/docs/Training-LoRAs.md)
- [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl)
- [OpenAI Cookbook](https://github.com/openai/openai-cookbook)
- [AemonAlgiz](https://www.youtube.com/@AemonAlgiz)
### Diffusers
- [enigmatic_e](https://www.youtube.com/@enigmatic_e)
- [Albert Bozesan](https://www.youtube.com/@albertbozesan)
- [ControlNet Tutorial](https://www.youtube.com/watch?v=dLM2Gz7GR44)
- [Stable Diffusion + ControlNet + TemporalKit + EbSynth Workflow](https://www.youtube.com/watch?v=rlfhv0gRAF4)
- [Stable Diffusion + Warp Fusion Workflow](https://www.youtube.com/watch?v=m8xaPnaooyg)
---
## Bonus Recommendations
**[AI Business Startup Kit](https://lemmy.world/post/669438)**
**LLM Learning Material from the Developer of SuperHOT** ([kaiokendev](https://kaiokendev.github.io/til)):
>Here are some resources to help with learning LLMs:
>
>[Andrej Karpathy’s GPT from scratch](https://www.youtube.com/watch?v=kCc8FmEb1nY)
>
>[Huggingface’s NLP Course](https://huggingface.co/learn/nlp-course/chapter1/1)
>
>And for training specifically:
>
>[Alpaca LoRA](https://github.com/tloen/alpaca-lora#-alpaca-lora)
>
>[Vicuna](https://github.com/lm-sys/FastChat#fine-tuning)
>
>[Community training guide](https://rentry.org/llm-training)
>
>Of course for papers, I recommend reading anything on arXiv’s CS - Computation & Language that looks interesting to you: [https://arxiv.org/list/cs.CL/recent](https://arxiv.org/list/cs.CL/recent).
---
## Support Developers!
Please consider donating, subscribing to, or buying a coffee for any of the major community developers advancing Free Open-Source Artificial Intelligence.
If you're a developer in this space and would like to have your information added here (or changed), please don't hesitate to [message me](mailto:adyn@divineblade.studio)!
[**TheBloke**](https://huggingface.co/TheBloke)
- https://www.patreon.com/TheBlokeAI
[**Oobabooga**](https://github.com/oobabooga/text-generation-webui)
- https://ko-fi.com/oobabooga
[**Eric Hartford**](https://erichartford.com/)
- https://erichartford.com/
[**kaiokendev**](https://kaiokendev.github.io/)
- https://kaiokendev.github.io/
---
**Major FOSAI News & Breakthroughs**
- (June 2023) [MPT-30B: Raising the bar for open-source foundation models](https://www.mosaicml.com/blog/mpt-30b)
- (May 2023) [Google "We Have No Moat, And Neither Does OpenAI"](https://www.semianalysis.com/p/google-we-have-no-moat-and-neither)
- (May 2023) [Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs](https://www.mosaicml.com/blog/mpt-7b)
- (March 2023) [OpenAI Releases Chat-GPT 4](https://openai.com/research/gpt-4)
- (November 2022) [OpenAI Releases Chat-GPT 3](https://openai.com/blog/chatgpt)
- (December 2017) [Attention Is All You Need](https://arxiv.org/abs/1706.03762)