OBS Studio

OBS Studio is a open-source software used to record your screen, or start Live Streaming on YouTube or Twitch

I don't have to explain it to you, but you need OBS Studio for this kind of stuff...(duh)

Prerequisite

• obs-vkcapture

How to install

• To install OBS Studio, you can install it using your Package Manager, or you can use the Flatpak version

Now Unfortunately the Plugin for Spout 2 Doesn't work in Linux OBS as of right now. But there's at least 3 alternatives. You can either use: Window Capture, Game Capture , or you can enable NDI capture for Vtube studio. It is recommended to use: Window Capture method or Game Capture method

Window Capture Method

• First go to OBS and select Window Capture (Xcomposite)* then select VTube Studio

• Next, you need to change the background color in your VTubing Software to something solid like Green

• Next you should go into OBS, and then add a Chroma Key filter

OBS Filters

• Next you should go into the Chroma Key Filter and adjust your settings to something like this:

Chroma Key settings

• The end result should look something like this:

Hey, look! it's Kylo!

You can now Live2D Vtube on Linux! Make sure the Live2D window is open though or you will be greeted with a black screen, you cannot minimize this but keeping it open is the best solution to this issue.

*Window Capture (Xcomposite) as the name suggest, Xcomposite, is a Window Capture for Xorg/X11 display server. If you're using Wayland, you have to use Screen Capture (PipeWire) and then select your window from your desktop portal

KDE Desktop Portal

Game Capture Method

For this method, you need to install a plugin called obs-vkcapture

For Arch Based Distributions, just install obs-vkcapture AUR package

For Fedora based Distributions, just install obs-studio-plugin-vkcapture package

For Ubuntu/Debian based distro, follow these steps first:

• Open Terminal and use the commands (ubuntu based distrubutions)

sudo apt install libvulkan-dev vulkan-tools
sudo apt install libgl1-mesa-dev
sudo apt install libobs-dev

• After these have been installed, next download the source files from GitHub and extract them from the Zip file (You can use Ark or similar app to deal with archive files)

• In Terminal:

cd path_to_extracted_folder
mkdir build && cd build
cmake -DCMAKE_INSTALL_PREFIX=/usr -DCMAKE_BUILD_TYPE=Release ..
sudo make
sudo make install 
or 
run make && make install

• After that is done game capture has been installed! This will work on both the Native version of Obs for Linux and Also the Flatpak version as well!

After installing obs-vkcapture, you can follow these steps:

• Open your Steam -> right click VTube Studio -> Properties -> Add obs-gamecapture %command% in Launch Options field, and then launch your VTube Studio

VTuber Studio Launch Command

• In OBS, Add a Game Capture source. In the Properties, add VTube Studio. Additionally, some VTubing apps require you to have "Allow Transparency" enabled

Game Capture settings

• And you're done!