I don’t know of any private trackers on i2p and have just used Postman mainly (the other trackers have very limited content). Postman is OK but not nearly as good as regular private trackers. If what you want are blockbuster films and the latest TV, you’ll be fine. Anything particularly nerdy you will probably find too.
If you do set up a RAG store, please post the tech stack you use as I’m in a similar situation. The inbuilt document store management in ollama+openwebui is a bit clunky.
I’d be interested to see how it goes. I’ve deployed Ollama plus Open WebUI on a few hosts and small models like Llama3.2 run adequately (at least as fast as I can read) on even an old i5-8500T with no GPU. Oracle Cloud free tier might work OK.
Running an LLM can certainly be an on-demand service. Apart from training, which I don’t think we are discussing, GPU compute is only used while responding to prompts.
Also, there are outproxies that provide access to clearnet. The public ones are usually overloaded and slow though.