LachlanM05
A reverse WebSocket tunnel that bridges your local Ollama instance to a public API endpoint. No port forwarding. No price. Always.
A public Node.js server that acts as the entry point. It authenticates requests and routes traffic.
Your PC connects outbound via a WebSocket. No need to open router ports or mess with firewalls.
Requests are executed on your local GPU via Ollama, and the text is streamed back instantly.
Only allowed websites are permitted to send requests. All others are blocked by CORS. Worried about your data safety? Don't be. Your model responses and your prompts are not kept.
Register on this dashboard to generate your API keys.
Copy your Slug and Key from the Dashboard into the App.
Copy your Slug and Key from the Dashboard to the website you would like to use it on, and enjoy.
Head over to my discord and into the Neural Gateway category for more info.
Don't trust the EXE and a inconspicuous virus total result? Good.
The entire stack is open source.