perplexity alternative local llm jan nano

Perplexity local alternative for Windows, Linux and Mac

If you value privacy a lot and also like perplexity then you might be searching for local software that can can search the web and answer using a local LLMs, recently a new local LLM model Jan-Nano is released by Menlo research who is the developer of popular Jan AI LLM software, the best part is that it is a very compact 4 billion parameter model specifically trained for the MCP and tool calling like browserMCP and more, some may require API keys like Serper, whereas the browserMCP will work with your local browser. Check the out the screenshots below of what is supported.

How to Run Jan Nano on your Windows 10/11 PC

Your will need the latest beta version of Jan.ai software to get the MCP support, after downloading the software, go to hub (bottom left) and search for jan nano and download the 4b q8 version if you have 8GB VRAM or more else try the lower quants.

To use browserMCP you have to download a chrome plugin by the same name

https://chromewebstore.google.com/detail/browser-mcp-automate-your/bjfgambnhccakkhmkepdoekmckoijdlc

Three steps for basic functionality:

1) Install the above Chrome plugin and activate it

2) Download Jan Nano model based on your install graphics card

3) After that enable the browserMCP by going to Setting and enabling the first two options, check screenshots below:

installing jan nano
installing jan nano q8

Where to find latest release of Jan AI files for Linux and Mac

Releases link