Been having too much fun using LLMs hosted locally, but can’t seem to get Ollama’s chat with documents to work well. Lots of “what are you talking about? There are no documents here” issues. Does anyone have any recommendations to either a) figure out what’s going wrong or b) Alternative locally hosted options that chat with documents works well with (GPT4all or something?)
Thanks for this. Time to play around and experiment.