Oh this is just what I was looking for! A really great breakdown of this, thank you bud. Didn't even realise that something like Obsidian existed... Here I am doing api calls through vscode like a pleb, definitely time to move!
Very well done explaining the uses of this tool! I believe future version of it will change how we go about everything, and a big step will be the ability to visualize and interact with these connections. I wanted to let you (and whoever sees this) know that I've collaborated with Brian (Creator of Smart Connections) and released the official plugin companion: "Smart Connections Visualizer". For this first version, it's an obsidian graph view that shows relevant connections to your current note. I'll still be adding much much more to it, also with an ability to customize how you see things like no other! Give my channel a peak if you want to find out more If it's not too much, could you pin this comment to let people know about this tool to enhance their experience with SC?
My vault is over 3million words across 2k+ files, all geared towards one project. I was excited to use the Co-Pilot plugin because it advertises "vault mode", but was quickly disappointed when its default reference amount was only 3 notes/files at a time (lol), and can only stretch to 10 but gives a warning that it will prolly screw up the responses. I want to communicate with my vault as a whole for perfect macro context, but it seems my case use is still not possible with current Ai? SmartConnections doesn't seem to be any better, or am I mistaken?
Sweet! That’s a good size! Smart Connections is similar but breaks files into blocks. You’ll pull several related references from within the context of some files which performs better but may take things out of context. Seems like it would perform better This problem is actually generally not so much about what AI is capable of today, it’s that general (solve all) solutions often don’t perfectly fit the problem space or some specific domain. Early days, and everyone is still figuring it out. Some new models can handle a lot of context but no infinite search over your notes yet but one solution could exist that might make you not care about it much
Yes! I’m ready to upload my decades of original notes and content into Obsidian and instruct my LLM to cull through them to create new material based on my own source material. Come on, pick my brain.
Sure, there’s some risk there. If you’re leveraging the API and this risk is meaningful to you, you can request to use it with a zero retention policy: community.openai.com/t/does-gpt-api-keep-data-acquired-from-client-request-private/315844/5
Hi! Good video! I am wondering if you are using any of the openai service essentially you are not running the model locally right? Is there a local embedding and llm available for this, such as llama2 or mistral. Thanks! Awesome video.
Thanks! Glad you enjoyed it! Local embedding are definitely available. Local models currently don’t seem supported but you can proxy requests in these plugins and that could make something like that work too
dude try obsidian copilot can use ollama, with that can use dolphin mistral = it's uncensored AI so there is no guardrail, this way we can be anything creative with texts.
Thanks for the suggestion! I like the look of that but don’t see a lot of activity on the GitHub. Still seems nice to be able to bring in other models, especially local models Dolphin has been pretty fun to play with too
I've never tried either of these. I generally like seeing inside the box and having a bit more insight into how the tools that operate on my notes work. That said Mem looks pretty cool!
Oh this is just what I was looking for! A really great breakdown of this, thank you bud. Didn't even realise that something like Obsidian existed... Here I am doing api calls through vscode like a pleb, definitely time to move!
Glad to hear! Check back in when you've had a chance to try it out!
Well done my man. Keep it up. Your content is valuable because your explainations are excellent!
Much appreciated!
Very well done explaining the uses of this tool! I believe future version of it will change how we go about everything, and a big step will be the ability to visualize and interact with these connections.
I wanted to let you (and whoever sees this) know that I've collaborated with Brian (Creator of Smart Connections) and released the official plugin companion:
"Smart Connections Visualizer".
For this first version, it's an obsidian graph view that shows relevant connections to your current note. I'll still be adding much much more to it, also with an ability to customize how you see things like no other! Give my channel a peak if you want to find out more
If it's not too much, could you pin this comment to let people know about this tool to enhance their experience with SC?
My vault is over 3million words across 2k+ files, all geared towards one project. I was excited to use the Co-Pilot plugin because it advertises "vault mode", but was quickly disappointed when its default reference amount was only 3 notes/files at a time (lol), and can only stretch to 10 but gives a warning that it will prolly screw up the responses.
I want to communicate with my vault as a whole for perfect macro context, but it seems my case use is still not possible with current Ai? SmartConnections doesn't seem to be any better, or am I mistaken?
Sweet! That’s a good size!
Smart Connections is similar but breaks files into blocks. You’ll pull several related references from within the context of some files which performs better but may take things out of context. Seems like it would perform better
This problem is actually generally not so much about what AI is capable of today, it’s that general (solve all) solutions often don’t perfectly fit the problem space or some specific domain. Early days, and everyone is still figuring it out. Some new models can handle a lot of context but no infinite search over your notes yet but one solution could exist that might make you not care about it much
Yes! I’m ready to upload my decades of original notes and content into Obsidian and instruct my LLM to cull through them to create new material based on my own source material. Come on, pick my brain.
If you use ChatGPT does that not just make your Obsidian notes no longer private?
Sure, there’s some risk there. If you’re leveraging the API and this risk is meaningful to you, you can request to use it with a zero retention policy: community.openai.com/t/does-gpt-api-keep-data-acquired-from-client-request-private/315844/5
I think it wouldn't be too much of a problem, unless you're a criminal
@@koska3 Wanting privacy does not make you a criminal.
@@StableDiscussion Thanks :)
Hi! Good video! I am wondering if you are using any of the openai service essentially you are not running the model locally right? Is there a local embedding and llm available for this, such as llama2 or mistral. Thanks! Awesome video.
Thanks! Glad you enjoyed it!
Local embedding are definitely available. Local models currently don’t seem supported but you can proxy requests in these plugins and that could make something like that work too
dude try obsidian copilot can use ollama, with that can use dolphin mistral = it's uncensored AI so there is no guardrail, this way we can be anything creative with texts.
Thanks for the suggestion! I like the look of that but don’t see a lot of activity on the GitHub. Still seems nice to be able to bring in other models, especially local models
Dolphin has been pretty fun to play with too
Do you use native AI note app like Mem or Saner?
I've never tried either of these. I generally like seeing inside the box and having a bit more insight into how the tools that operate on my notes work. That said Mem looks pretty cool!
There is anyway to use the GPU for this?
🫡❤