Search
Items tagged with: LLM
Got #qwen3coder 30B #LLM to work on #Framework Desktop. I tested it with e.g. "Write an Angular login page to oauth idp server. Use best practices. use HttpOnly cookies." and few others. It thinks few seconds and writes the code about in 30 seconds. The codes looked okay. I'm satisfied what i got.
And it's quiet - even when thinking! The monster multi-GPU AI machines are so outdated with a price of one 5090.
I followed github.com/pablo-ross/strix-ha… to install #llamacpp. Some changes from it:
- Skipped kernel update due to newer Ubuntu 25.10.
- Got sudo group error from distrobox. Removed --group-add sudo from distrobox create.
- Tweaked run parameters. I hacked them with trial and error. Looks like i can increase "context size" a lot.
Current command to run Qwen is:
```
distrobox enter llama-rocm-7rc-rocwmma -- ~/llama.cpp/build/bin/llama-cli -m ~/models/qwen3-coder-30B-A3B/BF16/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002.gguf --no-mmap -ngl 99 --ctx_size 16384 -n 20000
```
#homelab #AI
strix-halo-gmktec-evo-x2/ROADMAP.md at main · pablo-ross/strix-halo-gmktec-evo-x2
Configuration and documentation for optimizing Ubuntu 24.04 on AMD Ryzen AI Max+ 395 with Radeon 8060S for LLM inference using llama.cpp with ROCm 7 RC and rocWMMA. - pablo-ross/strix-halo-gmktec-e...GitHub
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
5 Thoughts on Kimi K2 Thinking
interconnects.ai/p/kimi-k2-thi…
5 Thoughts on Kimi K2 Thinking
Quick thoughts on another fantastic open model from a rapidly rising Chinese lab.Nathan Lambert (Interconnects)
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
#AI #LLM #PerplexityAI
https://www.linkedin.com/posts/matasoft-straight-forward-it-solutions_ai-llm-ollama-activity-7385205325618098176-h6AB?utm_source=share&utm_medium=member_android&rcm=ACoAAAvSE9wB9MDwKZXjVr9RHMW-xjFFBI5Ee_E
#Automation #Spreadsheets #OllamaCloud #Ollama #LLM
## Spreadsheet Automation with Ollama Cloud Models + Local Web Search
## Spreadsheet Automation with Ollama Cloud Models + Local Web Search The latest article demonstrates how (Un)Perplexed Spready integrates Ollama cloud models, and locally installed models, with local Searxng web search, delivering high-quality AI-p…Matasoft - Straight-forward IT Solutions (www.linkedin.com)
#AI #LLM #Gemma3 #Qwen3
#AI #LLM #Innovation #Spreadsheets
matasoft.hr/qtrendcontrol/inde…
(Un)Perplexed Spready with web search enabled Ollama models
Configure web search-enabled Ollama models in (Un)Perplexed Spready. Complete tutorial for connecting SearXNG to local AI models for enhanced spreadsheet automation.matasoft.hr
#AI #LLM #PerplexityAI
#AI #LLM #Superhuman #Freelance #Freelancer #Upwork #Fiverr
linkedin.com/posts/matasoft-st…
Turn raw data into instant insight.
Turn raw data into instant insight. (Un)Perplexed Spready’s hybrid models connect local and cloud reasoning with trusted web results, ensuring constant relevance. #AI #LLM #OllamaCloud #Searxng #UnPerplexedSpready https://lnkd.in/d-6pQPdWMatasoft - Straight-forward IT Solutions (www.linkedin.com)
#AI #LLM #Superhuman #Freelance #Freelancer #Upwork #Fiverr
linkedin.com/posts/matasoft-st…
Turn raw data into instant insight.
Turn raw data into instant insight. (Un)Perplexed Spready’s hybrid models connect local and cloud reasoning with trusted web results, ensuring constant relevance. #AI #LLM #OllamaCloud #Searxng #UnPerplexedSpready https://lnkd.in/d-6pQPdWMatasoft - Straight-forward IT Solutions (www.linkedin.com)
#AI #LLM #Ollama #Searxng #OllamaCloud #UnPerplexedSpready
linkedin.com/posts/matasoft-st…
