Forum Discussion

iFab's avatar
iFab
Contributor 2
1 month ago

Do you run AI locally or just use public AI apps?

Multi large language models vs. local download

Are a lot of people just downloading an llm on their own computer or just using the public apps? Is anybody using llms to check llms to check llms etc?

3 Replies

  • I use public AI apps, but I think the bigger question for business owners is what information we should and shouldn’t put into them. Convenience is great, but protecting business and customer information matters too.

  • iFab's avatar
    iFab
    Contributor 2

    I use Claude as my main orchestrater. Claude code is great and getting better the more I learn. 13 months ago I had heard about AI, but didn't know what ChatGPT was.  Now I use chatgpt, Claude, Grok, Gemini, perplexity, and Kimi. I have one LLM(it varies which one) write a prompt. I put the prompt into two others. Copy and paste the answers into each other and the prompt writer. Then return the answers of the other two to the prompt writer. When they all agree, I cold drop and have a 4th model check it. If it finds something I return it back to the first model. Then cold drop that into the 5th model. It takes more time but I'm getting working programs and websites. 

  • We run Claude locally. It can function like a ai assistant and has more functionality.