95
Why I Lost Faith in Kagi
(d-shoot.net)
I've been using Kagi for a while, so I'll post a few quick thoughts I had after reading the article, linked blog, and mastodon thread.
The one thing in the blog post I strongly disagree with is her statement that the summarizer is "the same old AI bullshit". I think they just assumed that without actually testing it. The summarizer is fantastic, and is a great example of the right way to use LLMs. Its output comes entirely from the URL or file you specify. It does not hallucinate. You can ask it follow-up questions about the document, and again, its replies are limited in scope to what's actually in that document. If you ask it something out of scope it'll tell you that it can't find that information in the document. This is great because it's using the LLM for what LLMs are actually good for — complex language parsing — and not for what they're bad for, like reasoning or information storage/retrieval. It's actually quite difficult to misuse the summarizer. It's straightforward and effective. This is Kagi's killer feature, IMO.
I can't speak as highly of its search-integrated AI features like FastGPT. They mostly take information from the contents of the first few search results, but they also seem to "fill in the blanks" more than I'd like. Sometimes it gives me information that is simply not in the sources that it cites. It's not as bad as using ChatGPT (which hallucinates all day every day, and if it ever tries to cite source is hallucinates those, too) but it needs improvement.
That said, Kagi doesn't shove the AI down your throat like you might think reading the blog post. These are separate features that need to be explicitly activated. Plain searches don't return results from the LLMs. If you want that, you need to explicitly go to the assistant or trigger the "quick answer" feature on the search results page. EDIT: I just realized that this is not totally true as of a few weeks ago, when they added a feature to automatically trigger the "quick answer" blurb for search queries ending in a question mark. Perhaps that's why Lori felt like it was over-emphasized.
Anyway, back to the summarizer, here is an example of it in action. I gave it the URL of the Mastodon post. I think this is an excellent result. I also asked it an unrelated followup question so you can see that it limits itself to the information in the URL. It will not make shit up!
The summarizer lets me download conversations in markdown form, so I'll just paste it right in here so you can see.
Exploring https://hackers.town/@lori/112255132348604770
Assistant:
Key points:
- The author wrote a blog post criticizing the search engine Kagi, which then prompted the CEO of Kagi, Vlad, to email the author directly to argue against the criticism. [1]
- The author woke up to an email from Vlad, the CEO of Kagi, who was upset about the blog post the author had written. [1]
- The author decided to publicly share the email exchange with Vlad, as they felt it was important for people to see his unhinged behavior. [1]
- The author refused to engage in a private debate with Vlad, as they did not want to be taken "to Crime Scene Number Two" without any accountability. [1]
- The author believes Vlad is unable to accept criticism or disagreement, and that it "eats him alive" when someone doesn't agree with him or his company. [1]
- The author states that no other search engine CEO has emailed them directly to "mansplain their company" in this manner. [1]
- The author sees Vlad's behavior as "petty and sad" and believes he has no understanding of boundaries. [1]
- Other users in the thread share similar experiences of Vlad's inability to accept criticism and his tendency to simply restate his own opinions rather than address counterpoints. [1]
- The author and others characterize Vlad's behavior as that of a narcissist who cannot tolerate disagreement. [1]
- The author and others are amazed by Vlad's decision to set up a separate company in another country just to print and give away t-shirts, rather than focus on improving Kagi's core search functionality.
Query:
What's the capital of North Dakota?
Assistant:
The knowledge provided does not contain any information about the capital of North Dakota. The context is focused on an email exchange between the author and the CEO of Kagi search engine regarding criticism of the company.
