Communicate with Hermes AI Agent over DeltaChat

Bots
1

I recently tried the hermes agent, which is similar to openclaw, some people seem like it more than openclaw.

When I set it up I saw integrations for all kinds of messengers, (even SimpleX), but unfortunately no Delta Chat, so I “vibe-coded” a plugin to add support for Delta Chat.

I got a bit carried away and added all kinds of features like:

  • it can be aware that it is in Delta Chat and has limited access to the jsonrpc api, so it can do things like adding locations/POIs to the map (experimental location streaming feature). :round_pushpin: :world_map:
  • It can receive, understand and send voice messages :speaking_head: :microphone:
  • It can generate webxdc apps :puzzle_piece::mobile_phone:
  • And it can do voice calls with you, and even initiate them on events if you tell it to. :telephone_receiver:

My personal thoughts: Regardless of what you think of AI/LLMs, I believe it would make sense to appear in the default options in these popular applications, not only for advertising, but also because Delta Chat is a good choice for bots, because you don’t need phone numbers or to chat with Telegrams “Bot Father”, you just (install the add-on and) scan the invite link, so this easy onboarding could really have potential.

2

That’s so cool! This adaptation is awesome! :clap:

3

fun project that i integrated easily into hermes agent. for bonus points, i worked with the agent to derive a skill for this repo. will send you a copy once i tune it a bit more if you want to review.

4

Share here! I’m curious what we could add to the skill to ensure it understands DC capabilities and best practices.

The coolest thing is that we can use these mini apps without fear since they’re sandboxed. I love this feature.

5

Agents can do this with chatmail and webxdc!