Chidori – Declarative framework for AI agents (Rust, Python, and Node.js)

by transitivebson 7/27/23, 12:56 AMwith 39 comments
by transitivebson 7/27/23, 12:56 AM

Friend of mine just open sourced his agent framework.

It's written in Rust and supports some cool features like time-travel debugging, embedded code interpreter (Deno + Starlark), human-in-the-loop, and agent evals.

Sharing here cause he's an introvert :) Would love to hear what the HN community thinks!

by hgomersallon 7/27/23, 6:26 AM

As someone that might well be interested in using this (as in someone that is likely to make use of better tooling around LLMs), I'm really struggling to understand what it does. Can anyone provide a summary of what an agent is in this context and an example of why this library makes things better?

by kveykvaon 7/27/23, 2:50 AM

Hello! I'm the author. If anyone has questions or feedback I'd really appreciate it!

by unshavedyakon 7/27/23, 2:10 PM

Well.. i'll be damned. I've been wanting to toy with LLMs on a local-only and simple "command<->LLM glue" style development. If i understand this project right.. it looks like Chidori implements most of the foundational stuff i wanted to do. Notably defining commands (nodes in this, i think?), monitoring node IO and LLM IO, etc.

Looks like i'll need to give this a try. Awesome!

edit: My goal is single binary local-only install though, so sounds like Chidori struggles here due to OpenAI required. Unfortunate for now

by jensneuseon 7/27/23, 12:41 PM

I've built something similar with a focus on returning structured data from the Agent and making it simple to expose an Agent as an OpenAPI. If that sounds interesting, I've wrote up some details here: https://wundergraph.com/blog/beyond_functions_seamlessly_bui...

by jauntywundrkindon 7/27/23, 1:42 AM

Smaller target, but https://news.ycombinator.com/item?id=36854102 https://github.com/e2b-dev/agent-protocol "Agent Protocol" was submitted yesterday, & reminds me of this a little. This is definitely a bigger, more overarching thing.

by ksecon 7/27/23, 7:53 AM

While people think this has something to do with Naruto. I would like to think it is some sort of future AI "Black technology" from Whispered.

( Yes, Chidori has a lot of other usage in Japanese )

by smasher164on 7/27/23, 2:45 AM

I love the Naruto reference.

by OwenCRon 7/27/23, 2:29 AM

This is great, I had been wanting a framework like SAM or Serverless for Lambda functions but for running LLM apps.

by josh-payneon 7/27/23, 1:21 AM

Dude this is so cool. Reliable agents are freakin hard to build, excited to try this out

by snthpyon 7/27/23, 4:59 AM

This looks very cool!

I'm most interested in the reactive runtime though and like the temporal.io and Timely Dataflow references. Is it possible to just have access to that in Rust and leave out the agent bits?

by veaxvoidon 7/27/23, 7:46 AM

can’t wait for Rasengan and Sharingan frameworks

by alex_lavon 7/27/23, 3:39 PM

Requires OpenAI API key. It feels like this is becoming too prominent.

by jxyxfiniteon 7/27/23, 5:17 AM

Can this be integrated with local LLMs or does it only support openAI?