---
license: cc0-1.0
task_categories:
- text-generation
language:
- en
tags:
- benchmark
- agent
pretty_name: ask-my-agent bench
size_categories:
- n<1K
---
# ask-my-agent bench

Benchmark measuring usability of models to use with generic agentic apps (such as `ask-my-agent`)

## Usage

Repository contains `index.js`. To run, you need:

1. Configure `ask-my-agent` with `npx ask-my-agent config`
2. Run `node index.js`

Done!

## Leaderboard

Benchmark has separate leaderboard at Obscure-Bench for [native](https://obscureai.mooo.com/leaderboard/askmyagentnative) and [fallback](https://obscureai.mooo.com/leaderboard/askmyagentfallback)

## About Native and Fallback

*P.S. This is not about this benchmark much, but about `ask-my-agent`*

Native tool calls are generally easier for model, because it's trained to do tasks like this. Fallback is entirely text-only talk, just like you would do in chat. No tools.

For this reason, fallback and native separated on leaderboard.

---

Brought to you by sapbot from [Romarchive](https://cows.info.gf)