General
PromptBeginner5 minmarkdown
-e
--env Environment variables in KEY=VALUE format
0
Explore
Find agent skills by outcome
114,300 skills indexed with the new KISS metadata standard.
Showing 24 of 114,300Categories: Productivity, Data, General
General
PromptBeginner5 minmarkdown
-u
--url MCP server URL
0
General
PromptBeginner5 minmarkdown
-a
--args Arguments for the command (e.g.
0
General
PromptBeginner5 minmarkdown
-c
--command Command to run MCP server (e.g.
0
General
PromptBeginner5 minmarkdown
-o
--output Output file for report (default: print to stdout)
0
General
PromptBeginner5 minmarkdown
-m
--model Claude model to use (default: claude-3-7-sonnet-20250219)
0
General
PromptBeginner5 minmarkdown
-t
--transport Transport type: stdio
0
General
PromptBeginner5 minmarkdown
usage: evaluation.py [-h] [-t {stdio
sse
0
General
PromptBeginner5 minmarkdown
-h
--help Show help message
0
Productivity
PromptBeginner5 minmarkdown
2. **Load each task instruction** and in parallel using the MCP server and tools
identify the correct answer by attempting to solve the task YOURSELF
0
General
PromptBeginner5 minmarkdown
After creating your evaluation file
you can use the provided evaluation harness to test your MCP server.
0
Productivity
PromptBeginner5 minmarkdown
Remember to parallelize solving tasks to avoid running out of context
then accumulate all answers and make changes to the file at the end.
0
General
PromptBeginner5 minmarkdown
- The answer will change as issues are created
closed
0
General
PromptBeginner5 minmarkdown
- LLM might format differently (JSON array
comma-separated
0
General
PromptBeginner5 minmarkdown
<answer>repo1
repo2
0
General
PromptBeginner5 minmarkdown
- Requires filtering bugs by date
priority
0
General
PromptBeginner5 minmarkdown
- Answer is a simple
verifiable value
0
General
PromptBeginner5 minmarkdown
<question>Among all bugs reported in January 2024 that were marked as critical priority
which assignee resolved the highest percentage of their assigned bugs within 48 hours? Provide the assignee's username.</question>
0
General
PromptBeginner5 minmarkdown
- In all tool call requests
use the `limit` parameter to limit results (<10)
0
General
PromptBeginner5 minmarkdown
- Make INCREMENTAL
SMALL
0
General
PromptBeginner5 minmarkdown
- Ensure each subagent is only performing READ-ONLY
NON-DESTRUCTIVE
0
General
PromptBeginner5 minmarkdown
- Use your intuition and understanding to create reasonable
realistic
0
General
PromptBeginner5 minmarkdown
- Understand input/output schemas
docstrings
0
General
PromptBeginner5 minmarkdown
- If ambiguity exists
fetch additional information from the web
0