[FEATURE] Allow users to configure test_pass threshold in trace-based evaluators

[poshinchen]

Problem Statement

Output evaluators has the rubric to provide the scores and acceptance criteria. However, in the trace-based evaluators the thresholds are fixed.

This issue is to allow users to configure test_pass threshold in trace-based evaluators.
The evaluators are:

• faithfulness_evaluator.py

• goal_success_rate_evaluator.py

• harmfulness_evaluator.py

• helpfulness_evaluator.py

• response_relevance_evaluator.py

• tool_parameter_accuracy_evaluator.py

• tool_selection_accuracy_evaluator.py

Proposed Solution

Allow users to configure test_pass threshold in trace-based evaluators

Use Case

Users can define the threshold for the tests to pass.

Alternatives Solutions

No response

Additional Context

No response