Feat/benches pipeline

[jfdreis]

No description provided.

[jfdreis]

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Python Benchmark with pytest-benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.20.

Benchmark suite	Current: 233b835	Previous: 7b76880	Ratio
benchmarks/test_rag.py::test_rag_pedantic	0.12853314014631542 iter/sec (stddev: 0.03930125145461016)	0.16664327083853855 iter/sec (stddev: 0.06262404233228976)	1.30

This comment was automatically generated by workflow using github-action-benchmark.

[jfdreis]

Summary:

Add RAG performance benchmark to CI pipeline using pytest-benchmark and github-action-benchmark.

Description:
This introduces a new performance benchmark (benchmarks/test_rag.py) and integrates it into workflow (.github/workflows/ci.yml).
The benchmark measures the execution time of the rag.top_num_chunks_execute function.

Key aspects:

• New Benchmark File: Adds benchmarks/test_rag.py containing the benchmark implementation.
• CI Integration: Modifies the CI workflow to run this benchmark on every pull request and push to main.
• Performance Tracking: Utilizes the github-action-benchmark to track performance changes over time and display results on the gh-pages branch. The benchmark performance graph is here.
• Regression Alerting: Configures the benchmark action to fail the CI pipeline and post a comment on the PR if the top_num_chunks_execute function's execution time increases by more than 2% compared to the previous commit.
• Non-Clustered Data: This specific benchmark is configured to test the non-clustered case of RAG execution. Later on we will update this to included a clustered case.
• Dataset Size: The benchmark runs against a test dataset which contains 1000 paragraphs.

[manel1874]

I would put this .env.ci file inside .github/workflows. I believe you only need to adjust the ci file from below.

[manel1874]

In case you move .env.ci into .github/workflows:

Suggested change

	cp .env.ci .env
	cp .github/workflows/.env.ci .env