SPDXVersion: SPDX-2.1 DataLicense: CC0-1.0 SPDXID: SPDXRef-DOCUMENT DocumentName: project DocumentNamespace: http://spdx.org/spdxdocs/spdx-v2.1-e96e9dab-f41d-4468-8f74-6acadec0908a Creator: Person: Anonymous () Creator: Organization: Anonymous () Creator: Tool: reuse-6.1.0 Created: 2026-06-05T16:03:11Z CreatorComment: This document was created automatically using available reuse information consistent with REUSE. Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-d736edcd3a6fe9155b53abf344503712 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-df20cde003ef354cebf50a59c6acf65d Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-afad677b1c577391f2df0d9da9e93516 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-e6b60f37efc9c91b3ae5d6729d2e1e7d Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-165971ce9b97cbc1341a52ee5f36523d Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-e1403ddc01c5a1d2e9c23861395d7733 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-cb574b5af7f4fe46342f1b06b6e56ba3 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-1c9787d05f6dd4680d37c8fcb82eb1a5 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-2005f716def8c542dea53f249f84f71b Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-5f80208e969d7b2ab698ebd57fc96c41 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-adc9638198aab61f3fbcc337dbbda965 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-27966b83715ee47527b3b42a3c1024eb Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-3496fd6cef5b7f2c4c48e95cc055579f Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-c9e7cc3482d1a44b26f8db9560bbdf1c Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-248ad6516fd9e5940145c7c8a1b375c4 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-a945e1de43c7e87df1a5e4482ecdaa60 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-2556ac68369a00f52157f1362d740f0c Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-02f2443eb6743b241173c7eb480d8d5d Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-030e0779ed4fbed6bd6d58c42b761ac6 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-48db8bc3ccc20c860cb6d1110e0b19e9 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-6b42e981289bd07e6518d6f8516ea682 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-7fdc23a373f78616f67d556c62a8f8e0 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-82214dec8d0c969ffcfa0307393ef460 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-010e8a887c551d5395962f1c8da83bbe Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-43c589a8e109f88e952d6c13012de0d1 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-fae78f8e707f2a66c1f19de29db4bd26 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-3800f914165a4f33cbaefcb21225fcd8 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-d1cb7ec0949225c4c096a4541db2fc51 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-253036b4f0964e55ba6918ee2e385a4c Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-682d09120d64bc6acfb0487f18cc13ca Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-7079f90253c6f0137fdecc4c4f2d4937 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-724f6fcc39cc796c06363931a6c0b917 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-e481be659ccb47a20b1e89042ea2ce2e Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-8c08accafa00d02caa059f371f72326e Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-1cd2e8db89fbc0862d83c04f3f104355 Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-8ffcf24b8ddfed1f32286ba400c5af1e Relationship: SPDXRef-DOCUMENT DESCRIBES SPDXRef-782c241bc168823be2bbf1b83b4ef8f1 FileName: ./.all-contributorsrc SPDXID: SPDXRef-d736edcd3a6fe9155b53abf344503712 FileChecksum: SHA1: 4ae485ad7886be986498907042a3ecae3deff382 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./.env.example SPDXID: SPDXRef-df20cde003ef354cebf50a59c6acf65d FileChecksum: SHA1: 10ad18c1b0e60d643fac2f2a1cc89cc400b7d3ec LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./.gitignore SPDXID: SPDXRef-afad677b1c577391f2df0d9da9e93516 FileChecksum: SHA1: 5e6d318ccccbd70da9e0b3dff3a95558b80b1348 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./CONTRIBUTING.md SPDXID: SPDXRef-e6b60f37efc9c91b3ae5d6729d2e1e7d FileChecksum: SHA1: 289713a6bce01f9a2506080234232cae1a50b4bf LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./README.md SPDXID: SPDXRef-165971ce9b97cbc1341a52ee5f36523d FileChecksum: SHA1: 2cf700c2b5dff8d64b875e58f5d9876b17938e22 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors Copyright 2026 SAP SE or an SAP affiliate company and toolsense contributors. Please see our [LICENSE](LICENSE) for copyright and license information. Detailed information including third-party components and their licensing/copyright information is available [via the REUSE tool](https://api.reuse.software/info/github.com/SAP/toolsense). FileName: ./data/toolbench-tools/data.jsonl SPDXID: SPDXRef-e1403ddc01c5a1d2e9c23861395d7733 FileChecksum: SHA1: 61c5606bacd0d79c86805bda97726dec357962a3 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./data/toolsense-mcq/data.jsonl SPDXID: SPDXRef-cb574b5af7f4fe46342f1b06b6e56ba3 FileChecksum: SHA1: 90a82aff633c84fbd6f1823431ae2dc5b5c9a7ef LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./data/toolsense-qa/data.jsonl SPDXID: SPDXRef-1c9787d05f6dd4680d37c8fcb82eb1a5 FileChecksum: SHA1: 8701b7102b7e9c1b0063641da54b47af9c0407c1 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./data/toolsense-realistic-retrieval/data.jsonl SPDXID: SPDXRef-2005f716def8c542dea53f249f84f71b FileChecksum: SHA1: 6e149c7a2feff9048df88ca8553f10ce1ff23abe LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./generate_mcq.py SPDXID: SPDXRef-5f80208e969d7b2ab698ebd57fc96c41 FileChecksum: SHA1: 653e418445bd031e25964352973b36a2b1e3650d LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./generate_qa.py SPDXID: SPDXRef-adc9638198aab61f3fbcc337dbbda965 FileChecksum: SHA1: 02fe54ecb749b89558a273afd7d28377890cbd1a LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./images/pipeline.png SPDXID: SPDXRef-27966b83715ee47527b3b42a3c1024eb FileChecksum: SHA1: 47b69f8f5dc76809360b2f34d8f60d6ee518f4bc LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./pyproject.toml SPDXID: SPDXRef-3496fd6cef5b7f2c4c48e95cc055579f FileChecksum: SHA1: ed243d658b48f6e25dc36d29dfa7f14cd2dea448 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/__init__.py SPDXID: SPDXRef-c9e7cc3482d1a44b26f8db9560bbdf1c FileChecksum: SHA1: c84f966e1925b31aabbad100b9e0234acee94954 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/environment.py SPDXID: SPDXRef-248ad6516fd9e5940145c7c8a1b375c4 FileChecksum: SHA1: cc3726074e18d4c9bc72bd75ec932635556618db LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/llm_utils.py SPDXID: SPDXRef-a945e1de43c7e87df1a5e4482ecdaa60 FileChecksum: SHA1: 613dcc5c35497e39f60c837f378e5fa68136a3d4 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/__init__.py SPDXID: SPDXRef-2556ac68369a00f52157f1362d740f0c FileChecksum: SHA1: 630c5fccd7a05b54d6cf496361f46474658633dc LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/aggregator.py SPDXID: SPDXRef-02f2443eb6743b241173c7eb480d8d5d FileChecksum: SHA1: c4bffd20fe5c67972c2844384ac1306b375a0f3a LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/easy/__init__.py SPDXID: SPDXRef-030e0779ed4fbed6bd6d58c42b761ac6 FileChecksum: SHA1: 1a7bd7257877e38e41f1b38033aa45b48e680dbd LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/easy/generate.py SPDXID: SPDXRef-48db8bc3ccc20c860cb6d1110e0b19e9 FileChecksum: SHA1: abe7a6926a6d0d204eeec7496e3fd210cc123414 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/easy/validate.py SPDXID: SPDXRef-6b42e981289bd07e6518d6f8516ea682 FileChecksum: SHA1: 341abaccee20c80812a45594ab6cee9d20a3a997 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/hard/__init__.py SPDXID: SPDXRef-7fdc23a373f78616f67d556c62a8f8e0 FileChecksum: SHA1: 192c83c64687e714cc59b6f811d1084ca62cbe04 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/hard/generate.py SPDXID: SPDXRef-82214dec8d0c969ffcfa0307393ef460 FileChecksum: SHA1: 338224c782589347394f71a76e9bb13d9fc5dd13 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/hard/validate.py SPDXID: SPDXRef-010e8a887c551d5395962f1c8da83bbe FileChecksum: SHA1: ddbcae6969321a0c278f6e391a314e0ec5a5b2a8 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/medium/__init__.py SPDXID: SPDXRef-43c589a8e109f88e952d6c13012de0d1 FileChecksum: SHA1: 3237dee9159a3271bb214eb9914c908ebd3bfb7a LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/medium/generate.py SPDXID: SPDXRef-fae78f8e707f2a66c1f19de29db4bd26 FileChecksum: SHA1: 709e72a469c2bc9b5823b8d069b29092d5d08890 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/medium/validate.py SPDXID: SPDXRef-3800f914165a4f33cbaefcb21225fcd8 FileChecksum: SHA1: acaa6eea9bb036dd6841e9d96f07ab0bcad9af66 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/nodes/shared_context.py SPDXID: SPDXRef-d1cb7ec0949225c4c096a4541db2fc51 FileChecksum: SHA1: 4e166147d77c65ec5b1887ccb67be73225aa7505 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/pipeline.py SPDXID: SPDXRef-253036b4f0964e55ba6918ee2e385a4c FileChecksum: SHA1: 6c332aa60c8c3607b07f407e733cc3a080a51915 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/postprocess.py SPDXID: SPDXRef-682d09120d64bc6acfb0487f18cc13ca FileChecksum: SHA1: 4a3f4e43a7ac6722c8435f1122ac2338e713bd30 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/prompts/easy_generate.jinja2 SPDXID: SPDXRef-7079f90253c6f0137fdecc4c4f2d4937 FileChecksum: SHA1: 91ca0f4fbfd102cff5785f49793f12001115f4f1 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/prompts/hard_generate.jinja2 SPDXID: SPDXRef-724f6fcc39cc796c06363931a6c0b917 FileChecksum: SHA1: 5ca210091bab8315ceda28e2f2379b49d1509da9 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/prompts/medium_generate.jinja2 SPDXID: SPDXRef-e481be659ccb47a20b1e89042ea2ce2e FileChecksum: SHA1: 1fd73c879371e96d0de46f05bba74e2043286bcf LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/prompts/validator.jinja2 SPDXID: SPDXRef-8c08accafa00d02caa059f371f72326e FileChecksum: SHA1: 88bf29ff34410e397641e0d3a3c073b7e9672ea6 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/run_generation.py SPDXID: SPDXRef-1cd2e8db89fbc0862d83c04f3f104355 FileChecksum: SHA1: eab883a24b8a4a4027ef082ab12029d9460fea73 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./realistic_benchmark/seed_preparation.py SPDXID: SPDXRef-8ffcf24b8ddfed1f32286ba400c5af1e FileChecksum: SHA1: 03cdcacfe3d770fe3aa98c7121a3b8970a9e3953 LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors FileName: ./uv.lock SPDXID: SPDXRef-782c241bc168823be2bbf1b83b4ef8f1 FileChecksum: SHA1: 1841206745ea91732e4a8e4e929f04d51f3ad5cc LicenseConcluded: NOASSERTION LicenseInfoInFile: Apache-2.0 FileCopyrightText: SPDX-FileCopyrightText: 2026 SAP SE or an SAP affiliate company and toolsense contributors