Running tests...
Capturing agent diff from: /logs/artifacts/testbed
rm 'datasets/atomic/dummy/atomic/1.1.0/dummy_data.zip'
Removed binary: datasets/atomic/dummy/atomic/1.1.0/dummy_data.zip
rm 'datasets/conceptnet5/dummy/conceptnet5/5.7.0/dummy_data.zip'
Removed binary: datasets/conceptnet5/dummy/conceptnet5/5.7.0/dummy_data.zip
rm 'datasets/conceptnet5/dummy/omcs_sentences_free/5.7.0/dummy_data.zip'
Removed binary: datasets/conceptnet5/dummy/omcs_sentences_free/5.7.0/dummy_data.zip
rm 'datasets/conceptnet5/dummy/omcs_sentences_more/5.7.0/dummy_data.zip'
Removed binary: datasets/conceptnet5/dummy/omcs_sentences_more/5.7.0/dummy_data.zip
rm 'datasets/lama/dummy/conceptnet/1.1.0/dummy_data.zip'
Removed binary: datasets/lama/dummy/conceptnet/1.1.0/dummy_data.zip
rm 'datasets/lama/dummy/google_re/1.1.0/dummy_data.zip'
Removed binary: datasets/lama/dummy/google_re/1.1.0/dummy_data.zip
rm 'datasets/lama/dummy/squad/1.1.0/dummy_data.zip'
Removed binary: datasets/lama/dummy/squad/1.1.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_belief/1115.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_belief/1115.0.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_belief_sentences/1115.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_belief_sentences/1115.0.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_candidate/1110.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_candidate/1110.0.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_candidate_sentences/1110.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_candidate_sentences/1110.0.0/dummy_data.zip
rm 'datasets/ollie/dummy/ollie_lemmagrep/1.1.0/dummy_data.zip'
Removed binary: datasets/ollie/dummy/ollie_lemmagrep/1.1.0/dummy_data.zip
rm 'datasets/ollie/dummy/ollie_patterned/1.1.0/dummy_data.zip'
Removed binary: datasets/ollie/dummy/ollie_patterned/1.1.0/dummy_data.zip
Patch size: 115001 bytes
HEAD is now at 99c5ad9 base
Baked origin refs missing; fetching from origin at verify time (network_mode=public)...
From https://github.com/huggingface/datasets
 * [new branch]          1.18.X                 -> origin/1.18.X
 * [new branch]          2.10                   -> origin/2.10
 * [new branch]          2.13                   -> origin/2.13
 * [new branch]          2.14                   -> origin/2.14
 * [new branch]          2.19                   -> origin/2.19
 * [new branch]          2.21                   -> origin/2.21
 * [new branch]          2.21-bis               -> origin/2.21-bis
 * [new branch]          2.6                    -> origin/2.6
 * [new branch]          2.7                    -> origin/2.7
 * [new branch]          PathLike-save_to_disk  -> origin/PathLike-save_to_disk
 * [new branch]          add-allow-empty-for-parquet-conversion -> origin/add-allow-empty-for-parquet-conversion
 * [new branch]          add-error_bad_chunk-to-json-loader -> origin/add-error_bad_chunk-to-json-loader
 * [new branch]          add-iterable-dataset-decode -> origin/add-iterable-dataset-decode
 * [new branch]          add-pq-extension       -> origin/add-pq-extension
 * [new branch]          add-repo_id-info       -> origin/add-repo_id-info
 * [new branch]          align-remove_columns-in-formatted-case -> origin/align-remove_columns-in-formatted-case
 * [new branch]          cfahlgren1/add-jsonl-sample-by-document -> origin/cfahlgren1/add-jsonl-sample-by-document
 * [new branch]          cfahlgren1/agent-traces-prompt-sent-at -> origin/cfahlgren1/agent-traces-prompt-sent-at
 * [new branch]          chore/add-dependabot-github-actions -> origin/chore/add-dependabot-github-actions
 * [new branch]          ci-csv-path            -> origin/ci-csv-path
 * [new branch]          ci-fix-test_load_dataset_distributed_with_script -> origin/ci-fix-test_load_dataset_distributed_with_script
 * [new branch]          ci-test-2.21           -> origin/ci-test-2.21
 * [new branch]          ci-test-20240523       -> origin/ci-test-20240523
 * [new branch]          ci-test-20240723       -> origin/ci-test-20240723
 * [new branch]          ci-test-array-cast     -> origin/ci-test-array-cast
 * [new branch]          ci-test-cast           -> origin/ci-test-cast
 * [new branch]          ci-test-ci             -> origin/ci-test-ci
 * [new branch]          ci-test-errors         -> origin/ci-test-errors
 * [new branch]          ci-test-fsspec         -> origin/ci-test-fsspec
 * [new branch]          ci-test-fsspec-2023.10.0 -> origin/ci-test-fsspec-2023.10.0
 * [new branch]          ci-test-fsspec-2023.12.1 -> origin/ci-test-fsspec-2023.12.1
 * [new branch]          ci-test-hf-folder-auth-token -> origin/ci-test-hf-folder-auth-token
 * [new branch]          ci-test-hub-20240708   -> origin/ci-test-hub-20240708
 * [new branch]          ci-test-huggingface-hub-0.29.0.rc6 -> origin/ci-test-huggingface-hub-0.29.0.rc6
 * [new branch]          ci-test-huggingface-hub-0.30.0.rc1 -> origin/ci-test-huggingface-hub-0.30.0.rc1
 * [new branch]          ci-test-huggingface-hub-1.10.0.rc0-release -> origin/ci-test-huggingface-hub-1.10.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.10.0.rc1-release -> origin/ci-test-huggingface-hub-1.10.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.11.0.rc0-release -> origin/ci-test-huggingface-hub-1.11.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.12.0.rc0-release -> origin/ci-test-huggingface-hub-1.12.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.12.0.rc1-release -> origin/ci-test-huggingface-hub-1.12.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.13.0.rc0-release -> origin/ci-test-huggingface-hub-1.13.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.14.0.rc0-release -> origin/ci-test-huggingface-hub-1.14.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.15.0.rc0-release -> origin/ci-test-huggingface-hub-1.15.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.16.0.rc0-release -> origin/ci-test-huggingface-hub-1.16.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.17.0.rc0-release -> origin/ci-test-huggingface-hub-1.17.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.18.0.rc0-release -> origin/ci-test-huggingface-hub-1.18.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.19.0.rc1-release -> origin/ci-test-huggingface-hub-1.19.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.20.0.rc0-release -> origin/ci-test-huggingface-hub-1.20.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.21.0.rc0-release -> origin/ci-test-huggingface-hub-1.21.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.7.0.rc0-release -> origin/ci-test-huggingface-hub-1.7.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.7.0.rc1-release -> origin/ci-test-huggingface-hub-1.7.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.8.0.rc0-release -> origin/ci-test-huggingface-hub-1.8.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.9.0.rc0-release -> origin/ci-test-huggingface-hub-1.9.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.16.0.rc0 -> origin/ci-test-huggingface-hub-v0.16.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.17.0.rc0 -> origin/ci-test-huggingface-hub-v0.17.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.18.0.rc0 -> origin/ci-test-huggingface-hub-v0.18.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.19.0.rc0 -> origin/ci-test-huggingface-hub-v0.19.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.20.0.rc1 -> origin/ci-test-huggingface-hub-v0.20.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.21.0.rc0 -> origin/ci-test-huggingface-hub-v0.21.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.22.0.rc0 -> origin/ci-test-huggingface-hub-v0.22.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.22.0.rc1 -> origin/ci-test-huggingface-hub-v0.22.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.23.0.rc0 -> origin/ci-test-huggingface-hub-v0.23.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.23.0.rc1 -> origin/ci-test-huggingface-hub-v0.23.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.24.0.rc0 -> origin/ci-test-huggingface-hub-v0.24.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.25.0.rc0 -> origin/ci-test-huggingface-hub-v0.25.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.25.0.rc1 -> origin/ci-test-huggingface-hub-v0.25.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.26.0.rc0 -> origin/ci-test-huggingface-hub-v0.26.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.27.0.rc0 -> origin/ci-test-huggingface-hub-v0.27.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.28.0.rc0 -> origin/ci-test-huggingface-hub-v0.28.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc0 -> origin/ci-test-huggingface-hub-v0.29.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc1 -> origin/ci-test-huggingface-hub-v0.29.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc2 -> origin/ci-test-huggingface-hub-v0.29.0.rc2
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc5 -> origin/ci-test-huggingface-hub-v0.29.0.rc5
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc7 -> origin/ci-test-huggingface-hub-v0.29.0.rc7
 * [new branch]          ci-test-huggingface-hub-v0.29.3.rc0 -> origin/ci-test-huggingface-hub-v0.29.3.rc0
 * [new branch]          ci-test-huggingface-hub-v0.30.0.rc3-release -> origin/ci-test-huggingface-hub-v0.30.0.rc3-release
 * [new branch]          ci-test-huggingface-hub-v0.31.0.rc0-release -> origin/ci-test-huggingface-hub-v0.31.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.32.0.rc0-release -> origin/ci-test-huggingface-hub-v0.32.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.32.0.rc1-release -> origin/ci-test-huggingface-hub-v0.32.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v0.33.0.rc0-release -> origin/ci-test-huggingface-hub-v0.33.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.34.0.rc0-release -> origin/ci-test-huggingface-hub-v0.34.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.35.0.rc0-release -> origin/ci-test-huggingface-hub-v0.35.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.35.0.rc1-release -> origin/ci-test-huggingface-hub-v0.35.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v0.36.0.rc0-release -> origin/ci-test-huggingface-hub-v0.36.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc0-release -> origin/ci-test-huggingface-hub-v1.0.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc1-release -> origin/ci-test-huggingface-hub-v1.0.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc2-release -> origin/ci-test-huggingface-hub-v1.0.0.rc2-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc3-release -> origin/ci-test-huggingface-hub-v1.0.0.rc3-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc4-release -> origin/ci-test-huggingface-hub-v1.0.0.rc4-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc5-release -> origin/ci-test-huggingface-hub-v1.0.0.rc5-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc6-release -> origin/ci-test-huggingface-hub-v1.0.0.rc6-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc7-release -> origin/ci-test-huggingface-hub-v1.0.0.rc7-release
 * [new branch]          ci-test-huggingface-hub-v1.1.0.rc0-release -> origin/ci-test-huggingface-hub-v1.1.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.1.0.rc1-release -> origin/ci-test-huggingface-hub-v1.1.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v1.1.0.rc2-release -> origin/ci-test-huggingface-hub-v1.1.0.rc2-release
 * [new branch]          ci-test-huggingface-hub-v1.2.0.rc0-release -> origin/ci-test-huggingface-hub-v1.2.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.3.0.rc0-release -> origin/ci-test-huggingface-hub-v1.3.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.4.0.rc0-release -> origin/ci-test-huggingface-hub-v1.4.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.5.0.rc0-release -> origin/ci-test-huggingface-hub-v1.5.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.6.0.rc0-release -> origin/ci-test-huggingface-hub-v1.6.0.rc0-release
 * [new branch]          ci-test-node-down      -> origin/ci-test-node-down
 * [new branch]          ci-test-np-2           -> origin/ci-test-np-2
 * [new branch]          ci-test-num-examples   -> origin/ci-test-num-examples
 * [new branch]          ci-test-numpy-2.0.0    -> origin/ci-test-numpy-2.0.0
 * [new branch]          ci-test-pyarrow-vuln   -> origin/ci-test-pyarrow-vuln
 * [new branch]          ci-test-sequence-dtype -> origin/ci-test-sequence-dtype
 * [new branch]          ci-test-tuple-protocol -> origin/ci-test-tuple-protocol
 * [new branch]          conda-4.6.0            -> origin/conda-4.6.0
 * [new branch]          conda-release-3.1.0    -> origin/conda-release-3.1.0
 * [new branch]          data-page-v2           -> origin/data-page-v2
 * [new branch]          datasets-2.19.1-hotfix -> origin/datasets-2.19.1-hotfix
 * [new branch]          demo-lazy-decoding     -> origin/demo-lazy-decoding
 * [new branch]          deprecate-search       -> origin/deprecate-search
 * [new branch]          dev-3.0                -> origin/dev-3.0
 * [new branch]          download-partial-dataset -> origin/download-partial-dataset
 * [new branch]          download_and_prepare-if-missing-splits -> origin/download_and_prepare-if-missing-splits
 * [new branch]          drop-data_files_duplicates -> origin/drop-data_files_duplicates
 * [new branch]          dummy                  -> origin/dummy
 * [new branch]          eliebak-patch-1        -> origin/eliebak-patch-1
 * [new branch]          fix-4796               -> origin/fix-4796
 * [new branch]          fix-6147               -> origin/fix-6147
 * [new branch]          fix-6880               -> origin/fix-6880
 * [new branch]          fix-7037               -> origin/fix-7037
 * [new branch]          fix-ci-numpy-numba     -> origin/fix-ci-numpy-numba
 * [new branch]          fix-expected-splits-when-passing-data_files-or-dir -> origin/fix-expected-splits-when-passing-data_files-or-dir
 * [new branch]          fix-set_default        -> origin/fix-set_default
 * [new branch]          fix-spawning-on-macos  -> origin/fix-spawning-on-macos
 * [new branch]          fix-zero-proba-interleave_datasets -> origin/fix-zero-proba-interleave_datasets
 * [new branch]          fix-zstd               -> origin/fix-zstd
 * [new branch]          fsspec-fixes           -> origin/fsspec-fixes
 * [new branch]          image-type-inference   -> origin/image-type-inference
 * [new branch]          large_convert_to_parquet -> origin/large_convert_to_parquet
 * [new branch]          lazy-data_files_resolution -> origin/lazy-data_files_resolution
 * [new branch]          main                   -> origin/main
 * [new branch]          map-decode             -> origin/map-decode
 * [new branch]          move-exceptions-to-utils -> origin/move-exceptions-to-utils
 * [new branch]          overload-load_dataset  -> origin/overload-load_dataset
 * [new branch]          release-2.14.5         -> origin/release-2.14.5
 * [new branch]          release-conda          -> origin/release-conda
 * [new branch]          release-conda-4.2.0    -> origin/release-conda-4.2.0
 * [new branch]          release-conda-5.0.0    -> origin/release-conda-5.0.0
 * [new branch]          resolve-data_files-by-split-name -> origin/resolve-data_files-by-split-name
 * [new branch]          retrieve-cached-no-script-datasets -> origin/retrieve-cached-no-script-datasets
 * [new branch]          retry-streaming-hub-error -> origin/retry-streaming-hub-error
 * [new branch]          security-fix/-github-workflows-release-conda-yml-1780939856 -> origin/security-fix/-github-workflows-release-conda-yml-1780939856
 * [new branch]          speedup_file_downloads -> origin/speedup_file_downloads
 * [new branch]          split_dataset_by_node-same-number-of-examples -> origin/split_dataset_by_node-same-number-of-examples
 * [new branch]          stas00-patch-1         -> origin/stas00-patch-1
 * [new branch]          stevhliu-patch-1       -> origin/stevhliu-patch-1
 * [new branch]          test-convert-parquet   -> origin/test-convert-parquet
 * [new branch]          test-disable-transformer-containers-in-docs-ci -> origin/test-disable-transformer-containers-in-docs-ci
 * [new branch]          v2.13-release          -> origin/v2.13-release
 * [new branch]          v2.14-release          -> origin/v2.14-release
 * [new branch]          v2.14.6-patch          -> origin/v2.14.6-patch
 * [new branch]          v2.14.7-patch          -> origin/v2.14.7-patch
 * [new branch]          v2.21.0-release        -> origin/v2.21.0-release
 * [new tag]             0.0.2                  -> 0.0.2
 * [new tag]             0.0.3                  -> 0.0.3
 * [new tag]             0.1.0                  -> 0.1.0
 * [new tag]             0.2.0                  -> 0.2.0
 * [new tag]             0.2.1                  -> 0.2.1
 * [new tag]             0.3.0                  -> 0.3.0
 * [new tag]             0.4.0                  -> 0.4.0
 * [new tag]             1.0.0                  -> 1.0.0
 * [new tag]             1.0.1                  -> 1.0.1
 * [new tag]             1.0.2                  -> 1.0.2
 * [new tag]             1.1.0                  -> 1.1.0
 * [new tag]             1.1.1                  -> 1.1.1
 * [new tag]             1.1.2                  -> 1.1.2
 * [new tag]             1.1.3                  -> 1.1.3
 * [new tag]             1.10.0                 -> 1.10.0
 * [new tag]             1.10.1                 -> 1.10.1
 * [new tag]             1.10.2                 -> 1.10.2
 * [new tag]             1.11.0                 -> 1.11.0
 * [new tag]             1.12.0                 -> 1.12.0
 * [new tag]             1.12.1                 -> 1.12.1
 * [new tag]             1.13.0                 -> 1.13.0
 * [new tag]             1.13.1                 -> 1.13.1
 * [new tag]             1.13.2                 -> 1.13.2
 * [new tag]             1.13.3                 -> 1.13.3
 * [new tag]             1.14.0                 -> 1.14.0
 * [new tag]             1.15.0                 -> 1.15.0
 * [new tag]             1.15.1                 -> 1.15.1
 * [new tag]             1.16.0                 -> 1.16.0
 * [new tag]             1.16.1                 -> 1.16.1
 * [new tag]             1.17.0                 -> 1.17.0
 * [new tag]             1.18.0                 -> 1.18.0
 * [new tag]             1.18.1                 -> 1.18.1
 * [new tag]             1.18.2                 -> 1.18.2
 * [new tag]             1.18.3                 -> 1.18.3
 * [new tag]             1.18.4                 -> 1.18.4
 * [new tag]             1.2.0                  -> 1.2.0
 * [new tag]             1.2.1                  -> 1.2.1
 * [new tag]             1.3.0                  -> 1.3.0
 * [new tag]             1.4.0                  -> 1.4.0
 * [new tag]             1.4.1                  -> 1.4.1
 * [new tag]             1.5.0                  -> 1.5.0
 * [new tag]             1.6.0                  -> 1.6.0
 * [new tag]             1.6.1                  -> 1.6.1
 * [new tag]             1.6.2                  -> 1.6.2
 * [new tag]             1.7.0                  -> 1.7.0
 * [new tag]             1.8.0                  -> 1.8.0
 * [new tag]             1.9.0                  -> 1.9.0
 * [new tag]             2.0.0                  -> 2.0.0
 * [new tag]             2.1.0                  -> 2.1.0
 * [new tag]             2.10.0                 -> 2.10.0
 * [new tag]             2.10.1                 -> 2.10.1
 * [new tag]             2.11.0                 -> 2.11.0
 * [new tag]             2.12.0                 -> 2.12.0
 * [new tag]             2.13.0                 -> 2.13.0
 * [new tag]             2.13.1                 -> 2.13.1
 * [new tag]             2.13.2                 -> 2.13.2
 * [new tag]             2.14.0                 -> 2.14.0
 * [new tag]             2.14.1                 -> 2.14.1
 * [new tag]             2.14.2                 -> 2.14.2
 * [new tag]             2.14.3                 -> 2.14.3
 * [new tag]             2.14.4                 -> 2.14.4
 * [new tag]             2.14.5                 -> 2.14.5
 * [new tag]             2.14.6                 -> 2.14.6
 * [new tag]             2.14.7                 -> 2.14.7
 * [new tag]             2.15.0                 -> 2.15.0
 * [new tag]             2.16.0                 -> 2.16.0
 * [new tag]             2.16.1                 -> 2.16.1
 * [new tag]             2.17.0                 -> 2.17.0
 * [new tag]             2.17.1                 -> 2.17.1
 * [new tag]             2.18.0                 -> 2.18.0
 * [new tag]             2.19.0                 -> 2.19.0
 * [new tag]             2.19.1                 -> 2.19.1
 * [new tag]             2.19.2                 -> 2.19.2
 * [new tag]             2.2.0                  -> 2.2.0
 * [new tag]             2.2.1                  -> 2.2.1
 * [new tag]             2.2.2                  -> 2.2.2
 * [new tag]             2.20.0                 -> 2.20.0
 * [new tag]             2.21.0                 -> 2.21.0
 * [new tag]             2.3.0                  -> 2.3.0
 * [new tag]             2.3.1                  -> 2.3.1
 * [new tag]             2.3.2                  -> 2.3.2
 * [new tag]             2.4.0                  -> 2.4.0
 * [new tag]             2.5.0                  -> 2.5.0
 * [new tag]             2.5.1                  -> 2.5.1
 * [new tag]             2.5.2                  -> 2.5.2
 * [new tag]             2.6.0                  -> 2.6.0
 * [new tag]             2.6.1                  -> 2.6.1
 * [new tag]             2.6.2                  -> 2.6.2
 * [new tag]             2.7.0                  -> 2.7.0
 * [new tag]             2.7.1                  -> 2.7.1
 * [new tag]             2.8.0                  -> 2.8.0
 * [new tag]             2.9.0                  -> 2.9.0
 * [new tag]             3.0.0                  -> 3.0.0
 * [new tag]             3.0.1                  -> 3.0.1
 * [new tag]             3.0.2                  -> 3.0.2
 * [new tag]             3.1.0                  -> 3.1.0
 * [new tag]             3.2.0                  -> 3.2.0
 * [new tag]             3.3.0                  -> 3.3.0
 * [new tag]             3.3.1                  -> 3.3.1
 * [new tag]             3.3.2                  -> 3.3.2
 * [new tag]             3.4.0                  -> 3.4.0
 * [new tag]             3.4.1                  -> 3.4.1
 * [new tag]             3.5.0                  -> 3.5.0
 * [new tag]             3.5.1                  -> 3.5.1
 * [new tag]             3.6.0                  -> 3.6.0
 * [new tag]             4.0.0                  -> 4.0.0
 * [new tag]             4.1.0                  -> 4.1.0
 * [new tag]             4.1.1                  -> 4.1.1
 * [new tag]             4.2.0                  -> 4.2.0
 * [new tag]             4.3.0                  -> 4.3.0
 * [new tag]             4.4.0                  -> 4.4.0
 * [new tag]             4.4.1                  -> 4.4.1
 * [new tag]             4.4.2                  -> 4.4.2
 * [new tag]             4.5.0                  -> 4.5.0
 * [new tag]             4.6.0                  -> 4.6.0
 * [new tag]             4.6.1                  -> 4.6.1
 * [new tag]             4.7.0                  -> 4.7.0
 * [new tag]             4.8.0                  -> 4.8.0
 * [new tag]             4.8.1                  -> 4.8.1
 * [new tag]             4.8.2                  -> 4.8.2
 * [new tag]             4.8.3                  -> 4.8.3
 * [new tag]             4.8.4                  -> 4.8.4
 * [new tag]             4.8.5                  -> 4.8.5
 * [new tag]             5.0.0                  -> 5.0.0
 * [new tag]             alpha                  -> alpha
 * [new tag]             delete                 -> delete
Removing benchmark.py
Removing datasets/flores/dummy/sien/1.1.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/encs/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enda/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ende/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enel/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enes/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enet/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enfi/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enfr/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enga/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enhr/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enhu/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enit/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enlt/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enlv/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enmt/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ennl/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enpl/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enpt/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enro/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ensk/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ensl/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ensv/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/aztr_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/be_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/beru_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/es_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/fr_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/gl_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/glpt_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/he_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/it_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/pt_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/ru_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/ru_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/tr_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/xtreme/dummy/XQuAD.ar/1.0.0/dummy_data-zip-extracted/
Removing reference_result.json
Removing src/datasets/formatting/formatting.py.bak
Removing src/datasets/table.py.bak
HEAD is now at b713dcdff Fix CI: commit operation equality (hfh 1.20.0) and pytest parametrize collection error (#8283)
Checking out base repo...
Note: switching to '599403601739e7a73e8ebbc8653d246e07207265^'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at e60c99fbb [Docs] How to use with PyTorch page (#4474)
Installing repo...
Using CPython 3.9.20
Creating virtual environment at: .venv
/testbed/.venv/bin/python
Python 3.9.20
Resolved 34 packages in 1.32s
Prepared 34 packages in 906ms
Installed 34 packages in 66ms
 + aiohappyeyeballs==2.6.1
 + aiohttp==3.13.5
 + aiosignal==1.4.0
 + async-timeout==5.0.1
 + attrs==26.1.0
 + certifi==2026.6.17
 + charset-normalizer==3.4.7
 + datasets==2.2.3.dev0 (from file:///testbed)
 + dill==0.3.5.1
 + filelock==3.19.1
 + frozenlist==1.8.0
 + fsspec==2025.10.0
 + hf-xet==1.5.1
 + huggingface-hub==0.36.2
 + idna==3.18
 + multidict==6.7.1
 + multiprocess==0.70.13
 + numpy==2.0.2
 + packaging==26.2
 + pandas==2.3.3
 + propcache==0.4.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2026.2
 + pyyaml==6.0.3
 + requests==2.32.5
 + responses==0.18.0
 + six==1.17.0
 + tqdm==4.68.3
 + typing-extensions==4.15.0
 + tzdata==2026.2
 + urllib3==2.6.3
 + xxhash==3.7.1
 + yarl==1.22.0
Resolved 1 package in 233ms
Prepared 1 package in 290ms
Uninstalled 1 package in 56ms
Installed 1 package in 41ms
 - pyarrow==21.0.0
 + pyarrow==20.0.0
Resolved 13 packages in 342ms
Prepared 6 packages in 83ms
Installed 6 packages in 21ms
 + absl-py==2.3.1
 + decorator==5.3.1
 + greenlet==3.2.5
 + pillow==11.3.0
 + sqlalchemy==2.0.51
 + zstandard==0.25.0
Name: datasets
Version: 2.2.3.dev0
Location: /testbed/.venv/lib/python3.9/site-packages
Requires: aiohttp, dill, fsspec, huggingface-hub, multiprocess, numpy, packaging, pandas, pyarrow, requests, responses, tqdm, xxhash
Required-by:
>>>>> Init Succeeded
Running performance test before patch...
Running test /tests/gso_test_0.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_1.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_2.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c2c1ea9dac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x74972ea5dac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x723fcf8dcac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7aa12ae9dac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ddb2945cac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_3.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_4.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_5.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_6.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x796ee671fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7a924b11fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7574bd59fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7f25fc69fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x724776ddfa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x77a82509fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7eeac449fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x79ffde4dfa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x73b9365dfa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x74694b09fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_7.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_8.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7e9a542dda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x72d219a9da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x739a02cdda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x760d15ddda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7af9fa91da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x738606240a50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7fae9a9dda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7f7a212dda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7521ca45da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7dc6b869da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_9.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_10.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7196bb09b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71985729a9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7735e409b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7bd35f09b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ec71d85b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7895c9c9b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7a733ba9b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7d5a5ca9b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7093ff71b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ca17e29b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_11.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x76691a09ea50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7748bce5da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x71196addda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7dd006edca50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7711ccf1ca50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_12.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Applying patch...
Skipped patch 'datasets/atomic/dataset_infos.json'.
Skipped patch 'datasets/conceptnet5/dataset_infos.json'.
Skipped patch 'datasets/lama/dataset_infos.json'.
Skipped patch 'datasets/nell/dataset_infos.json'.
Skipped patch 'datasets/ollie/dataset_infos.json'.
Skipped patch 'reference_result.json'.
Checking patch .circleci/deploy.sh...
Checking patch benchmark.py...
Checking patch convert_dataset.sh...
Checking patch datasets/atomic/README.md...
Checking patch datasets/atomic/atomic.py...
Checking patch datasets/conceptnet5/README.md...
Checking patch datasets/conceptnet5/conceptnet5.py...
Checking patch datasets/generics_kb/generics_kb.py...
Checking patch datasets/lama/README.md...
Checking patch datasets/lama/lama.py...
Checking patch datasets/nell/README.md...
Checking patch datasets/nell/nell.py...
Checking patch datasets/ollie/README.md...
Checking patch datasets/ollie/ollie.py...
Checking patch datasets/proto_qa/proto_qa.py...
Checking patch datasets/ro_sts/ro_sts.py...
Checking patch datasets/ro_sts_parallel/README.md...
Checking patch datasets/ro_sts_parallel/ro_sts_parallel.py...
Checking patch src/datasets/arrow_dataset.py...
Checking patch src/datasets/formatting/formatting.py...
Checking patch src/datasets/formatting/formatting.py.bak...
Checking patch src/datasets/table.py...
Checking patch src/datasets/table.py.bak...
Applied patch .circleci/deploy.sh cleanly.
Applied patch benchmark.py cleanly.
Applied patch convert_dataset.sh cleanly.
Applied patch datasets/atomic/README.md cleanly.
Applied patch datasets/atomic/atomic.py cleanly.
Applied patch datasets/conceptnet5/README.md cleanly.
Applied patch datasets/conceptnet5/conceptnet5.py cleanly.
Applied patch datasets/generics_kb/generics_kb.py cleanly.
Applied patch datasets/lama/README.md cleanly.
Applied patch datasets/lama/lama.py cleanly.
Applied patch datasets/nell/README.md cleanly.
Applied patch datasets/nell/nell.py cleanly.
Applied patch datasets/ollie/README.md cleanly.
Applied patch datasets/ollie/ollie.py cleanly.
Applied patch datasets/proto_qa/proto_qa.py cleanly.
Applied patch datasets/ro_sts/ro_sts.py cleanly.
Applied patch datasets/ro_sts_parallel/README.md cleanly.
Applied patch datasets/ro_sts_parallel/ro_sts_parallel.py cleanly.
Applied patch src/datasets/arrow_dataset.py cleanly.
Applied patch src/datasets/formatting/formatting.py cleanly.
Applied patch src/datasets/formatting/formatting.py.bak cleanly.
Applied patch src/datasets/table.py cleanly.
Applied patch src/datasets/table.py.bak cleanly.
Successfully applied patch using git apply --verbose
>>>>> Applied Patch
Installing repo...
Using CPython 3.9.20
Creating virtual environment at: .venv
/testbed/.venv/bin/python
Python 3.9.20
Resolved 34 packages in 1.34s
Prepared 34 packages in 923ms
Installed 34 packages in 102ms
 + aiohappyeyeballs==2.6.1
 + aiohttp==3.13.5
 + aiosignal==1.4.0
 + async-timeout==5.0.1
 + attrs==26.1.0
 + certifi==2026.6.17
 + charset-normalizer==3.4.7
 + datasets==2.2.3.dev0 (from file:///testbed)
 + dill==0.3.5.1
 + filelock==3.19.1
 + frozenlist==1.8.0
 + fsspec==2025.10.0
 + hf-xet==1.5.1
 + huggingface-hub==0.36.2
 + idna==3.18
 + multidict==6.7.1
 + multiprocess==0.70.13
 + numpy==2.0.2
 + packaging==26.2
 + pandas==2.3.3
 + propcache==0.4.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2026.2
 + pyyaml==6.0.3
 + requests==2.32.5
 + responses==0.18.0
 + six==1.17.0
 + tqdm==4.68.3
 + typing-extensions==4.15.0
 + tzdata==2026.2
 + urllib3==2.6.3
 + xxhash==3.7.1
 + yarl==1.22.0
Resolved 1 package in 240ms
Prepared 1 package in 222ms
Uninstalled 1 package in 67ms
Installed 1 package in 42ms
 - pyarrow==21.0.0
 + pyarrow==20.0.0
Resolved 13 packages in 323ms
Prepared 6 packages in 75ms
Installed 6 packages in 20ms
 + absl-py==2.3.1
 + decorator==5.3.1
 + greenlet==3.2.5
 + pillow==11.3.0
 + sqlalchemy==2.0.51
 + zstandard==0.25.0
Name: datasets
Version: 2.2.3.dev0
Location: /testbed/.venv/lib/python3.9/site-packages
Requires: aiohttp, dill, fsspec, huggingface-hub, multiprocess, numpy, packaging, pandas, pyarrow, requests, responses, tqdm, xxhash
Required-by:
>>>>> Init Succeeded
Running performance test after patch...
Running test /tests/gso_test_0.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_1.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_2.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7635bf71d9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7a75e949c9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7aac7449c9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71af55a9c9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x706db016e9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_3.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_4.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_5.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_6.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x73915fa5f970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7891b50e0970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x767712a60970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x77e847860970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x79ad93ea0970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x77b08f8e0970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x73a85f443970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7f43a8a60970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7be3adbe0970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x773b55ca0970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_7.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_8.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x73f56a65e970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7922b851e970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x76a49611d970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x75d1e4edd970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x780864dde970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x789c680de970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x784028ade970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x70cbaed1e970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7315e129e970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7e89c889e970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_9.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_10.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71755645c900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7178ec49c900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7e815c85c900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x72e89089b900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x741d1605c900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x73ad60c5c900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x78f7a5b9b900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x72c39b4dc900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7f08ee25b900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c816c65c900> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_11.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7ada4ca9c970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x73d9cd1dd970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x724ab0e5c970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x70b29b69e970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7247e105e970> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_12.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
>>>>> Start Base Output
>>>>> Test 0
Execution time: 0.218833s
Execution time: 0.214679s
Execution time: 0.215371s
Execution time: 0.217160s
Execution time: 0.221225s
Execution time: 0.217686s
Execution time: 0.224511s
Execution time: 0.213042s
Execution time: 0.215713s
Execution time: 0.221017s
>>>>> Test 1
Execution time: 0.003977s
Execution time: 0.003868s
Execution time: 0.004018s
Execution time: 0.003947s
Execution time: 0.003928s
Execution time: 0.003922s
Execution time: 0.003903s
Execution time: 0.004023s
Execution time: 0.003937s
Execution time: 0.003887s
>>>>> Test 2
Execution time: 0.771344s
Execution time: 0.772617s
Execution time: 0.791982s
Execution time: 0.781104s
Execution time: 0.817845s
>>>>> Test 3
Execution time: 0.446381s
Execution time: 0.426602s
Execution time: 0.432154s
Execution time: 0.429247s
Execution time: 0.427313s
>>>>> Test 4
Execution time: 0.051538s
Execution time: 0.050947s
Execution time: 0.050599s
Execution time: 0.050678s
Execution time: 0.050532s
>>>>> Test 5
Execution time: 0.004164s
Execution time: 0.004159s
Execution time: 0.004050s
Execution time: 0.004057s
Execution time: 0.004014s
Execution time: 0.003992s
Execution time: 0.004167s
Execution time: 0.004275s
Execution time: 0.004023s
Execution time: 0.004073s
>>>>> Test 6
Execution time: 0.004472s
Execution time: 0.004579s
Execution time: 0.004940s
Execution time: 0.004473s
Execution time: 0.004780s
Execution time: 0.004370s
Execution time: 0.004486s
Execution time: 0.005881s
Execution time: 0.004474s
Execution time: 0.004548s
>>>>> Test 7
Execution time: 0.005799s
Execution time: 0.005914s
Execution time: 0.005760s
Execution time: 0.005808s
Execution time: 0.006131s
Execution time: 0.006225s
Execution time: 0.006532s
Execution time: 0.005683s
Execution time: 0.005615s
Execution time: 0.005633s
>>>>> Test 8
Execution time: 0.674718s
Execution time: 0.720788s
Execution time: 0.690197s
Execution time: 0.664199s
Execution time: 0.674295s
Execution time: 0.679108s
Execution time: 0.671990s
Execution time: 0.695907s
Execution time: 0.683375s
Execution time: 0.695232s
>>>>> Test 9
Execution time: 0.033975s
Execution time: 0.032611s
Execution time: 0.033519s
Execution time: 0.033942s
Execution time: 0.033009s
Execution time: 0.033324s
Execution time: 0.033828s
Execution time: 0.033147s
Execution time: 0.032809s
Execution time: 0.032544s
>>>>> Test 10
Execution time: 0.001998s
Execution time: 0.001973s
Execution time: 0.002060s
Execution time: 0.002032s
Execution time: 0.002032s
Execution time: 0.002029s
Execution time: 0.002197s
Execution time: 0.002028s
Execution time: 0.002049s
Execution time: 0.002104s
>>>>> Test 11
Execution time: 0.069004s
Execution time: 0.071692s
Execution time: 0.069525s
Execution time: 0.068959s
Execution time: 0.068892s
>>>>> Test 12
Execution time: 0.262047s
Execution time: 0.263556s
Execution time: 0.263854s
Execution time: 0.270600s
Execution time: 0.264964s
Execution time: 0.264257s
Execution time: 0.265869s
Execution time: 0.263318s
Execution time: 0.263467s
Execution time: 0.266388s
>>>>> End Base Output
>>>>> Start Patch Output
>>>>> Test 0
Execution time: 0.004874s
Execution time: 0.004301s
Execution time: 0.004513s
Execution time: 0.006123s
Execution time: 0.004722s
Execution time: 0.004459s
Execution time: 0.004160s
Execution time: 0.004461s
Execution time: 0.004235s
Execution time: 0.004576s
>>>>> Test 1
Execution time: 0.000666s
Execution time: 0.000650s
Execution time: 0.000675s
Execution time: 0.000656s
Execution time: 0.000683s
Execution time: 0.000695s
Execution time: 0.000657s
Execution time: 0.000656s
Execution time: 0.000672s
Execution time: 0.000656s
>>>>> Test 2
Execution time: 0.169679s
Execution time: 0.161587s
Execution time: 0.173917s
Execution time: 0.168071s
Execution time: 0.166621s
>>>>> Test 3
Execution time: 0.088262s
Execution time: 0.089612s
Execution time: 0.091502s
Execution time: 0.088143s
Execution time: 0.090385s
>>>>> Test 4
Execution time: 0.024233s
Execution time: 0.024184s
Execution time: 0.023954s
Execution time: 0.023451s
Execution time: 0.023737s
>>>>> Test 5
Execution time: 0.002641s
Execution time: 0.002642s
Execution time: 0.002682s
Execution time: 0.002619s
Execution time: 0.002636s
Execution time: 0.002652s
Execution time: 0.002680s
Execution time: 0.002661s
Execution time: 0.002783s
Execution time: 0.002636s
>>>>> Test 6
Execution time: 0.003202s
Execution time: 0.003139s
Execution time: 0.004712s
Execution time: 0.003154s
Execution time: 0.003259s
Execution time: 0.003202s
Execution time: 0.003208s
Execution time: 0.003223s
Execution time: 0.004524s
Execution time: 0.003227s
>>>>> Test 7
Execution time: 0.005727s
Execution time: 0.004425s
Execution time: 0.004194s
Execution time: 0.004129s
Execution time: 0.004122s
Execution time: 0.004291s
Execution time: 0.004219s
Execution time: 0.004117s
Execution time: 0.004072s
Execution time: 0.005218s
>>>>> Test 8
Execution time: 0.602046s
Execution time: 0.592853s
Execution time: 0.616912s
Execution time: 0.602330s
Execution time: 0.619202s
Execution time: 0.597883s
Execution time: 0.613188s
Execution time: 0.595548s
Execution time: 0.591370s
Execution time: 0.598660s
>>>>> Test 9
Execution time: 0.028017s
Execution time: 0.028055s
Execution time: 0.028721s
Execution time: 0.033805s
Execution time: 0.028305s
Execution time: 0.028037s
Execution time: 0.029329s
Execution time: 0.027911s
Execution time: 0.028595s
Execution time: 0.027740s
>>>>> Test 10
Execution time: 0.001751s
Execution time: 0.001750s
Execution time: 0.001765s
Execution time: 0.001783s
Execution time: 0.001768s
Execution time: 0.001807s
Execution time: 0.001769s
Execution time: 0.001751s
Execution time: 0.001757s
Execution time: 0.001871s
>>>>> Test 11
Execution time: 0.056911s
Execution time: 0.057880s
Execution time: 0.057389s
Execution time: 0.057353s
Execution time: 0.056640s
>>>>> Test 12
Execution time: 0.219285s
Execution time: 0.228320s
Execution time: 0.216648s
Execution time: 0.221542s
Execution time: 0.221184s
Execution time: 0.226038s
Execution time: 0.220872s
Execution time: 0.234849s
Execution time: 0.229745s
Execution time: 0.213953s
>>>>> End Patch Output
Removing base_0.txt
Removing base_1.txt
Removing base_10.txt
Removing base_11.txt
Removing base_12.txt
Removing base_2.txt
Removing base_3.txt
Removing base_4.txt
Removing base_5.txt
Removing base_6.txt
Removing base_7.txt
Removing base_8.txt
Removing base_9.txt
Removing benchmark.py
Removing build/
Removing gso_0_result.json
Removing gso_10_result.json
Removing gso_11_result.json
Removing gso_12_result.json
Removing gso_1_result.json
Removing gso_2_result.json
Removing gso_3_result.json
Removing gso_4_result.json
Removing gso_5_result.json
Removing gso_6_result.json
Removing gso_7_result.json
Removing gso_8_result.json
Removing gso_9_result.json
Removing result_0.txt
Removing result_1.txt
Removing result_10.txt
Removing result_11.txt
Removing result_12.txt
Removing result_2.txt
Removing result_3.txt
Removing result_4.txt
Removing result_5.txt
Removing result_6.txt
Removing result_7.txt
Removing result_8.txt
Removing result_9.txt
Removing src/datasets.egg-info/
Removing src/datasets/formatting/formatting.py.bak
Removing src/datasets/table.py.bak
HEAD is now at b713dcdff Fix CI: commit operation equality (hfh 1.20.0) and pytest parametrize collection error (#8283)
Checking out commit...
Previous HEAD position was b713dcdff Fix CI: commit operation equality (hfh 1.20.0) and pytest parametrize collection error (#8283)
HEAD is now at 599403601 Optimize contiguous shard and select (#4466)
Installing repo...
Using CPython 3.9.20
Creating virtual environment at: .venv
/testbed/.venv/bin/python
Python 3.9.20
Resolved 34 packages in 1.49s
Prepared 34 packages in 814ms
Installed 34 packages in 95ms
 + aiohappyeyeballs==2.6.1
 + aiohttp==3.13.5
 + aiosignal==1.4.0
 + async-timeout==5.0.1
 + attrs==26.1.0
 + certifi==2026.6.17
 + charset-normalizer==3.4.7
 + datasets==2.2.3.dev0 (from file:///testbed)
 + dill==0.3.5.1
 + filelock==3.19.1
 + frozenlist==1.8.0
 + fsspec==2025.10.0
 + hf-xet==1.5.1
 + huggingface-hub==0.36.2
 + idna==3.18
 + multidict==6.7.1
 + multiprocess==0.70.13
 + numpy==2.0.2
 + packaging==26.2
 + pandas==2.3.3
 + propcache==0.4.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2026.2
 + pyyaml==6.0.3
 + requests==2.32.5
 + responses==0.18.0
 + six==1.17.0
 + tqdm==4.68.3
 + typing-extensions==4.15.0
 + tzdata==2026.2
 + urllib3==2.6.3
 + xxhash==3.7.1
 + yarl==1.22.0
Resolved 1 package in 125ms
Prepared 1 package in 277ms
Uninstalled 1 package in 41ms
Installed 1 package in 31ms
 - pyarrow==21.0.0
 + pyarrow==20.0.0
Resolved 13 packages in 340ms
Prepared 6 packages in 62ms
Installed 6 packages in 14ms
 + absl-py==2.3.1
 + decorator==5.3.1
 + greenlet==3.2.5
 + pillow==11.3.0
 + sqlalchemy==2.0.51
 + zstandard==0.25.0
Name: datasets
Version: 2.2.3.dev0
Location: /testbed/.venv/lib/python3.9/site-packages
Requires: aiohttp, dill, fsspec, huggingface-hub, multiprocess, numpy, packaging, pandas, pyarrow, requests, responses, tqdm, xxhash
Required-by:
>>>>> Init Succeeded
Running performance test for commit...
Running test /tests/gso_test_0.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_1.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_2.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x700306bddc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x78a40605dc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7414d025dc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x72177d09dc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7b797e85dc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_3.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_4.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_5.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_6.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x79a9c00a0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x748d0485fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x790e86aa0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x753697aa0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7986bc71fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c97e825fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71bcdcaa0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x75c6ec8a0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71163bd30ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x798a35e60ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_7.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_8.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7e005e31fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7afad129eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x71ba2731eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x740e5ca5fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7bedeb11eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x761dae6dfba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7e9b9ca9eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x773d3ac5fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x771186adeba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x74305c09fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_9.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_10.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7d37363dcb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c67b9b1cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x788503cdcb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x79f316b1cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x738bc8e5cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x77cf9bc9cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7cb68309cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x764b7a2dcb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7a66efa9db30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x740e4f25db30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_11.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x707abc31eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7c759b6a0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x73a21d29eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7eca94b1eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x79885a7deba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_12.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
>>>>> Start Commit Output
>>>>> Test 0
Execution time: 0.029640s
Execution time: 0.028872s
Execution time: 0.028594s
Execution time: 0.028854s
Execution time: 0.031753s
Execution time: 0.029769s
Execution time: 0.035150s
Execution time: 0.028829s
Execution time: 0.028678s
Execution time: 0.028533s
>>>>> Test 1
Execution time: 0.000736s
Execution time: 0.000715s
Execution time: 0.000749s
Execution time: 0.000734s
Execution time: 0.000740s
Execution time: 0.000772s
Execution time: 0.000746s
Execution time: 0.000737s
Execution time: 0.000752s
Execution time: 0.000739s
>>>>> Test 2
Execution time: 0.248076s
Execution time: 0.251870s
Execution time: 0.252195s
Execution time: 0.246320s
Execution time: 0.245579s
>>>>> Test 3
Execution time: 0.146384s
Execution time: 0.152350s
Execution time: 0.148753s
Execution time: 0.156894s
Execution time: 0.147327s
>>>>> Test 4
Execution time: 0.023998s
Execution time: 0.023960s
Execution time: 0.024085s
Execution time: 0.027032s
Execution time: 0.025543s
>>>>> Test 5
Execution time: 0.002480s
Execution time: 0.002487s
Execution time: 0.002723s
Execution time: 0.002460s
Execution time: 0.002470s
Execution time: 0.002455s
Execution time: 0.002443s
Execution time: 0.002539s
Execution time: 0.003469s
Execution time: 0.002511s
>>>>> Test 6
Execution time: 0.002889s
Execution time: 0.002986s
Execution time: 0.002893s
Execution time: 0.002944s
Execution time: 0.002897s
Execution time: 0.002909s
Execution time: 0.002981s
Execution time: 0.002972s
Execution time: 0.003332s
Execution time: 0.003015s
>>>>> Test 7
Execution time: 0.004108s
Execution time: 0.003984s
Execution time: 0.004127s
Execution time: 0.004089s
Execution time: 0.004022s
Execution time: 0.005173s
Execution time: 0.004055s
Execution time: 0.004071s
Execution time: 0.004755s
Execution time: 0.004031s
>>>>> Test 8
Execution time: 0.520700s
Execution time: 0.535868s
Execution time: 0.530247s
Execution time: 0.528942s
Execution time: 0.515616s
Execution time: 0.513066s
Execution time: 0.513931s
Execution time: 0.509714s
Execution time: 0.527569s
Execution time: 0.541971s
>>>>> Test 9
Execution time: 0.025785s
Execution time: 0.026767s
Execution time: 0.026741s
Execution time: 0.026574s
Execution time: 0.026371s
Execution time: 0.026087s
Execution time: 0.025434s
Execution time: 0.028824s
Execution time: 0.026524s
Execution time: 0.026678s
>>>>> Test 10
Execution time: 0.001532s
Execution time: 0.001547s
Execution time: 0.001624s
Execution time: 0.001673s
Execution time: 0.001534s
Execution time: 0.001536s
Execution time: 0.001574s
Execution time: 0.001528s
Execution time: 0.001552s
Execution time: 0.001567s
>>>>> Test 11
Execution time: 0.052526s
Execution time: 0.065048s
Execution time: 0.052497s
Execution time: 0.052571s
Execution time: 0.052461s
>>>>> Test 12
Execution time: 0.216066s
Execution time: 0.218338s
Execution time: 0.215019s
Execution time: 0.215797s
Execution time: 0.221573s
Execution time: 0.220560s
Execution time: 0.226893s
Execution time: 0.221215s
Execution time: 0.227494s
Execution time: 0.223021s
>>>>> End Commit Output
opt_commit: True, binary_reward: 1, reward: 1.1929472952648736
