Running tests...
Capturing agent diff from: /logs/artifacts/testbed
rm 'datasets/atomic/dummy/atomic/1.1.0/dummy_data.zip'
Removed binary: datasets/atomic/dummy/atomic/1.1.0/dummy_data.zip
rm 'datasets/conceptnet5/dummy/conceptnet5/5.7.0/dummy_data.zip'
Removed binary: datasets/conceptnet5/dummy/conceptnet5/5.7.0/dummy_data.zip
rm 'datasets/conceptnet5/dummy/omcs_sentences_free/5.7.0/dummy_data.zip'
Removed binary: datasets/conceptnet5/dummy/omcs_sentences_free/5.7.0/dummy_data.zip
rm 'datasets/conceptnet5/dummy/omcs_sentences_more/5.7.0/dummy_data.zip'
Removed binary: datasets/conceptnet5/dummy/omcs_sentences_more/5.7.0/dummy_data.zip
rm 'datasets/lama/dummy/conceptnet/1.1.0/dummy_data.zip'
Removed binary: datasets/lama/dummy/conceptnet/1.1.0/dummy_data.zip
rm 'datasets/lama/dummy/google_re/1.1.0/dummy_data.zip'
Removed binary: datasets/lama/dummy/google_re/1.1.0/dummy_data.zip
rm 'datasets/lama/dummy/squad/1.1.0/dummy_data.zip'
Removed binary: datasets/lama/dummy/squad/1.1.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_belief/1115.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_belief/1115.0.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_belief_sentences/1115.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_belief_sentences/1115.0.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_candidate/1110.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_candidate/1110.0.0/dummy_data.zip
rm 'datasets/nell/dummy/nell_candidate_sentences/1110.0.0/dummy_data.zip'
Removed binary: datasets/nell/dummy/nell_candidate_sentences/1110.0.0/dummy_data.zip
rm 'datasets/ollie/dummy/ollie_lemmagrep/1.1.0/dummy_data.zip'
Removed binary: datasets/ollie/dummy/ollie_lemmagrep/1.1.0/dummy_data.zip
rm 'datasets/ollie/dummy/ollie_patterned/1.1.0/dummy_data.zip'
Removed binary: datasets/ollie/dummy/ollie_patterned/1.1.0/dummy_data.zip
Patch size: 14361 bytes
HEAD is now at 99c5ad9 base
Baked origin refs missing; fetching from origin at verify time (network_mode=public)...
From https://github.com/huggingface/datasets
 * [new branch]          1.18.X                 -> origin/1.18.X
 * [new branch]          2.10                   -> origin/2.10
 * [new branch]          2.13                   -> origin/2.13
 * [new branch]          2.14                   -> origin/2.14
 * [new branch]          2.19                   -> origin/2.19
 * [new branch]          2.21                   -> origin/2.21
 * [new branch]          2.21-bis               -> origin/2.21-bis
 * [new branch]          2.6                    -> origin/2.6
 * [new branch]          2.7                    -> origin/2.7
 * [new branch]          PathLike-save_to_disk  -> origin/PathLike-save_to_disk
 * [new branch]          add-allow-empty-for-parquet-conversion -> origin/add-allow-empty-for-parquet-conversion
 * [new branch]          add-error_bad_chunk-to-json-loader -> origin/add-error_bad_chunk-to-json-loader
 * [new branch]          add-iterable-dataset-decode -> origin/add-iterable-dataset-decode
 * [new branch]          add-pq-extension       -> origin/add-pq-extension
 * [new branch]          add-repo_id-info       -> origin/add-repo_id-info
 * [new branch]          align-remove_columns-in-formatted-case -> origin/align-remove_columns-in-formatted-case
 * [new branch]          cfahlgren1/add-jsonl-sample-by-document -> origin/cfahlgren1/add-jsonl-sample-by-document
 * [new branch]          cfahlgren1/agent-traces-prompt-sent-at -> origin/cfahlgren1/agent-traces-prompt-sent-at
 * [new branch]          chore/add-dependabot-github-actions -> origin/chore/add-dependabot-github-actions
 * [new branch]          ci-csv-path            -> origin/ci-csv-path
 * [new branch]          ci-fix-test_load_dataset_distributed_with_script -> origin/ci-fix-test_load_dataset_distributed_with_script
 * [new branch]          ci-test-2.21           -> origin/ci-test-2.21
 * [new branch]          ci-test-20240523       -> origin/ci-test-20240523
 * [new branch]          ci-test-20240723       -> origin/ci-test-20240723
 * [new branch]          ci-test-array-cast     -> origin/ci-test-array-cast
 * [new branch]          ci-test-cast           -> origin/ci-test-cast
 * [new branch]          ci-test-ci             -> origin/ci-test-ci
 * [new branch]          ci-test-errors         -> origin/ci-test-errors
 * [new branch]          ci-test-fsspec         -> origin/ci-test-fsspec
 * [new branch]          ci-test-fsspec-2023.10.0 -> origin/ci-test-fsspec-2023.10.0
 * [new branch]          ci-test-fsspec-2023.12.1 -> origin/ci-test-fsspec-2023.12.1
 * [new branch]          ci-test-hf-folder-auth-token -> origin/ci-test-hf-folder-auth-token
 * [new branch]          ci-test-hub-20240708   -> origin/ci-test-hub-20240708
 * [new branch]          ci-test-huggingface-hub-0.29.0.rc6 -> origin/ci-test-huggingface-hub-0.29.0.rc6
 * [new branch]          ci-test-huggingface-hub-0.30.0.rc1 -> origin/ci-test-huggingface-hub-0.30.0.rc1
 * [new branch]          ci-test-huggingface-hub-1.10.0.rc0-release -> origin/ci-test-huggingface-hub-1.10.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.10.0.rc1-release -> origin/ci-test-huggingface-hub-1.10.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.11.0.rc0-release -> origin/ci-test-huggingface-hub-1.11.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.12.0.rc0-release -> origin/ci-test-huggingface-hub-1.12.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.12.0.rc1-release -> origin/ci-test-huggingface-hub-1.12.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.13.0.rc0-release -> origin/ci-test-huggingface-hub-1.13.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.14.0.rc0-release -> origin/ci-test-huggingface-hub-1.14.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.15.0.rc0-release -> origin/ci-test-huggingface-hub-1.15.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.16.0.rc0-release -> origin/ci-test-huggingface-hub-1.16.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.17.0.rc0-release -> origin/ci-test-huggingface-hub-1.17.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.18.0.rc0-release -> origin/ci-test-huggingface-hub-1.18.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.19.0.rc1-release -> origin/ci-test-huggingface-hub-1.19.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.20.0.rc0-release -> origin/ci-test-huggingface-hub-1.20.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.21.0.rc0-release -> origin/ci-test-huggingface-hub-1.21.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.7.0.rc0-release -> origin/ci-test-huggingface-hub-1.7.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.7.0.rc1-release -> origin/ci-test-huggingface-hub-1.7.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-1.8.0.rc0-release -> origin/ci-test-huggingface-hub-1.8.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-1.9.0.rc0-release -> origin/ci-test-huggingface-hub-1.9.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.16.0.rc0 -> origin/ci-test-huggingface-hub-v0.16.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.17.0.rc0 -> origin/ci-test-huggingface-hub-v0.17.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.18.0.rc0 -> origin/ci-test-huggingface-hub-v0.18.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.19.0.rc0 -> origin/ci-test-huggingface-hub-v0.19.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.20.0.rc1 -> origin/ci-test-huggingface-hub-v0.20.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.21.0.rc0 -> origin/ci-test-huggingface-hub-v0.21.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.22.0.rc0 -> origin/ci-test-huggingface-hub-v0.22.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.22.0.rc1 -> origin/ci-test-huggingface-hub-v0.22.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.23.0.rc0 -> origin/ci-test-huggingface-hub-v0.23.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.23.0.rc1 -> origin/ci-test-huggingface-hub-v0.23.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.24.0.rc0 -> origin/ci-test-huggingface-hub-v0.24.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.25.0.rc0 -> origin/ci-test-huggingface-hub-v0.25.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.25.0.rc1 -> origin/ci-test-huggingface-hub-v0.25.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.26.0.rc0 -> origin/ci-test-huggingface-hub-v0.26.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.27.0.rc0 -> origin/ci-test-huggingface-hub-v0.27.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.28.0.rc0 -> origin/ci-test-huggingface-hub-v0.28.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc0 -> origin/ci-test-huggingface-hub-v0.29.0.rc0
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc1 -> origin/ci-test-huggingface-hub-v0.29.0.rc1
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc2 -> origin/ci-test-huggingface-hub-v0.29.0.rc2
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc5 -> origin/ci-test-huggingface-hub-v0.29.0.rc5
 * [new branch]          ci-test-huggingface-hub-v0.29.0.rc7 -> origin/ci-test-huggingface-hub-v0.29.0.rc7
 * [new branch]          ci-test-huggingface-hub-v0.29.3.rc0 -> origin/ci-test-huggingface-hub-v0.29.3.rc0
 * [new branch]          ci-test-huggingface-hub-v0.30.0.rc3-release -> origin/ci-test-huggingface-hub-v0.30.0.rc3-release
 * [new branch]          ci-test-huggingface-hub-v0.31.0.rc0-release -> origin/ci-test-huggingface-hub-v0.31.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.32.0.rc0-release -> origin/ci-test-huggingface-hub-v0.32.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.32.0.rc1-release -> origin/ci-test-huggingface-hub-v0.32.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v0.33.0.rc0-release -> origin/ci-test-huggingface-hub-v0.33.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.34.0.rc0-release -> origin/ci-test-huggingface-hub-v0.34.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.35.0.rc0-release -> origin/ci-test-huggingface-hub-v0.35.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v0.35.0.rc1-release -> origin/ci-test-huggingface-hub-v0.35.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v0.36.0.rc0-release -> origin/ci-test-huggingface-hub-v0.36.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc0-release -> origin/ci-test-huggingface-hub-v1.0.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc1-release -> origin/ci-test-huggingface-hub-v1.0.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc2-release -> origin/ci-test-huggingface-hub-v1.0.0.rc2-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc3-release -> origin/ci-test-huggingface-hub-v1.0.0.rc3-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc4-release -> origin/ci-test-huggingface-hub-v1.0.0.rc4-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc5-release -> origin/ci-test-huggingface-hub-v1.0.0.rc5-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc6-release -> origin/ci-test-huggingface-hub-v1.0.0.rc6-release
 * [new branch]          ci-test-huggingface-hub-v1.0.0.rc7-release -> origin/ci-test-huggingface-hub-v1.0.0.rc7-release
 * [new branch]          ci-test-huggingface-hub-v1.1.0.rc0-release -> origin/ci-test-huggingface-hub-v1.1.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.1.0.rc1-release -> origin/ci-test-huggingface-hub-v1.1.0.rc1-release
 * [new branch]          ci-test-huggingface-hub-v1.1.0.rc2-release -> origin/ci-test-huggingface-hub-v1.1.0.rc2-release
 * [new branch]          ci-test-huggingface-hub-v1.2.0.rc0-release -> origin/ci-test-huggingface-hub-v1.2.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.3.0.rc0-release -> origin/ci-test-huggingface-hub-v1.3.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.4.0.rc0-release -> origin/ci-test-huggingface-hub-v1.4.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.5.0.rc0-release -> origin/ci-test-huggingface-hub-v1.5.0.rc0-release
 * [new branch]          ci-test-huggingface-hub-v1.6.0.rc0-release -> origin/ci-test-huggingface-hub-v1.6.0.rc0-release
 * [new branch]          ci-test-node-down      -> origin/ci-test-node-down
 * [new branch]          ci-test-np-2           -> origin/ci-test-np-2
 * [new branch]          ci-test-num-examples   -> origin/ci-test-num-examples
 * [new branch]          ci-test-numpy-2.0.0    -> origin/ci-test-numpy-2.0.0
 * [new branch]          ci-test-pyarrow-vuln   -> origin/ci-test-pyarrow-vuln
 * [new branch]          ci-test-sequence-dtype -> origin/ci-test-sequence-dtype
 * [new branch]          ci-test-tuple-protocol -> origin/ci-test-tuple-protocol
 * [new branch]          conda-4.6.0            -> origin/conda-4.6.0
 * [new branch]          conda-release-3.1.0    -> origin/conda-release-3.1.0
 * [new branch]          data-page-v2           -> origin/data-page-v2
 * [new branch]          datasets-2.19.1-hotfix -> origin/datasets-2.19.1-hotfix
 * [new branch]          demo-lazy-decoding     -> origin/demo-lazy-decoding
 * [new branch]          deprecate-search       -> origin/deprecate-search
 * [new branch]          dev-3.0                -> origin/dev-3.0
 * [new branch]          download-partial-dataset -> origin/download-partial-dataset
 * [new branch]          download_and_prepare-if-missing-splits -> origin/download_and_prepare-if-missing-splits
 * [new branch]          drop-data_files_duplicates -> origin/drop-data_files_duplicates
 * [new branch]          dummy                  -> origin/dummy
 * [new branch]          eliebak-patch-1        -> origin/eliebak-patch-1
 * [new branch]          fix-4796               -> origin/fix-4796
 * [new branch]          fix-6147               -> origin/fix-6147
 * [new branch]          fix-6880               -> origin/fix-6880
 * [new branch]          fix-7037               -> origin/fix-7037
 * [new branch]          fix-ci-numpy-numba     -> origin/fix-ci-numpy-numba
 * [new branch]          fix-expected-splits-when-passing-data_files-or-dir -> origin/fix-expected-splits-when-passing-data_files-or-dir
 * [new branch]          fix-set_default        -> origin/fix-set_default
 * [new branch]          fix-spawning-on-macos  -> origin/fix-spawning-on-macos
 * [new branch]          fix-zero-proba-interleave_datasets -> origin/fix-zero-proba-interleave_datasets
 * [new branch]          fix-zstd               -> origin/fix-zstd
 * [new branch]          fsspec-fixes           -> origin/fsspec-fixes
 * [new branch]          image-type-inference   -> origin/image-type-inference
 * [new branch]          large_convert_to_parquet -> origin/large_convert_to_parquet
 * [new branch]          lazy-data_files_resolution -> origin/lazy-data_files_resolution
 * [new branch]          main                   -> origin/main
 * [new branch]          map-decode             -> origin/map-decode
 * [new branch]          move-exceptions-to-utils -> origin/move-exceptions-to-utils
 * [new branch]          overload-load_dataset  -> origin/overload-load_dataset
 * [new branch]          release-2.14.5         -> origin/release-2.14.5
 * [new branch]          release-conda          -> origin/release-conda
 * [new branch]          release-conda-4.2.0    -> origin/release-conda-4.2.0
 * [new branch]          release-conda-5.0.0    -> origin/release-conda-5.0.0
 * [new branch]          resolve-data_files-by-split-name -> origin/resolve-data_files-by-split-name
 * [new branch]          retrieve-cached-no-script-datasets -> origin/retrieve-cached-no-script-datasets
 * [new branch]          retry-streaming-hub-error -> origin/retry-streaming-hub-error
 * [new branch]          security-fix/-github-workflows-release-conda-yml-1780939856 -> origin/security-fix/-github-workflows-release-conda-yml-1780939856
 * [new branch]          speedup_file_downloads -> origin/speedup_file_downloads
 * [new branch]          split_dataset_by_node-same-number-of-examples -> origin/split_dataset_by_node-same-number-of-examples
 * [new branch]          stas00-patch-1         -> origin/stas00-patch-1
 * [new branch]          stevhliu-patch-1       -> origin/stevhliu-patch-1
 * [new branch]          test-convert-parquet   -> origin/test-convert-parquet
 * [new branch]          test-disable-transformer-containers-in-docs-ci -> origin/test-disable-transformer-containers-in-docs-ci
 * [new branch]          v2.13-release          -> origin/v2.13-release
 * [new branch]          v2.14-release          -> origin/v2.14-release
 * [new branch]          v2.14.6-patch          -> origin/v2.14.6-patch
 * [new branch]          v2.14.7-patch          -> origin/v2.14.7-patch
 * [new branch]          v2.21.0-release        -> origin/v2.21.0-release
 * [new tag]             0.0.2                  -> 0.0.2
 * [new tag]             0.0.3                  -> 0.0.3
 * [new tag]             0.1.0                  -> 0.1.0
 * [new tag]             0.2.0                  -> 0.2.0
 * [new tag]             0.2.1                  -> 0.2.1
 * [new tag]             0.3.0                  -> 0.3.0
 * [new tag]             0.4.0                  -> 0.4.0
 * [new tag]             1.0.0                  -> 1.0.0
 * [new tag]             1.0.1                  -> 1.0.1
 * [new tag]             1.0.2                  -> 1.0.2
 * [new tag]             1.1.0                  -> 1.1.0
 * [new tag]             1.1.1                  -> 1.1.1
 * [new tag]             1.1.2                  -> 1.1.2
 * [new tag]             1.1.3                  -> 1.1.3
 * [new tag]             1.10.0                 -> 1.10.0
 * [new tag]             1.10.1                 -> 1.10.1
 * [new tag]             1.10.2                 -> 1.10.2
 * [new tag]             1.11.0                 -> 1.11.0
 * [new tag]             1.12.0                 -> 1.12.0
 * [new tag]             1.12.1                 -> 1.12.1
 * [new tag]             1.13.0                 -> 1.13.0
 * [new tag]             1.13.1                 -> 1.13.1
 * [new tag]             1.13.2                 -> 1.13.2
 * [new tag]             1.13.3                 -> 1.13.3
 * [new tag]             1.14.0                 -> 1.14.0
 * [new tag]             1.15.0                 -> 1.15.0
 * [new tag]             1.15.1                 -> 1.15.1
 * [new tag]             1.16.0                 -> 1.16.0
 * [new tag]             1.16.1                 -> 1.16.1
 * [new tag]             1.17.0                 -> 1.17.0
 * [new tag]             1.18.0                 -> 1.18.0
 * [new tag]             1.18.1                 -> 1.18.1
 * [new tag]             1.18.2                 -> 1.18.2
 * [new tag]             1.18.3                 -> 1.18.3
 * [new tag]             1.18.4                 -> 1.18.4
 * [new tag]             1.2.0                  -> 1.2.0
 * [new tag]             1.2.1                  -> 1.2.1
 * [new tag]             1.3.0                  -> 1.3.0
 * [new tag]             1.4.0                  -> 1.4.0
 * [new tag]             1.4.1                  -> 1.4.1
 * [new tag]             1.5.0                  -> 1.5.0
 * [new tag]             1.6.0                  -> 1.6.0
 * [new tag]             1.6.1                  -> 1.6.1
 * [new tag]             1.6.2                  -> 1.6.2
 * [new tag]             1.7.0                  -> 1.7.0
 * [new tag]             1.8.0                  -> 1.8.0
 * [new tag]             1.9.0                  -> 1.9.0
 * [new tag]             2.0.0                  -> 2.0.0
 * [new tag]             2.1.0                  -> 2.1.0
 * [new tag]             2.10.0                 -> 2.10.0
 * [new tag]             2.10.1                 -> 2.10.1
 * [new tag]             2.11.0                 -> 2.11.0
 * [new tag]             2.12.0                 -> 2.12.0
 * [new tag]             2.13.0                 -> 2.13.0
 * [new tag]             2.13.1                 -> 2.13.1
 * [new tag]             2.13.2                 -> 2.13.2
 * [new tag]             2.14.0                 -> 2.14.0
 * [new tag]             2.14.1                 -> 2.14.1
 * [new tag]             2.14.2                 -> 2.14.2
 * [new tag]             2.14.3                 -> 2.14.3
 * [new tag]             2.14.4                 -> 2.14.4
 * [new tag]             2.14.5                 -> 2.14.5
 * [new tag]             2.14.6                 -> 2.14.6
 * [new tag]             2.14.7                 -> 2.14.7
 * [new tag]             2.15.0                 -> 2.15.0
 * [new tag]             2.16.0                 -> 2.16.0
 * [new tag]             2.16.1                 -> 2.16.1
 * [new tag]             2.17.0                 -> 2.17.0
 * [new tag]             2.17.1                 -> 2.17.1
 * [new tag]             2.18.0                 -> 2.18.0
 * [new tag]             2.19.0                 -> 2.19.0
 * [new tag]             2.19.1                 -> 2.19.1
 * [new tag]             2.19.2                 -> 2.19.2
 * [new tag]             2.2.0                  -> 2.2.0
 * [new tag]             2.2.1                  -> 2.2.1
 * [new tag]             2.2.2                  -> 2.2.2
 * [new tag]             2.20.0                 -> 2.20.0
 * [new tag]             2.21.0                 -> 2.21.0
 * [new tag]             2.3.0                  -> 2.3.0
 * [new tag]             2.3.1                  -> 2.3.1
 * [new tag]             2.3.2                  -> 2.3.2
 * [new tag]             2.4.0                  -> 2.4.0
 * [new tag]             2.5.0                  -> 2.5.0
 * [new tag]             2.5.1                  -> 2.5.1
 * [new tag]             2.5.2                  -> 2.5.2
 * [new tag]             2.6.0                  -> 2.6.0
 * [new tag]             2.6.1                  -> 2.6.1
 * [new tag]             2.6.2                  -> 2.6.2
 * [new tag]             2.7.0                  -> 2.7.0
 * [new tag]             2.7.1                  -> 2.7.1
 * [new tag]             2.8.0                  -> 2.8.0
 * [new tag]             2.9.0                  -> 2.9.0
 * [new tag]             3.0.0                  -> 3.0.0
 * [new tag]             3.0.1                  -> 3.0.1
 * [new tag]             3.0.2                  -> 3.0.2
 * [new tag]             3.1.0                  -> 3.1.0
 * [new tag]             3.2.0                  -> 3.2.0
 * [new tag]             3.3.0                  -> 3.3.0
 * [new tag]             3.3.1                  -> 3.3.1
 * [new tag]             3.3.2                  -> 3.3.2
 * [new tag]             3.4.0                  -> 3.4.0
 * [new tag]             3.4.1                  -> 3.4.1
 * [new tag]             3.5.0                  -> 3.5.0
 * [new tag]             3.5.1                  -> 3.5.1
 * [new tag]             3.6.0                  -> 3.6.0
 * [new tag]             4.0.0                  -> 4.0.0
 * [new tag]             4.1.0                  -> 4.1.0
 * [new tag]             4.1.1                  -> 4.1.1
 * [new tag]             4.2.0                  -> 4.2.0
 * [new tag]             4.3.0                  -> 4.3.0
 * [new tag]             4.4.0                  -> 4.4.0
 * [new tag]             4.4.1                  -> 4.4.1
 * [new tag]             4.4.2                  -> 4.4.2
 * [new tag]             4.5.0                  -> 4.5.0
 * [new tag]             4.6.0                  -> 4.6.0
 * [new tag]             4.6.1                  -> 4.6.1
 * [new tag]             4.7.0                  -> 4.7.0
 * [new tag]             4.8.0                  -> 4.8.0
 * [new tag]             4.8.1                  -> 4.8.1
 * [new tag]             4.8.2                  -> 4.8.2
 * [new tag]             4.8.3                  -> 4.8.3
 * [new tag]             4.8.4                  -> 4.8.4
 * [new tag]             4.8.5                  -> 4.8.5
 * [new tag]             5.0.0                  -> 5.0.0
 * [new tag]             alpha                  -> alpha
 * [new tag]             delete                 -> delete
Removing .pytest_cache/
Removing datasets/flores/dummy/sien/1.1.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/encs/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enda/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ende/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enel/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enes/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enet/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enfi/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enfr/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enga/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enhr/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enhu/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enit/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enlt/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enlv/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enmt/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ennl/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enpl/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enpt/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/enro/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ensk/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ensl/1.0.0/dummy_data-zip-extracted/
Removing datasets/para_crawl/dummy/ensv/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/aztr_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/be_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/beru_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/es_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/fr_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/gl_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/glpt_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/he_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/it_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/pt_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/ru_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/ru_to_pt/1.0.0/dummy_data-zip-extracted/
Removing datasets/ted_hrlr/dummy/tr_to_en/1.0.0/dummy_data-zip-extracted/
Removing datasets/xtreme/dummy/XQuAD.ar/1.0.0/dummy_data-zip-extracted/
Removing reference_result.json
HEAD is now at 06fcc085f support droid agent traces (#8263)
Checking out base repo...
Note: switching to '599403601739e7a73e8ebbc8653d246e07207265^'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at e60c99fbb [Docs] How to use with PyTorch page (#4474)
Installing repo...
Using CPython 3.9.20
Creating virtual environment at: .venv
/testbed/.venv/bin/python
Python 3.9.20
Resolved 34 packages in 974ms
Prepared 34 packages in 765ms
Installed 34 packages in 58ms
 + aiohappyeyeballs==2.6.1
 + aiohttp==3.13.5
 + aiosignal==1.4.0
 + async-timeout==5.0.1
 + attrs==26.1.0
 + certifi==2026.6.17
 + charset-normalizer==3.4.7
 + datasets==2.2.3.dev0 (from file:///testbed)
 + dill==0.3.5.1
 + filelock==3.19.1
 + frozenlist==1.8.0
 + fsspec==2025.10.0
 + hf-xet==1.5.1
 + huggingface-hub==0.36.2
 + idna==3.18
 + multidict==6.7.1
 + multiprocess==0.70.13
 + numpy==2.0.2
 + packaging==26.2
 + pandas==2.3.3
 + propcache==0.4.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2026.2
 + pyyaml==6.0.3
 + requests==2.32.5
 + responses==0.18.0
 + six==1.17.0
 + tqdm==4.68.3
 + typing-extensions==4.15.0
 + tzdata==2026.2
 + urllib3==2.6.3
 + xxhash==3.7.1
 + yarl==1.22.0
Resolved 1 package in 21ms
Prepared 1 package in 253ms
Uninstalled 1 package in 51ms
Installed 1 package in 41ms
 - pyarrow==21.0.0
 + pyarrow==20.0.0
Resolved 13 packages in 150ms
Prepared 6 packages in 73ms
Installed 6 packages in 15ms
 + absl-py==2.3.1
 + decorator==5.3.1
 + greenlet==3.2.5
 + pillow==11.3.0
 + sqlalchemy==2.0.51
 + zstandard==0.25.0
Name: datasets
Version: 2.2.3.dev0
Location: /testbed/.venv/lib/python3.9/site-packages
Requires: aiohttp, dill, fsspec, huggingface-hub, multiprocess, numpy, packaging, pandas, pyarrow, requests, responses, tqdm, xxhash
Required-by:
>>>>> Init Succeeded
Running performance test before patch...
Running test /tests/gso_test_0.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_1.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_2.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x79745711dac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7152ea6ddac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x76937e69dac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7324a53dcac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x736ef01deac0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_3.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_4.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_5.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_6.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x745f81d1ea50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7d819931fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71661da5fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71f3a3a5fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7e74010a0a50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7cb78149fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7d8b7089fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x74a420b1fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c546985fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x74e3c369fa50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_7.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_8.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x755a71adda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x786a9fb1da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7fec8e1dda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7db8a165da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x72f45549da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x70dc3169da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x769e409dda50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x781ec709da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x73f58569da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7ae84705da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_9.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_10.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x72c52419b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ed9b949b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7345b7adb9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7605c3e5b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x79976e11b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71bea0f1b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7b4960ddb9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x75853829b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x777e4945b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ff75b11b9e0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_11.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x773115d1da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7eed6d80ca50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7648c969da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x774a8851da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x77b2b165da50> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_12.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Applying patch...
Skipped patch 'datasets/atomic/dataset_infos.json'.
Skipped patch 'datasets/conceptnet5/dataset_infos.json'.
Skipped patch 'datasets/lama/dataset_infos.json'.
Skipped patch 'datasets/nell/dataset_infos.json'.
Skipped patch 'datasets/ollie/dataset_infos.json'.
Skipped patch 'reference_result.json'.
Checking patch .circleci/deploy.sh...
Checking patch convert_dataset.sh...
Checking patch datasets/atomic/README.md...
Checking patch datasets/atomic/atomic.py...
Checking patch datasets/conceptnet5/README.md...
Checking patch datasets/conceptnet5/conceptnet5.py...
Checking patch datasets/generics_kb/generics_kb.py...
Checking patch datasets/lama/README.md...
Checking patch datasets/lama/lama.py...
Checking patch datasets/nell/README.md...
Checking patch datasets/nell/nell.py...
Checking patch datasets/ollie/README.md...
Checking patch datasets/ollie/ollie.py...
Checking patch datasets/proto_qa/proto_qa.py...
Checking patch datasets/ro_sts/ro_sts.py...
Checking patch datasets/ro_sts_parallel/README.md...
Checking patch datasets/ro_sts_parallel/ro_sts_parallel.py...
Checking patch src/datasets/arrow_dataset.py...
Checking patch src/datasets/fingerprint.py...
Checking patch src/datasets/formatting/formatting.py...
Checking patch src/datasets/table.py...
Applied patch .circleci/deploy.sh cleanly.
Applied patch convert_dataset.sh cleanly.
Applied patch datasets/atomic/README.md cleanly.
Applied patch datasets/atomic/atomic.py cleanly.
Applied patch datasets/conceptnet5/README.md cleanly.
Applied patch datasets/conceptnet5/conceptnet5.py cleanly.
Applied patch datasets/generics_kb/generics_kb.py cleanly.
Applied patch datasets/lama/README.md cleanly.
Applied patch datasets/lama/lama.py cleanly.
Applied patch datasets/nell/README.md cleanly.
Applied patch datasets/nell/nell.py cleanly.
Applied patch datasets/ollie/README.md cleanly.
Applied patch datasets/ollie/ollie.py cleanly.
Applied patch datasets/proto_qa/proto_qa.py cleanly.
Applied patch datasets/ro_sts/ro_sts.py cleanly.
Applied patch datasets/ro_sts_parallel/README.md cleanly.
Applied patch datasets/ro_sts_parallel/ro_sts_parallel.py cleanly.
Applied patch src/datasets/arrow_dataset.py cleanly.
Applied patch src/datasets/fingerprint.py cleanly.
Applied patch src/datasets/formatting/formatting.py cleanly.
Applied patch src/datasets/table.py cleanly.
Successfully applied patch using git apply --verbose
>>>>> Applied Patch
Installing repo...
Using CPython 3.9.20
Creating virtual environment at: .venv
/testbed/.venv/bin/python
Python 3.9.20
Resolved 34 packages in 961ms
Prepared 34 packages in 714ms
Installed 34 packages in 59ms
 + aiohappyeyeballs==2.6.1
 + aiohttp==3.13.5
 + aiosignal==1.4.0
 + async-timeout==5.0.1
 + attrs==26.1.0
 + certifi==2026.6.17
 + charset-normalizer==3.4.7
 + datasets==2.2.3.dev0 (from file:///testbed)
 + dill==0.3.5.1
 + filelock==3.19.1
 + frozenlist==1.8.0
 + fsspec==2025.10.0
 + hf-xet==1.5.1
 + huggingface-hub==0.36.2
 + idna==3.18
 + multidict==6.7.1
 + multiprocess==0.70.13
 + numpy==2.0.2
 + packaging==26.2
 + pandas==2.3.3
 + propcache==0.4.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2026.2
 + pyyaml==6.0.3
 + requests==2.32.5
 + responses==0.18.0
 + six==1.17.0
 + tqdm==4.68.3
 + typing-extensions==4.15.0
 + tzdata==2026.2
 + urllib3==2.6.3
 + xxhash==3.7.1
 + yarl==1.22.0
Resolved 1 package in 111ms
Prepared 1 package in 258ms
Uninstalled 1 package in 34ms
Installed 1 package in 35ms
 - pyarrow==21.0.0
 + pyarrow==20.0.0
Resolved 13 packages in 172ms
Prepared 6 packages in 48ms
Installed 6 packages in 14ms
 + absl-py==2.3.1
 + decorator==5.3.1
 + greenlet==3.2.5
 + pillow==11.3.0
 + sqlalchemy==2.0.51
 + zstandard==0.25.0
Name: datasets
Version: 2.2.3.dev0
Location: /testbed/.venv/lib/python3.9/site-packages
Requires: aiohttp, dill, fsspec, huggingface-hub, multiprocess, numpy, packaging, pandas, pyarrow, requests, responses, tqdm, xxhash
Required-by:
>>>>> Init Succeeded
Running performance test after patch...
Running test /tests/gso_test_0.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_1.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_2.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71afbc0bc200> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x79a254a61200> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7aae718bc200> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71b0fe8bd200> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c66d49fd200> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_3.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_4.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_5.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_6.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x76f53a15b190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7175ea8db190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x76def3f5b190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7a49e1f5b190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7be0e3edb190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x78fd0255b190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7e5527c9b190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x76b39f2db190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x75d3c6d5b190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x728cd9a5a190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_7.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_8.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x779e5a0a8190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7724a7929190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7410c46e8190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x79b21fee9190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x796532169190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x740cc9b45190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x71cf678e8190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7c3561566190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7422068ea190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x76a2fb9a9190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_9.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_10.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7caa6ed2e120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7e04ffdae120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x74cac401f120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7cf368728120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x722bc992e120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7fbf28eee120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x715ecc72e120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x71baa18ee120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7bd957cee120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x72f67a05f120> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_11.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x74c7b1715190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x74a145016190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7ff6f8696190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7dc174815190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x724eb5555190> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_12.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
>>>>> Start Base Output
>>>>> Test 0
Execution time: 0.218298s
Execution time: 0.224637s
Execution time: 0.216120s
Execution time: 0.227000s
Execution time: 0.232133s
Execution time: 0.226268s
Execution time: 0.264390s
Execution time: 0.243477s
Execution time: 0.249243s
Execution time: 0.218449s
>>>>> Test 1
Execution time: 0.004059s
Execution time: 0.004202s
Execution time: 0.004080s
Execution time: 0.004445s
Execution time: 0.003967s
Execution time: 0.003992s
Execution time: 0.003987s
Execution time: 0.004018s
Execution time: 0.004084s
Execution time: 0.004093s
>>>>> Test 2
Execution time: 0.839296s
Execution time: 0.922673s
Execution time: 0.942708s
Execution time: 0.914284s
Execution time: 0.887901s
>>>>> Test 3
Execution time: 0.491440s
Execution time: 0.467425s
Execution time: 0.459616s
Execution time: 0.463056s
Execution time: 0.450475s
>>>>> Test 4
Execution time: 0.053184s
Execution time: 0.053363s
Execution time: 0.053078s
Execution time: 0.052832s
Execution time: 0.056545s
>>>>> Test 5
Execution time: 0.004363s
Execution time: 0.004455s
Execution time: 0.005606s
Execution time: 0.004632s
Execution time: 0.004475s
Execution time: 0.004480s
Execution time: 0.004512s
Execution time: 0.004663s
Execution time: 0.004156s
Execution time: 0.004104s
>>>>> Test 6
Execution time: 0.004552s
Execution time: 0.004558s
Execution time: 0.004494s
Execution time: 0.004551s
Execution time: 0.004489s
Execution time: 0.004507s
Execution time: 0.004586s
Execution time: 0.004515s
Execution time: 0.004598s
Execution time: 0.004999s
>>>>> Test 7
Execution time: 0.005856s
Execution time: 0.006224s
Execution time: 0.005864s
Execution time: 0.007227s
Execution time: 0.005983s
Execution time: 0.005972s
Execution time: 0.007663s
Execution time: 0.007398s
Execution time: 0.007679s
Execution time: 0.005912s
>>>>> Test 8
Execution time: 0.736190s
Execution time: 0.747607s
Execution time: 0.731448s
Execution time: 0.726742s
Execution time: 0.733778s
Execution time: 0.694669s
Execution time: 0.712056s
Execution time: 0.687501s
Execution time: 0.724636s
Execution time: 0.707566s
>>>>> Test 9
Execution time: 0.037727s
Execution time: 0.037259s
Execution time: 0.034678s
Execution time: 0.038125s
Execution time: 0.033954s
Execution time: 0.039878s
Execution time: 0.035531s
Execution time: 0.034974s
Execution time: 0.034024s
Execution time: 0.034123s
>>>>> Test 10
Execution time: 0.002119s
Execution time: 0.002117s
Execution time: 0.002088s
Execution time: 0.002305s
Execution time: 0.002134s
Execution time: 0.002296s
Execution time: 0.002797s
Execution time: 0.002212s
Execution time: 0.002074s
Execution time: 0.002022s
>>>>> Test 11
Execution time: 0.082121s
Execution time: 0.075261s
Execution time: 0.079537s
Execution time: 0.074938s
Execution time: 0.074616s
>>>>> Test 12
Execution time: 0.283713s
Execution time: 0.299624s
Execution time: 0.290937s
Execution time: 0.320349s
Execution time: 0.282091s
Execution time: 0.445213s
Execution time: 0.297433s
Execution time: 0.339686s
Execution time: 0.332475s
Execution time: 0.350504s
>>>>> End Base Output
>>>>> Start Patch Output
>>>>> Test 0
Execution time: 0.005653s
Execution time: 0.005707s
Execution time: 0.004984s
Execution time: 0.006531s
Execution time: 0.007851s
Execution time: 0.006654s
Execution time: 0.006066s
Execution time: 0.005868s
Execution time: 0.006070s
Execution time: 0.006076s
>>>>> Test 1
Execution time: 0.001068s
Execution time: 0.001148s
Execution time: 0.000927s
Execution time: 0.001070s
Execution time: 0.001123s
Execution time: 0.001052s
Execution time: 0.001107s
Execution time: 0.000860s
Execution time: 0.000777s
Execution time: 0.000805s
>>>>> Test 2
Execution time: 0.153330s
Execution time: 0.157011s
Execution time: 0.185924s
Execution time: 0.164400s
Execution time: 0.170636s
>>>>> Test 3
Execution time: 0.100998s
Execution time: 0.099283s
Execution time: 0.090322s
Execution time: 0.107472s
Execution time: 0.089032s
>>>>> Test 4
Execution time: 0.029782s
Execution time: 0.029273s
Execution time: 0.024707s
Execution time: 0.024742s
Execution time: 0.028859s
>>>>> Test 5
Execution time: 0.002376s
Execution time: 0.002630s
Execution time: 0.002576s
Execution time: 0.002465s
Execution time: 0.002597s
Execution time: 0.002575s
Execution time: 0.002402s
Execution time: 0.002712s
Execution time: 0.003098s
Execution time: 0.002415s
>>>>> Test 6
Execution time: 0.002792s
Execution time: 0.002960s
Execution time: 0.004151s
Execution time: 0.002925s
Execution time: 0.002758s
Execution time: 0.002720s
Execution time: 0.003115s
Execution time: 0.002767s
Execution time: 0.002668s
Execution time: 0.002690s
>>>>> Test 7
Execution time: 0.003389s
Execution time: 0.003372s
Execution time: 0.003315s
Execution time: 0.003409s
Execution time: 0.003385s
Execution time: 0.003637s
Execution time: 0.004331s
Execution time: 0.004958s
Execution time: 0.004606s
Execution time: 0.003463s
>>>>> Test 8
Execution time: 0.687253s
Execution time: 0.740485s
Execution time: 0.681776s
Execution time: 0.697371s
Execution time: 0.708860s
Execution time: 0.721143s
Execution time: 0.688052s
Execution time: 0.689419s
Execution time: 0.695643s
Execution time: 0.724462s
>>>>> Test 9
Execution time: 0.034430s
Execution time: 0.034311s
Execution time: 0.037664s
Execution time: 0.034620s
Execution time: 0.031911s
Execution time: 0.036325s
Execution time: 0.032341s
Execution time: 0.031986s
Execution time: 0.031995s
Execution time: 0.032344s
>>>>> Test 10
Execution time: 0.001487s
Execution time: 0.001454s
Execution time: 0.001535s
Execution time: 0.001434s
Execution time: 0.001632s
Execution time: 0.001719s
Execution time: 0.001558s
Execution time: 0.001445s
Execution time: 0.001452s
Execution time: 0.001529s
>>>>> Test 11
Execution time: 0.048933s
Execution time: 0.041630s
Execution time: 0.046147s
Execution time: 0.041792s
Execution time: 0.042567s
>>>>> Test 12
Execution time: 0.284745s
Execution time: 0.279633s
Execution time: 0.271484s
Execution time: 0.265998s
Execution time: 0.281561s
Execution time: 0.276472s
Execution time: 0.274523s
Execution time: 0.269857s
Execution time: 0.284867s
Execution time: 0.270000s
>>>>> End Patch Output
Removing base_0.txt
Removing base_1.txt
Removing base_10.txt
Removing base_11.txt
Removing base_12.txt
Removing base_2.txt
Removing base_3.txt
Removing base_4.txt
Removing base_5.txt
Removing base_6.txt
Removing base_7.txt
Removing base_8.txt
Removing base_9.txt
Removing build/
Removing gso_0_result.json
Removing gso_10_result.json
Removing gso_11_result.json
Removing gso_12_result.json
Removing gso_1_result.json
Removing gso_2_result.json
Removing gso_3_result.json
Removing gso_4_result.json
Removing gso_5_result.json
Removing gso_6_result.json
Removing gso_7_result.json
Removing gso_8_result.json
Removing gso_9_result.json
Removing result_0.txt
Removing result_1.txt
Removing result_10.txt
Removing result_11.txt
Removing result_12.txt
Removing result_2.txt
Removing result_3.txt
Removing result_4.txt
Removing result_5.txt
Removing result_6.txt
Removing result_7.txt
Removing result_8.txt
Removing result_9.txt
Removing src/datasets.egg-info/
HEAD is now at 06fcc085f support droid agent traces (#8263)
Checking out commit...
Previous HEAD position was 06fcc085f support droid agent traces (#8263)
HEAD is now at 599403601 Optimize contiguous shard and select (#4466)
Installing repo...
Using CPython 3.9.20
Creating virtual environment at: .venv
/testbed/.venv/bin/python
Python 3.9.20
Resolved 34 packages in 970ms
Prepared 34 packages in 700ms
Installed 34 packages in 86ms
 + aiohappyeyeballs==2.6.1
 + aiohttp==3.13.5
 + aiosignal==1.4.0
 + async-timeout==5.0.1
 + attrs==26.1.0
 + certifi==2026.6.17
 + charset-normalizer==3.4.7
 + datasets==2.2.3.dev0 (from file:///testbed)
 + dill==0.3.5.1
 + filelock==3.19.1
 + frozenlist==1.8.0
 + fsspec==2025.10.0
 + hf-xet==1.5.1
 + huggingface-hub==0.36.2
 + idna==3.18
 + multidict==6.7.1
 + multiprocess==0.70.13
 + numpy==2.0.2
 + packaging==26.2
 + pandas==2.3.3
 + propcache==0.4.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2026.2
 + pyyaml==6.0.3
 + requests==2.32.5
 + responses==0.18.0
 + six==1.17.0
 + tqdm==4.68.3
 + typing-extensions==4.15.0
 + tzdata==2026.2
 + urllib3==2.6.3
 + xxhash==3.7.1
 + yarl==1.22.0
Resolved 1 package in 38ms
Prepared 1 package in 284ms
Uninstalled 1 package in 34ms
Installed 1 package in 46ms
 - pyarrow==21.0.0
 + pyarrow==20.0.0
Resolved 13 packages in 153ms
Prepared 6 packages in 67ms
Installed 6 packages in 15ms
 + absl-py==2.3.1
 + decorator==5.3.1
 + greenlet==3.2.5
 + pillow==11.3.0
 + sqlalchemy==2.0.51
 + zstandard==0.25.0
Name: datasets
Version: 2.2.3.dev0
Location: /testbed/.venv/lib/python3.9/site-packages
Requires: aiohttp, dill, fsspec, huggingface-hub, multiprocess, numpy, packaging, pandas, pyarrow, requests, responses, tqdm, xxhash
Required-by:
>>>>> Init Succeeded
Running performance test for commit...
Running test /tests/gso_test_0.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_1.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_2.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c114ec9cc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x736597bddc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x76598bc5dc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7c6b91e9dc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x73883d49dc10> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_3.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_4.py 5 times...
  Iteration 1/5
  Iteration 2/5
  Iteration 3/5
  Iteration 4/5
  Iteration 5/5
>>>>> Tests Passed
Running test /tests/gso_test_5.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_6.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ff1869e0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ad2108dfba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7f461d320ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7e985c0d8ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x731fa48a0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x773f28e5fba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x760b51aa0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7eb16bca0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x74cb8dea0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x791d040a0ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_7.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_8.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7e629531eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x73ee9de9eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7fe56e120ba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x76170ac9eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7bbcfabdeba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x774ac4d1eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7ca3c671eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7406ff71eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x76da786deba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.contiguous_generator at 0x7fee2169eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_9.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
Running test /tests/gso_test_10.py 10 times...
  Iteration 1/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x720e20b1bb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7de386bdbb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ab9d405cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x76299b83fb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x75940a51ab30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 6/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x707273a9cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 7/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x798b534dbb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 8/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x7ad957e5cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 9/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x757b1529cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 10/10
Parameter 'indices'=<generator object experiment.<locals>.<genexpr> at 0x74ccf1d1cb30> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_11.py 5 times...
  Iteration 1/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7f3a0269eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 2/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x733af4a5eba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 3/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x77def63ddba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 4/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7b95a3fddba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
  Iteration 5/5
Parameter 'indices'=<generator object setup.<locals>.<genexpr> at 0x7ce3cabdcba0> of the transform datasets.arrow_dataset.Dataset.select couldn't be hashed properly, a random hash was used instead. Make sure your transforms and parameters are serializable with pickle or dill for the dataset fingerprinting and caching to work. If you reuse this transform, the caching mechanism will consider it to be different from the previous calls and recompute everything. This warning is only showed once. Subsequent hashing failures won't be showed.
>>>>> Tests Passed
Running test /tests/gso_test_12.py 10 times...
  Iteration 1/10
  Iteration 2/10
  Iteration 3/10
  Iteration 4/10
  Iteration 5/10
  Iteration 6/10
  Iteration 7/10
  Iteration 8/10
  Iteration 9/10
  Iteration 10/10
>>>>> Tests Passed
>>>>> Start Commit Output
>>>>> Test 0
Execution time: 0.034132s
Execution time: 0.035277s
Execution time: 0.029851s
Execution time: 0.028908s
Execution time: 0.029892s
Execution time: 0.044384s
Execution time: 0.029522s
Execution time: 0.028499s
Execution time: 0.029225s
Execution time: 0.028892s
>>>>> Test 1
Execution time: 0.000918s
Execution time: 0.001077s
Execution time: 0.000902s
Execution time: 0.000837s
Execution time: 0.000894s
Execution time: 0.000846s
Execution time: 0.000753s
Execution time: 0.000820s
Execution time: 0.000761s
Execution time: 0.000803s
>>>>> Test 2
Execution time: 0.264071s
Execution time: 0.260724s
Execution time: 0.256693s
Execution time: 0.266174s
Execution time: 0.255852s
>>>>> Test 3
Execution time: 0.177191s
Execution time: 0.164257s
Execution time: 0.156636s
Execution time: 0.178290s
Execution time: 0.145341s
>>>>> Test 4
Execution time: 0.025049s
Execution time: 0.031859s
Execution time: 0.029046s
Execution time: 0.024856s
Execution time: 0.026546s
>>>>> Test 5
Execution time: 0.003298s
Execution time: 0.002706s
Execution time: 0.002552s
Execution time: 0.003973s
Execution time: 0.002671s
Execution time: 0.002671s
Execution time: 0.002540s
Execution time: 0.002927s
Execution time: 0.002495s
Execution time: 0.002654s
>>>>> Test 6
Execution time: 0.003531s
Execution time: 0.003097s
Execution time: 0.003015s
Execution time: 0.003421s
Execution time: 0.003448s
Execution time: 0.004298s
Execution time: 0.002964s
Execution time: 0.003106s
Execution time: 0.003070s
Execution time: 0.003063s
>>>>> Test 7
Execution time: 0.004129s
Execution time: 0.004188s
Execution time: 0.005086s
Execution time: 0.004148s
Execution time: 0.004256s
Execution time: 0.004727s
Execution time: 0.004595s
Execution time: 0.004136s
Execution time: 0.004203s
Execution time: 0.004356s
>>>>> Test 8
Execution time: 0.619477s
Execution time: 0.577381s
Execution time: 0.579203s
Execution time: 0.552845s
Execution time: 0.543707s
Execution time: 0.549761s
Execution time: 0.547328s
Execution time: 0.532225s
Execution time: 0.517975s
Execution time: 0.534319s
>>>>> Test 9
Execution time: 0.026622s
Execution time: 0.026193s
Execution time: 0.027853s
Execution time: 0.026766s
Execution time: 0.030505s
Execution time: 0.026578s
Execution time: 0.026475s
Execution time: 0.027075s
Execution time: 0.031298s
Execution time: 0.027218s
>>>>> Test 10
Execution time: 0.001650s
Execution time: 0.001601s
Execution time: 0.001646s
Execution time: 0.001602s
Execution time: 0.001666s
Execution time: 0.001735s
Execution time: 0.001752s
Execution time: 0.001746s
Execution time: 0.001592s
Execution time: 0.001618s
>>>>> Test 11
Execution time: 0.052457s
Execution time: 0.060127s
Execution time: 0.063085s
Execution time: 0.058576s
Execution time: 0.054119s
>>>>> Test 12
Execution time: 0.223410s
Execution time: 0.233762s
Execution time: 0.228045s
Execution time: 0.236763s
Execution time: 0.228822s
Execution time: 0.250067s
Execution time: 0.267830s
Execution time: 0.251437s
Execution time: 0.231550s
Execution time: 0.236595s
>>>>> End Commit Output
opt_commit: True, binary_reward: 1, reward: 1.2213847341037725
