Dataset Viewer
Viewer
The dataset viewer is not available for this split.
Cannot load the dataset split (in streaming mode) to extract the first rows.
Error code:   StreamingRowsError
Exception:    KeyError
Message:      "There is no item named 'test/network.csv' in the archive"
Traceback:    Traceback (most recent call last):
                File "/src/services/worker/src/worker/utils.py", line 257, in get_rows_or_raise
                  return get_rows(
                File "/src/services/worker/src/worker/utils.py", line 198, in decorator
                  return func(*args, **kwargs)
                File "/src/services/worker/src/worker/utils.py", line 235, in get_rows
                  rows_plus_one = list(itertools.islice(ds, rows_max_number + 1))
                File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/iterable_dataset.py", line 1379, in __iter__
                  for key, example in ex_iterable:
                File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/iterable_dataset.py", line 233, in __iter__
                  yield from self.generate_examples_fn(**self.kwargs)
                File "/tmp/modules-cache/datasets_modules/datasets/NASP--neteval-exam/2551f747ca25cd26f66b3956c0c1a96ade65f8b3e9b2aabbd5fa20d9736c64b8/neteval-exam.py", line 108, in _generate_examples
                  df = pd.read_csv(filepath,encoding="utf-8")
                File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/streaming.py", line 74, in wrapper
                  return function(*args, download_config=download_config, **kwargs)
                File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/download/streaming_download_manager.py", line 765, in xpandas_read_csv
                  return pd.read_csv(xopen(filepath_or_buffer, "rb", download_config=download_config), **kwargs)
                File "/src/services/worker/.venv/lib/python3.9/site-packages/datasets/download/streaming_download_manager.py", line 496, in xopen
                  file_obj = fsspec.open(file, mode=mode, *args, **kwargs).open()
                File "/src/services/worker/.venv/lib/python3.9/site-packages/fsspec/core.py", line 134, in open
                  return self.__enter__()
                File "/src/services/worker/.venv/lib/python3.9/site-packages/fsspec/core.py", line 102, in __enter__
                  f = self.fs.open(self.path, mode=mode)
                File "/src/services/worker/.venv/lib/python3.9/site-packages/fsspec/spec.py", line 1199, in open
                  f = self._open(
                File "/src/services/worker/.venv/lib/python3.9/site-packages/fsspec/implementations/zip.py", line 122, in _open
                  out = self.zip.open(path, mode.strip("b"))
                File "/usr/local/lib/python3.9/zipfile.py", line 1511, in open
                  zinfo = self.getinfo(name)
                File "/usr/local/lib/python3.9/zipfile.py", line 1438, in getinfo
                  raise KeyError(
              KeyError: "There is no item named 'test/network.csv' in the archive"

Need help to make the dataset viewer work? Open a discussion for direct support.

NetEval is a NetOps evaluation suite for foundation models, consisting of 5269 multi-choice questions. Please check our paper for more details about NetEval.

We hope NetEval could help developers track the progress and analyze the NetOps ability of their models.

Citation

Please cite our paper if you use our dataset.

@misc{miao2023empirical,
      title={An Empirical Study of NetOps Capability of Pre-Trained Large Language Models}, 
      author={Yukai Miao and Yu Bai and Li Chen and Dan Li and Haifeng Sun and Xizheng Wang and Ziqiu Luo and Dapeng Sun and Xiuting Xu and Qi Zhang and Chao Xiang and Xinchi Li},
      year={2023},
      eprint={2309.05557},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
Downloads last month
0
Edit dataset card
Evaluate models HF Leaderboard