Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hello; how to fix this error; Error importing optional module IPython.core.display #48

Open
tianhao909 opened this issue Dec 17, 2024 · 1 comment

Comments

@tianhao909
Copy link

$python -m vidur.main \

--replica_config_device a100
--replica_config_model_name meta-llama/Meta-Llama-3-8B
--cluster_config_num_replicas 1
--replica_config_tensor_parallel_size 1
--replica_config_num_pipeline_stages 1
--request_generator_config_type synthetic
--synthetic_request_generator_config_num_requests 512
--length_generator_config_type trace
--trace_request_length_generator_config_max_tokens 16384
--trace_request_length_generator_config_trace_file ./data/processed_traces/splitwise_conv.csv
--interval_generator_config_type poisson
--poisson_request_interval_generator_config_qps 6.45
--replica_scheduler_config_type sarathi
--sarathi_scheduler_config_batch_size_cap 512
--sarathi_scheduler_config_chunk_size 512
--random_forrest_execution_time_predictor_config_prediction_max_prefill_chunk_size 16384
--random_forrest_execution_time_predictor_config_prediction_max_batch_size 512
--random_forrest_execution_time_predictor_config_prediction_max_tokens_per_request 16384
INFO 12-17 16:26:28 trace_request_length_generator.py:78] Loaded request length trace file ./data/processed_traces/splitwise_conv.csv with 19366 requests

INFO 12-17 16:26:54 simulator.py:60] Starting simulation with cluster: Cluster({'id': 0, 'num_replicas': 1}) and 512 requests
INFO 12-17 16:26:55 simulator.py:80] Simulation ended at: 85.98978289077179s
INFO 12-17 16:26:55 simulator.py:83] Writing output
Error importing optional module IPython.core.display
Traceback (most recent call last):
File "/home/xiaohao.fth/.conda/envs/vidur02/lib/python3.10/site-packages/_plotly_utils/optional_imports.py", line 28, in get_module
return import_module(name)
File "/home/xiaohao.fth/.conda/envs/vidur02/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 992, in _find_and_load_unlocked
File "", line 241, in _call_with_frames_removed
File "", line 1050, in _gcd_import

@renyinCheng001
Copy link

I had the same problem and it seems to be caused by IPython and my IPython version is 8.31.0

(vidur) user@s04:~/project25/vidur$ python -m vidur.main
INFO 01-17 17:14:43 simulator.py:60] Starting simulation with cluster: Cluster({'id': 0, 'num_replicas': 1}) and 128 requests
INFO 01-17 17:14:45 simulator.py:80] Simulation ended at: 240.50675835545405s
INFO 01-17 17:14:45 simulator.py:83] Writing output
Error importing optional module IPython.core.display
Traceback (most recent call last):
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/_plotly_utils/optional_imports.py", line 28, in get_module
    return import_module(name)
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/__init__.py", line 55, in <module>
    from .terminal.embed import embed
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/terminal/embed.py", line 16, in <module>
    from IPython.terminal.interactiveshell import TerminalInteractiveShell
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/terminal/interactiveshell.py", line 48, in <module>
    from .debugger import TerminalPdb, Pdb
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/site-packages/IPython/terminal/debugger.py", line 18, in <module>
    from concurrent.futures import ThreadPoolExecutor
  File "<frozen importlib._bootstrap>", line 1075, in _handle_fromlist
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/concurrent/futures/__init__.py", line 49, in __getattr__
    from .thread import ThreadPoolExecutor as te
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/concurrent/futures/thread.py", line 37, in <module>
    threading._register_atexit(_python_exit)
  File "/data/node06/user/anaconda3/envs/vidur/lib/python3.10/threading.py", line 1504, in _register_atexit
    raise RuntimeError("can't register atexit after shutdown")
RuntimeError: can't register atexit after shutdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants