Skip to content

Commit

Permalink
#3323: Disable mistral7b demo and add warning to README
Browse files Browse the repository at this point in the history
  • Loading branch information
yieldthought authored and mtairum committed Oct 30, 2024
1 parent d1c7eba commit 312d97b
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 2 deletions.
6 changes: 6 additions & 0 deletions models/demos/wormhole/mistral7b/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,12 @@ Demo showcasing Mistral-7B running on Wormhole, using ttnn.

## How to Run

⚠️ **WARNING: DO NOT RUN THIS DEMO FOR NOW** ⚠️

This demo is currently disabled as it has been linked to hardware failures that can permanently damage cards. Please do not attempt to run it until further notice.

[The issue](https://github.com/tenstorrent/cloud/issues/3323) appears to be connected to blown FETs (Field Effect Transistors) that can disable cards. We are investigating the root cause and will update this notice once the demo is confirmed to be safe to run.

### Download the weights

Download the weights tarfile directly from Mistral-AI:
Expand Down
3 changes: 1 addition & 2 deletions models/demos/wormhole/mistral7b/demo/demo.py
Original file line number Diff line number Diff line change
Expand Up @@ -330,8 +330,7 @@ def run_mistral_demo(user_input, batch_size, device, instruct_mode, is_ci_env, n
],
)
def test_mistral7B_demo(device, use_program_cache, input_prompts, instruct_weights, is_ci_env, num_batches):
if is_ci_env:
pytest.skip("Issue #14440: May kill WH cards")
pytest.skip("https://github.com/tenstorrent/cloud/issues/3323: May kill WH cards (internal issue 14440)")

if (is_ci_env and instruct_weights == False) or (is_ci_env and not (num_batches == 1 or num_batches == 3)):
pytest.skip(
Expand Down

0 comments on commit 312d97b

Please sign in to comment.