Skip to content

Run model on CPUs if GPUs are not available - #1683

Closed
elliottslaughter wants to merge 1 commit into
flexflow:masterfrom
elliottslaughter:bin-run-model
Closed

elliottslaughter wants to merge 1 commit into
flexflow:masterfrom
elliottslaughter:bin-run-model

Conversation

@elliottslaughter

@elliottslaughter elliottslaughter commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

This change is Reviewable

lockshaw added a commit that referenced this pull request Sep 16, 2026
The --device-type argument can be set to cpu, gpu, or auto, with auto as
default. When auto is selected, gpu execution is performed when
possible, falling back to cpu execution when gpus are not available.
GPU availability is determined by querying the Realm machine.

Co-authored-by: Colin Unger <lockshaw@lockshaw.net>
@lockshaw

Copy link
Copy Markdown
Collaborator

Merged in f23bf7f6162be8ab77d57d798f8b9cd242944140.

@lockshaw lockshaw closed this Sep 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants