Skip to content

Commit

Permalink
update framework image in proposal
Browse files Browse the repository at this point in the history
Signed-off-by: wyoung1 <[email protected]>
  • Loading branch information
wyoung1 committed Sep 20, 2024
1 parent a6e3ccf commit efc193a
Show file tree
Hide file tree
Showing 5 changed files with 4 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -52,9 +52,6 @@ def load(self, model_url=None):
raise Exception(f"model url is None")
```

The overall process is illustrated in the following diagram:
![old process](images/old_process.png)

Based on the above process analysis, we find that the existing multi-edge inference benchmarking job only uses Ianvs to create and manage test cases, where the core algorithmic processes such as multi-device parallelism and model partitioning are left to the user to implement. It is also worth mentioning that the nn.DataParallel(self.model) used in this case only achieves data parallelism, and for scenarios with low computing power on the edge and large models, relying solely on data parallelism is obviously insufficient to support edge inference needs. Therefore, this project needs to implement model parallel capabilities based on model partitioning and encapsulate these capabilities (partitioning and scheduling) into an function, separated from the user's code, as an optional feature in the multiedge_inference paradigm supported by Ianvs.

## Module Design and Code Integration
Expand Down Expand Up @@ -110,7 +107,10 @@ Further, provide the load method of the BaseModel class in the benchmarking job
At the same time, the corresponding multi-edge inference benchmarking job for high-mobility scenarios will be provided in the _examples_ folder.

In conjunction with the process design, the newly added automatic partitioning module will be inserted into the position indicated in the diagram below, thereby forming a new complete flowchart:
![new process](images/new_process.png)
![process](images/process.png)

The following diagram illustrates the framework of the entire system after the modifications:
![framework](images/framework.png)

## Method Desgin
![image](images/partition_method.png)
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Binary file not shown.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit efc193a

Please sign in to comment.