Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

configmixin #152

Merged
merged 1 commit into from
Oct 31, 2023
Merged

configmixin #152

merged 1 commit into from
Oct 31, 2023

Conversation

kong13661
Copy link
Contributor

What type of PR is this?
开源之夏项目,实现一个pipeline,能够方便部署模型。

Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:

/kind bug

/kind enhancement

/kind documentation

What does this PR do / why do we need it:

1.昇思大模型平台是一个集大模型体验、代码托管、模型选型、AI全流程为一体的平台,而TinyMS是昇思MindSpore高阶API工具,旨在让用户快速使用模型等。
2.目前昇思大模型平台的模型使用只支持线上的方式,缺少一种线下的方式。为了方便开发者的使用,需要开发平台的的Lib,通过Lib,可以极简地通过几行代码实现从平台中下载SOTA模型、并进行预训练、训练、微调、推理和评估等

Which issue(s) this PR fixes:

开源之夏项目,实现一个pipeline,能够方便部署模型。尚在开发。

Fixes #

Special notes for your reviewers:

@CLAassistant
Copy link

CLAassistant commented Sep 29, 2023

CLA assistant check
All committers have signed the CLA.

>>> from tinyms.pipeline import AutoModelPileline
>>> model = AutoModelPileline.from_pretrained("model_cache_path", "model_repo")
>>> pred = model(your_input)
```
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

当前支持哪些模型?可否实际提供一个完整跑通的例子?有明确输入参数,输出结果,这样方便看最终的成果。

>>> trainer = AutoTrainerPipeline.from_pretrained("trainer_cache_path", "trainer_repo")
>>> trainer.init_model(model)
>>> trainer.train()
```
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

和上面评论一样

>>> new_trainer.train()
>>>
>>> new_trainer.train(4)

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

和上面评论一样

Copy link
Collaborator

@hellowaywewe hellowaywewe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

有几个问题:
1,当前对支持的MindSpore版本有要求吗?你本地跑的MIndSpore是什么版本?
2,下载的地址是本地+云上的下载都行?云上的地址是必须是你提供的OBS地址吗?

@kong13661
Copy link
Contributor Author

有几个问题: 1,当前对支持的MindSpore版本有要求吗?你本地跑的MIndSpore是什么版本? 2,下载的地址是本地+云上的下载都行?云上的地址是必须是你提供的OBS地址吗?

  1. 对mindspore没有版本要求,没合并之前是什么版本要求,合并之后就是什么版本要求。

  2. 是的,本地云上都可以。云上的地址参考上一回复。

drizzlezyk
drizzlezyk previously approved these changes Oct 31, 2023
hellowaywewe
hellowaywewe previously approved these changes Oct 31, 2023
Copy link
Collaborator

@hellowaywewe hellowaywewe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

delete _internal_config_dict_converted

convert init_subclass to wrapper

trainer_configmixin

sha256 and pretrained. fix wrapper

download from obs

remove test code

image_classification_trainer

append sys

add dict

mindspore dataset

fix bug findFromPreConfig

fix path bug

fix path bug

pathlib

class check

add document

checkfiles

autopipeline

documentation

doc

init
Copy link
Collaborator

@hellowaywewe hellowaywewe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hellowaywewe hellowaywewe merged commit 0945080 into tinyms-ai:main Oct 31, 2023
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants