Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The latest version doesn't support perceptron model #978

Open
linjing-lab opened this issue Oct 12, 2023 · 0 comments
Open

The latest version doesn't support perceptron model #978

linjing-lab opened this issue Oct 12, 2023 · 0 comments

Comments

@linjing-lab
Copy link

linjing-lab commented Oct 12, 2023

As a developer concentrated in mathematical optimization and machine learning approaches, I released a software named perming integrated with PyTorch to deal with supervised learning problems based on perceptron model.

As far as I concerned, Perceptron-based model and algorithm will make the hidden differentiable latent space to represent linearly separable high-dimensional data, so I think it is important to upgrade dask_ml project by developing perceptron algorithm integrated with parallel computing and compiled operators, like activation function included relu, tanh, and so on.

For example, I adopt operators released by PyTorch to make any supervised learning task conform to target and tabular data possible, and I wrap numpy.ndarray dataset to torch.Tensor for a high efficiency in processing cuda computation. Morever, the early_stop stage was involved in training and validation of any algoithm in perming. The underlying code is the simple configuration of perming:

import perming # pip install perming
main = perming.Box(10, 3, (30,), batch_size=8, activation='relu', inplace_on=True, solver='sgd', criterion='MultiLabelSoftMarginLoss', learning_rate_init=0.01)
main.data_loader(X, y, random_seed=0)
main.train_val(num_epochs=60, interval=25, tolerance=1e-4, patience=10, early_stop=True)
main.test()

main.model can be deployed to any pipeline related to predicative task, so I recommend dask_ml to release perceptron model for a more compatible support in processing linear inseparable dataset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant