Use bayes Upload data

Here we introduce how to use it bayes Create a dataset. Upload one tiny imagenet Dataset to HyperAI. Merge some additional data into tiny imagenet In the existing dataset versions. And open it from the command line web Interface.

Create a new dataset

$ bayes data create tiny-imagenet -m "Can you briefly explain this tiny-imagenet data set" -o

data set tiny-imagenet (tiQXU5Z5DIy) Created successfully
Open webpage https://hyperai.com/console/username/datasets/tiQXU5Z5DIy View dataset tiny-imagenet (tiQXU5Z5DIy) Detailed Information
Jumping to browser...
Successfully opened browser

Can you introduce a few available parameters:

• -m or --message Dataset Description Information. Can be left blank
• -o or --open After the dataset is successfully created, it will. Open the corresponding in the browser web Interface

At the same time, you can also see the information in the dataset in the printed information on the terminal URL and ID.

Upload folders directly through the command line

stay web We need to package the dataset into zip Only compressed files can be uploaded. However, there is no such restriction through command-line tools. The command-line tool will automatically package and upload compressed files for us. After successful upload, the compressed file will be automatically deleted.

$ bayes data upload tiQXU5Z5DIy -p ~/Downloads/tiny-imagenet-200 -o

Reading file list, please wait a moment...
Excluded from .HyperAIignore Neglected files and folders...
Shared Files 120,205 individual
Compressing dataset...
Compressed dataset completed
Sending upload request to server...
The server has responded
Initializing upload in progress...
Uploading compressed file. Total upload size: 245.9 MiB
124.25 MiB / 245.90 MiB [============================>-----------------------------]  51 %  4.29 MiB/s
Cleaning work in progress
data set tiny-imagenet (RsUdt11TEwb) Upload successful
Open webpage https://hyperai.com/console/username/datasets/RsUdt11TEwb View dataset tiny-imagenet (RsUdt11TEwb) Detailed Information
Jumping to browser...
Successfully opened browser

Command line upload supports breakpoint continuation. If the upload process is interrupted due to an unexpected request. By entering the upload command again, you can choose to continue from the previous upload:

$ bayes data upload tiQXU5Z5DIy -p ~/Downloads/tiny-imagenet-200

HyperAI Upload dataset
There is an unfinished upload. Do you need to continue? [y/N]: y
Uploading compressed file. Total upload size: 245.9 MiB
245.90 MiB / 245.90 MiB [=================================]  100 %  8.87 MiB/s
Cleaning work in progress
data set tiny-imagenet (tiQXU5Z5DIy) Upload successful
Open webpage https://hyperai.com/console/username/datasets/tiQXU5Z5DIy View dataset tiny-imagenet (tiQXU5Z5DIy) Detailed Information

Can you introduce a few available parameters:

• -p or --path Local path of dataset file. If not filled in, use the current directory
• -o or --open It will be uploaded after the dataset is completed. Open the corresponding in the browser web Interface

Wait for the server-side data synchronization, you can see that the dataset has been uploaded:

note

If you already have an existing compressed file that needs to be uploaded to HyperAI. You can use the command bayes data upload tiQXU5Z5DIy -p abc.zip Upload directly. HyperAI It will be decompressed after receiving the compressed file.

note

If you only have one single file that needs to be uploaded to HyperAI. You can also use commands bayes data upload tiQXU5Z5DIy -p afile.xy Upload to HyperAI.

Merge data into the specified version and path of the dataset through the command line

Use the following command. We can merge some additional data into the specified folder of the specified dataset version

bayes data merge tiQXU5Z5DIy --version 1 -d /merge-dir/ -p ~/Downloads/data-to-be-merged -m both -o
Reading file list, please wait a moment...
Excluded from .HyperAIignore Neglected files and folders...
Shared Files 102 individual
Compressing dataset...
Compressed dataset completed
Sending merge request to server...
The server has responded
Initializing upload in progress...
Uploading compressed files that need to be merged. Total merge size: 877.44 KiB
877.44 KiB / 877.44 KiB [==========================================================]  100 %  971.38 KiB/s
Cleaning work in progress
data set tiny-imagenet (RsUdt11TEwb) Merge successful
Open webpage https://hyperai.com/console/username/datasets/RsUdt11TEwb View dataset tiny-imagenet (RsUdt11TEwb) Detailed Information
Jumping to browser...
Successfully opened browser

Can you introduce a few available parameters:

• --version The version number of the dataset that needs to be merged. Required
• -m or --mode Merge method, support skip (skip), both (coexist), replace (replace), If not filled in, it will be used by default replace (replace)
• -d or --directory The specified path for merging dataset files. If not filled in, the root directory will be used by default
• -p or --path Local path of dataset file. If not filled in, use the current directory
• -o or --open After the dataset is successfully merged. Open the corresponding in the browser web Interface

Wait for server-side data synchronization. You can see that the dataset has been merged into the specified version. Click to enter the specified folder. You can see the newly added data.

Open the dataset through the command line web Interface

We can open it directly from the command line using the following command web Interface:

$ bayes data open tiQXU5Z5DIy

Opening dataset https://hyperai.com/console/username/datasets/tiQXU5Z5DIy
Jumping to browser...

perhaps. Add at the end of the upload or merge command -o parameter. The command-line tool will immediately open the corresponding file after the upload or merge is completed web Interface:

$ bayes data upload tiQXU5Z5DIy -p ~/Downloads/tiny-imagenet-200 -o

Reading file list, please wait a moment...
Excluded from .HyperAIignore Neglected files and folders...
Shared Files 120,205 individual
Compressing dataset...
Compressed dataset completed
Sending upload request to server...
The server has responded
Initializing upload in progress...
Uploading compressed file. Total upload size: 245.9 MiB
124.25 MiB / 245.90 MiB [============================>-----------------------------]  51 %  4.29 MiB/s
Cleaning work in progress
data set tiny-imagenet (RsUdt11TEwb) Upload successful
Open webpage https://hyperai.com/console/username/datasets/RsUdt11TEwb View dataset tiny-imagenet (RsUdt11TEwb) Detailed Information
Jumping to browser...
Successfully opened browser