Uploading data

Ingest data through the UI, SDK or connect your own cloud storage.

You can add data to your datasets on Mindkosh in a few different ways.

Uploading using the UI

You can upload most data types directly from the UI. To do this, either create a new dataset, or select an existing dataset. On the dataset page, click on the Add files button at the top. Then you can upload your data by simply dragging and dropping your files. Note that you will only see files with supported file formats for the selected dataset type.

Adding reference images to point clouds (for example for Sensor fusion use cases), is not supported through the UI. These can only be added using the SDK. The same applies to reference images for other images - for example, depth and thermal images to a RGB image.

Supported formats for Images

PNG (Single channel and RGB), JPG, JPEG, BMP

Supported formats for point clouds

ASCII PCD, Binary PCD, Binary compressed PCD

You can only upload 1000 files at a time using the UI. If you have more files, you can upload them in chunks. However it is recommended that you use the SDK to upload large number of files.

Uploading using SDK

Please refer to the documentation on SDK to see how you can upload data using the SDK. Note that you need an SDK token to be able to use the SDK - please get in touch with us to get one.

Adding data from cloud storage

To add data from your own cloud storage, first make sure that you have added your credentials. Here is a guide on adding your AWS credentials. This is a one-time process. Once you've added your credentials, you can add data any number of times without having to add credentials.

To add data from your AWS bucket, create a new Dataset and select User cloud as the storage location. If you don't see the User cloud, make sure that your credentials have been added by following the guide here.

On selecting User cloud, you will be able to enter the details of your AWS storage.

Location Choose the location of your AWS bucket. Bucket name Enter your bucket name. Note that you need to enter just the bucket name, without prefixes like https or S3, or ending slashes.

Directory Enter the directory that contains the images you want to add to your dataset. Note that we only scan the root directory entered here and skip any sub-directories. Make sure your data is in the directory mentioned here.

For example, if your images are stored in this manner: s3://example_bucket_name/sample_dataset/slice_1/image_0001.png

s3://example_bucket_name/sample_dataset/slice_1/image_0002.png

You would enter, example_bucket_name as the bucket, and sample_dataset/slice_1/ as the directory, and all images in this directory would be added to the dataset.