Self-Distillation is a tool designed to help models learn new skills without forgetting past knowledge. It builds on the On-Policy Self-Distillation algorithm from the research paper "Self-Distillation Enables Continual Learning". This software allows users to run effective experiments using just one H200 GPU.
In this guide, you will learn how to download and run Self-Distillation on your system. You do not need programming knowledge to follow these steps.
- Operating System: Windows 10 or MacOS (Linux support is also available)
- GPU: H200 GPU recommended for best performance
- Memory: At least 8 GB of RAM
- Storage: Minimum of 1 GB free space for installation and data
To get started, you need to visit the Releases page and download the software.
Once you are on the Releases page:
- Look for the latest version of Self-Distillation.
- Locate the download link for your operating system.
- Click the link to download the installation file.
- After downloading, locate the installation file on your computer. This file is usually in your "Downloads" folder.
- Double-click the file to start the installation process.
- Follow the on-screen instructions to complete the installation. This may include agreeing to terms and conditions and choosing an installation location.
Once the installation is complete, you can run the software.
- Find the Self-Distillation application in your start menu or applications folder.
- Click to open the application.
- Use the interface to set up your experiments based on your preferences.
Self-Distillation allows you to conduct a variety of experiments focused on continual learning:
- Simple Configuration: Easy setup for running experiments.
- On-Policy Learning: Helps your models learn directly from demonstrations.
- Low Resource Usage: Efficient enough to run on a single H200 GPU.
- Select Your Dataset: Choose the dataset you want to work with from the options available in the application.
- Adjust Parameters: Set the learning parameters based on your needs. The software provides default values that are suitable for most users.
- Run Your Experiment: Press the "Start" button to begin the experiment.
While the experiment runs, you can monitor various metrics through the interface. This will help you understand how well your model is learning and if it needs adjustments.
If you encounter issues during installation or use, consider the following:
- Installation Fails: Ensure your operating system meets the above requirements. Verify that you downloaded the correct version.
- Performance Issues: If the application runs slowly, try closing other applications to free up memory.
- Error Messages: Refer to the user manual for explanations of common error messages. Support documentation is available on our Wiki.
For more guidance and advanced features, check out our documentation and community forums:
If you need further assistance, please reach out to our support team. You can submit issues directly on GitHub or use our contact form on the website.
Start your journey in continual learning with Self-Distillation today!