This roadmap outlines the planned features and improvements for the v0.1 release of DistillKitPlus, targeted for May 2025. The goal is to enhance the core distillation capabilities, improve usability, and establish a foundation for future development.
- Support for different teacher/student architectures (e.g., cross-architecture distillation).
- Implement additional distillation loss functions (e.g., MinED).
- Improve logging and progress tracking during distillation.
- Add documentation for core components.
Community contributions and feedback are welcome! Feel free to comment on this issue or open new issues for specific suggestions or bug reports.