File tree 3 files changed +8
-6
lines changed
lightning_examples/finetuning-scheduler 3 files changed +8
-6
lines changed Original file line number Diff line number Diff line change @@ -6,6 +6,9 @@ docutils>=0.16
6
6
sphinx-paramlinks >= 0.4.0
7
7
ipython [notebook ]
8
8
9
+ # temporarily included until hub available to evaluate finetuning_scheduler
10
+ git+git://github.com/speediedan/pytorch-lightning.git@24d3e43568814ec381ac5be91627629808d62081#egg=pytorch-lightning
11
+
9
12
https://github.com/PyTorchLightning/lightning_sphinx_theme/archive/master.zip#egg=pt-lightning-sphinx-theme
10
13
11
14
-r ../.actions/requirements.txt
Original file line number Diff line number Diff line change 9
9
description : |
10
10
This notebook introduces the FinetuningScheduler callback and demonstrates the use of FinetuningScheduler to finetune
11
11
a small foundational model on the [RTE](https://huggingface.co/datasets/viewer/?dataset=super_glue&config=rte) task
12
- of [SuperGLUE](https://super.gluebenchmark.com/) with iterative earlystopping defined according to a user-specified
13
- schedule. It uses HuggingFace's ``datasets`` and ``transformers`` libraries to retrieve the relevant benchmark data and
14
- foundational model weights.
12
+ of [SuperGLUE](https://super.gluebenchmark.com/) with iterative early-stopping defined according to a user-specified
13
+ schedule. It uses HuggingFace's ``datasets`` and ``transformers`` libraries to retrieve the relevant benchmark data
14
+ and foundational model weights.
15
15
requirements :
16
16
- transformers
17
17
- datasets
18
+ - scikit-learn
18
19
accelerator :
19
20
- GPU
Original file line number Diff line number Diff line change 84
84
# ```
85
85
86
86
# %% [markdown]
87
- # ## EarlyStopping and Epoch-Driven Phase Transition Criteria
87
+ # ## Early-Stopping and Epoch-Driven Phase Transition Criteria
88
88
#
89
89
#
90
90
# By default, ``FTSEarlyStopping`` and epoch-driven
@@ -396,7 +396,6 @@ def __init__(
396
396
model_cfg : Optional [Dict [str , Any ]] = None ,
397
397
task_name : str = DEFAULT_TASK ,
398
398
experiment_tag : str = "default" ,
399
- plot_liveloss : bool = False ,
400
399
):
401
400
"""
402
401
Args:
@@ -414,7 +413,6 @@ def __init__(
414
413
super ().__init__ ()
415
414
self .optimizer_init = optimizer_init
416
415
self .lr_scheduler_init = lr_scheduler_init
417
- self .plot_liveloss = plot_liveloss
418
416
self .pl_lrs_cfg = pl_lrs_cfg or {}
419
417
if task_name in TASK_NUM_LABELS .keys ():
420
418
self .task_name = task_name
You can’t perform that action at this time.
0 commit comments