-
Notifications
You must be signed in to change notification settings - Fork 3.5k
Lightning Lite Examples #9987
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Lightning Lite Examples #9987
Changes from 250 commits
Commits
Show all changes
385 commits
Select commit
Hold shift + click to select a range
8ddb777
move scheduler
awaelchli c2b4b74
convert
awaelchli 0d430c5
fix precision + dataloader wrapping for DP
awaelchli 5d09298
Merge remote-tracking branch 'origin/lite-poc' into lightning-lite/li…
awaelchli 2a21ad9
remove unused import
awaelchli 23d6786
Merge branch 'master' into lightning-lite/litghtning-lite
awaelchli eeff843
Update pl_examples/lite_examples/simple/mnist_example.py
kaushikb11 3f7a2ce
Update pl_examples/lite_examples/simple/mnist_example.py
kaushikb11 61c825c
Add LightningLite Example (#9991)
tchaton 21ada36
call process_dataloader()
awaelchli 1bc966c
Merge branch 'master' into lightning-lite/litghtning-lite
awaelchli 6dd770f
refactor spawn
awaelchli 724c2a9
update new_process
awaelchli 866e14d
call accelerator.setup_environment()
awaelchli a2e576b
set_device
awaelchli ce1b3ce
Merge branch 'master' into lightning-lite/litghtning-lite
awaelchli 6005040
remove unused methods
awaelchli 6674f01
Update TPUSpawn plugin to support Lightning Lite (#9999)
kaushikb11 5bdde62
move tpu optimizer step
awaelchli dab9532
Merge branch 'master' into lightning-lite/litghtning-lite
awaelchli 9f4943c
clean up imports
awaelchli 365fc8d
remove distributed_backend
awaelchli f63b85e
access protected methods
awaelchli 2b77ce2
update precision handling in sharded
awaelchli db00696
sharded spawn
awaelchli 71a6489
add spawn shaded support
awaelchli 0a06e85
add zero grad stub to LiteOptimizer
awaelchli fd9a4d6
Merge branch 'master' into lightning-lite/litghtning-lite
awaelchli a488fd9
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 072fff0
Remove TPUAcc check in setup_dataloaders
kaushikb11 cd2f0d6
trigger ci
awaelchli 4ed755b
Add parity tests for LightningLite vs. pure PyTorch (#10002)
tchaton 75100ad
update test
tchaton 72b47cd
Add tests for Lite wrappers (#10048)
awaelchli fe65b74
update closure
awaelchli b4a0c4a
update zero_grad
awaelchli e5bd182
tests for device
awaelchli 809767e
Merge branch 'master' into lightning-lite/litghtning-lite
awaelchli 74b11eb
merge conflict fixes
awaelchli 4c81c78
add tests for distributed sampler
awaelchli b33dda2
update is_distrib access
awaelchli 68c74ac
Merge branch 'master' into lightning-lite/lite-poc
awaelchli 5935ce4
remove comment
awaelchli 12de35c
update spawn() for tpu_spawn plugin
awaelchli 56271bc
update bloat check
awaelchli 0758aff
Merge branch 'lightning-lite/test-setup-data' into lightning-lite/lit…
awaelchli 7b83347
update optimizer step test
awaelchli 4f0d82a
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] f86fd6f
add guards to example
awaelchli eeee4e8
Merge remote-tracking branch 'origin/lite-poc' into lightning-lite/li…
awaelchli f703112
move scrips to debug folder for removal later on
awaelchli 3421372
test invalid choices
awaelchli 3744ea4
test to_device
awaelchli d197b49
save checkpoint
awaelchli 806fffc
Merge branch 'lightning-lite/tests' into lightning-lite/lite-poc
awaelchli 2551877
update test description
awaelchli 5c46acd
document public api
awaelchli 98c8066
add api docs for wrappers
awaelchli 76f2d6a
Merge branch 'lightning-lite/tests' into lightning-lite/lite-poc
awaelchli 079fd27
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] a4e035c
simple tests
awaelchli b14f22e
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] eadc10d
Add more LightningLite tests (#10047)
tchaton c74b231
merge all tests together
awaelchli b4310ad
_num_models checks
awaelchli 143aef8
use decorator for patching
awaelchli 08cd122
docs for deepspeed special case
awaelchli f8a0f45
rename wrapper for sharded context
awaelchli 0b30c8e
add todo
awaelchli 538f6de
improve typing
tchaton ae7af78
delete debug examples
awaelchli fadca44
Fix sampler not being defined bug
kaushikb11 2074c8b
Add support for auto with the accelerator flag
kaushikb11 63fd036
failing assert for strategy.model
awaelchli 240f95b
support Accelerator object and TrainingType strategy object to be pas…
awaelchli 56e3b7a
support vararg optimizer sequence input to setup()
awaelchli a6cf010
remove redundant Iterable annotation from setup_dataloaders since we …
awaelchli 070fa23
to_device overload for mypy
awaelchli 6aa4ac0
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 0838ea9
harden tests for setup()
awaelchli e6e2895
simplify test
awaelchli 314da4a
fix mypy for setup() return type
awaelchli 5efbfb3
organize
awaelchli 676f765
remove dataloader type check (already checked above)
awaelchli f1716f8
Merge branch 'master' into lightning-lite/lite-poc
awaelchli 04e1b41
update examples, setup() syntax
awaelchli 024fa6a
skip test if dependency not available
awaelchli 3e446d9
skip test if deepspeed unavailable
awaelchli 18c58fd
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 186ed8d
test run() input outputs
awaelchli 442a184
re-organize tests
awaelchli 3539f2c
rename
awaelchli 1510661
Add LightningLite documentation (#10043)
tchaton 2d88340
remove "mixed"
awaelchli 3171bee
fix title levels
awaelchli 8d3e33d
fix spacing
awaelchli ce86e6e
fix title levels
awaelchli bad8356
add optional name to barrier
awaelchli 8e5ddc3
re-add "mixed" as it is defined in NativeMixedPrecisionPlugin
awaelchli d987133
add lite flags section
awaelchli 25c5b99
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 86c163e
Update docs/source/starter/lightning_lite.rst
awaelchli ae1d793
Add documentation for essential methods
awaelchli 9382fa4
add spacers
awaelchli 219de45
add save_checkpoint, barrier to docs
awaelchli 66a3f1f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] ec7565f
Merge branch 'master' into lightning-lite/lite-poc
awaelchli 16ac4df
update lite with latest master changes
awaelchli debe472
remove unused method in tpu spawn
awaelchli f3cb163
remove unused import
awaelchli 1687387
fix precommit formatting issue
awaelchli 5d0a72b
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 7906eb3
remove reduce_decision and execute_on_rank
awaelchli 4550510
Merge branch 'master' into lightning-lite/lite-poc
awaelchli 0482860
update on comments
tchaton 2359d0c
Add barrier for TPU Spawn
kaushikb11 915438f
Merge branch 'master' into lightning-lite/lite-poc
awaelchli 889e319
Merge branch 'master' into lightning-lite/lite-poc
awaelchli d566082
Add Mnist examples with lite (#10131)
tchaton f22ac90
update
tchaton b914b74
update
tchaton 2969f68
update
tchaton 57f82e9
update
tchaton bc082a9
resolve doctest
tchaton ef6b591
resolve mypy
tchaton c90aff5
update
tchaton fd8660c
switch to Any
tchaton 4f8e3a5
update
tchaton e5fd5b6
update
tchaton bca53f6
update
tchaton e0cee6a
resolve bugs
tchaton 144eee4
update
tchaton 2c6214b
Revert "switch to Any"
tchaton 2ccae27
try to fix mypy
awaelchli 0f11f70
x
awaelchli d2c27dc
Merge branch 'master' into lightning-lite/lite-poc
awaelchli 782c70f
lightning lite package and tests
awaelchli be39098
update changelog
awaelchli 824c11d
update test to ensure spawn result
awaelchli 81636fe
Add sleep to fix the rendezous error
kaushikb11 34b0e89
Merge branch 'master' into lightning-lite/lite-core
tchaton e45f736
update
tchaton 0deceba
Docstrings and CHANGELOG
carmocca 5d14e83
Fixes to previous commit. Mention devices=auto (not yet implemented).…
carmocca 11862e8
Fix test
carmocca ffed5ce
Fix test
carmocca 538b969
Merge branch 'lightning-lite/lite-core' of https://github.com/PyTorch…
carmocca c614cf0
Improve Lite Examples (#10195)
tchaton 93b7940
update
tchaton 13587df
Merge branch 'master' into lightning-lite/lite-core
awaelchli 84ac310
Merge branch 'master' into lightning-lite/lite-poc
awaelchli cf34e7b
Merge branch 'master' into lightning-lite/lite-core
awaelchli a6414a2
update access to deepspeed internal vars
awaelchli 2e55f6c
Merge branch 'master' into lightning-lite/lite-poc
awaelchli 5e1aeb8
fix check for multiple models in deepspeed
awaelchli f885b35
fix deepspeed precision
awaelchli de4ef79
update
tchaton 7a474a7
Merge branch 'master' into lite-poc
tchaton 7f62394
update
tchaton 5546084
Merge branch 'master' into lightning-lite/lite-core
awaelchli db34e09
fix line too long
awaelchli 992fd45
Minor changes
carmocca b8d44ce
remove identity wrapper
awaelchli 732de7a
Merge remote-tracking branch 'origin/lightning-lite/lite-core' into l…
awaelchli 04094c3
Same annotations as Lightning which are identical to those in torch
carmocca 1d9920a
Add comment
carmocca a6df052
Simplify _LiteOptimizer
carmocca 5208e19
Didn't mean to remove this :)
carmocca 31406ae
rename cast to autocast
awaelchli bda0f8a
test: Remove unused parametrization
carmocca c34d006
rename save_checkpoint to save
awaelchli f45c2c8
update docstring
awaelchli c84acb1
update comment
awaelchli ddd7c4f
Merge remote-tracking branch 'origin/lightning-lite/lite-core' into l…
awaelchli 92752e6
add load
awaelchli c0ffc71
tests: update autocast use
carmocca af40009
add test for autocast
awaelchli eb9b92e
simplify test
awaelchli 3e261e1
add test description
awaelchli 5754ad7
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 85fe0cf
remove "mixed" string support
awaelchli 91a6b3c
More mixed references
carmocca f45a97a
Implement `seed_everything`
carmocca b543655
Merge branch 'master' into lightning-lite/lite-core
awaelchli ba7ac5f
add isinstance check
awaelchli f04b398
add bfloat16
awaelchli 229b024
rename params_on_cpu
awaelchli 95db246
Pass down the barrier name
carmocca 0c8e914
Add back __del__
carmocca a93278d
Fix mypy
carmocca 65e289b
Fix test
carmocca d408228
Add worker init fn
carmocca 952e11c
Forgot to pass the global rank
carmocca 50d5124
add back skip of expensive spawn test
awaelchli 13fb58a
resolve todo in _LiteModule
awaelchli 2e92fe1
Merge remote-tracking branch 'origin/lightning-lite/lite-core' into l…
awaelchli 9a1e93f
Add seed everything test
carmocca f47c2ad
fix type error
awaelchli 4c40d71
Merge branch 'lightning-lite/lite-core' into lightning-lite/lite-poc
awaelchli d7b430f
Update pl_examples/basic_examples/mnist_examples/image_classifier_2_l…
awaelchli d51c71c
Update pl_examples/basic_examples/mnist_examples/image_classifier_2_l…
awaelchli 5b5fbd5
update on master
tchaton ae2fe70
update examples
tchaton 3d4a5ef
update
tchaton 0ffc7d2
update
tchaton 1b3fb60
update
tchaton 357869e
replace links with file paths
awaelchli 70067df
fix link
awaelchli 24f0ff4
typos, grammar, fix links
awaelchli 2cd5ba4
create a sentence
awaelchli 99acc1e
duplicate fixes
awaelchli 68fcf07
Merge branch 'master' into lite-poc
tchaton b5e9a94
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] 3e100f7
fix changelog
awaelchli e01da0b
typos and formatting in mnist lite/lightning examples
awaelchli c385998
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] eb53884
fixes for loop example mnist_lite
awaelchli d32f428
undo gitignore changes
awaelchli ac75983
use strategy arg
awaelchli b441745
backticks for run
awaelchli 15588c5
Merge remote-tracking branch 'origin/lite-poc' into lightning-lite/li…
awaelchli 8045e0c
auto accelerator and devices
awaelchli 5b6243f
update comments about dp/strategy
awaelchli 51ca1e6
address a couple missed commens from ari
awaelchli 9fd0bba
Update pl_examples/basic_examples/README.md
awaelchli 60a65dc
update links, latest -> stable
awaelchli f33911d
switch order in run_examples.sh
awaelchli 6e76183
capitalization
awaelchli d644ba6
Merge remote-tracking branch 'origin/lite-poc' into lightning-lite/li…
awaelchli 6c7e630
Update pl_examples/basic_examples/README.md
awaelchli be1d820
Update pl_examples/basic_examples/README.md
awaelchli 138f4f5
Merge branch 'master' into lite-poc
tchaton 09ccc0d
update on comments
tchaton a27d0e3
hotfix
tchaton 8a970ac
update
tchaton fd3d286
update
tchaton 29bb0c9
update
tchaton 3b9496b
remove test.py
tchaton 8139093
update
tchaton af13b28
update
tchaton af1ad85
update
tchaton 389e535
update
tchaton b4b63fb
update
tchaton 3b82b57
update
tchaton 7a88161
update
tchaton c05a102
Merge branch 'master' into lite-poc
tchaton 506fc19
update
tchaton 81ea111
update
tchaton 5209601
update
tchaton 33b8758
update
tchaton File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.