Skip to content

Merge fbsync into master branch - retire legacy code #1172

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 59 commits into from
Feb 18, 2021

Conversation

zhangguanheng66
Copy link
Contributor

No description provided.

Guanheng Zhang and others added 30 commits March 25, 2020 08:01
fbshipit-source-id: bb7d2eb52240c7223b57c3c9624e61d116e77e39
Summary: [20:45:34: cpuhrsch@devvm3140 pytorch]$ ./fb_build/import_text.sh

Reviewed By: pbelevich

Differential Revision: D21320577

fbshipit-source-id: ac2148b9f0d58e5538443c879845bfb4f6ca7202
Summary: ./fb_build/import_text.sh

Reviewed By: zhangguanheng66

Differential Revision: D21343124

fbshipit-source-id: c08ecad2cc6f439fa40130aeaf91383be9403fe8
Summary: See title

Reviewed By: pbelevich

Differential Revision: D21344211

fbshipit-source-id: a8bcf7f3ab9bb2c2853e27f612e82caa341d3651
Summary: Import torchtext up to pytorch#786

Reviewed By: cpuhrsch

Differential Revision: D21483116

fbshipit-source-id: bc8ab38db9dc9ce4a8734ca8ea991c20e4ef0882
Summary:
Import up to pytorch#798
Addresses T67599333

Reviewed By: zhangguanheng66

Differential Revision: D21764935

fbshipit-source-id: f44d1db637799f2e95f420a8099fbf19545c7cbd
Summary: Import from github master

Reviewed By: zhangguanheng66

Differential Revision: D21886238

fbshipit-source-id: a8f098e299466dd1701fe7ceb6a97c2a2fc54b9d
Summary: Import from github master

Reviewed By: zhangguanheng66

Differential Revision: D21907519

fbshipit-source-id: f22370d97796da5f2cb9f76f506c80f18fefea7f
Summary: Original commit changeset: f22370d97796

Reviewed By: zhangguanheng66

Differential Revision: D21964222

fbshipit-source-id: c316836596fc3e232e63abc59e172f237b551cc5
Summary: Import from github torchtext/master

Reviewed By: zhangguanheng66, cpuhrsch

Differential Revision: D22168183

fbshipit-source-id: 7d96ade64f18942d9bd19437011be2f65f0b2a5e
Reviewed By: Nayef211

Differential Revision: D22315715

fbshipit-source-id: 6b8b8544b0aa458cf5e7e9ca380d0dc85c98189f
Summary: Import from github torchtext/master

Reviewed By: cpuhrsch

Differential Revision: D22420576

fbshipit-source-id: 4d2c19d7f1db8f698894ca406c1c44b2ad8e0506
fbshipit-source-id: 5113fe0c527595e4227ff827253b7414abbdf7ac
fbshipit-source-id: 798decc90db4f13770e97cdce3c0df7d5421b2a3
Summary: Import from github torchtext/master

Reviewed By: zhangguanheng66

Differential Revision: D22641140

fbshipit-source-id: 8190692d059a937e25c5f93506581086f389c291
Reviewed By: ashwinp-fb

Differential Revision: D22955630

fbshipit-source-id: f00ef17a905e4c7cd9196c8924db39f9cdfe8cfa
Summary: Import from github torchtext/master

Reviewed By: zhangguanheng66

Differential Revision: D22989210

fbshipit-source-id: 083464e188b758a8746123f4dd2197cc7edc4bc4
Summary: Import from github torchtext/master

Reviewed By: cpuhrsch

Differential Revision: D23190596

fbshipit-source-id: 1568a25a5bd6431bcef3c6539f64a3ab1f5bccd7
Reviewed By: hudeven

Differential Revision: D23451795

fbshipit-source-id: 73e6130c16716919c77862cef4ca4c8048428670
Reviewed By: Nayef211

Differential Revision: D23539397

fbshipit-source-id: 88dce59418a3071cbc9e944cf0a4cf2117d7d9f7
Reviewed By: cpuhrsch

Differential Revision: D23616189

fbshipit-source-id: 365debc987326145eead7456ed48517fe55cac96
Summary:
Pull Request resolved: pytorch/pytorch#42390

**Summary**
This commit extends support for properties to include
ScriptModules.

**Test Plan**
This commit adds a unit test that has a ScriptModule with
a user-defined property.

`python test/test_jit_py3.py TestScriptPy3.test_module_properties`

Test Plan: Imported from OSS

Reviewed By: eellison, mannatsingh

Differential Revision: D22880298

Pulled By: SplitInfinity

fbshipit-source-id: 74f6cb80f716084339e2151ca25092b6341a1560
Reviewed By: cpuhrsch

Differential Revision: D23721167

fbshipit-source-id: 13b32091c422a3ed0ae299595d69a7afa7136638
Reviewed By: cpuhrsch

Differential Revision: D23962265

fbshipit-source-id: 0d042878fe9119aa725e982ab7d5e96e7c885a59
Summary:
Pull Request resolved: pytorch/pytorch#45261

**Summary**
This commit enables `unused` syntax for ignoring
properties. Inoring properties is more intuitive with this feature enabled.
`ignore` is not supported because class type properties cannot be
executed in Python (because they exist only as TorchScript types) like
an `ignored` function and module properties that cannot be scripted
are not added to the `ScriptModule` wrapper so that they
may execute in Python.

**Test Plan**
This commit updates the existing unit tests for class type and module
properties to test properties ignored using `unused`.

Test Plan: Imported from OSS

Reviewed By: navahgar, Krovatkin, mannatsingh

Differential Revision: D23971881

Pulled By: SplitInfinity

fbshipit-source-id: 8d3cc1bbede7753d6b6f416619e4660c56311d33
datumbox and others added 12 commits February 15, 2021 06:04
Reviewed By: zhangguanheng66

Differential Revision: D26369003

fbshipit-source-id: 09ca48f9705d8663b06e6a329a6b64b24f9c148e
Reviewed By: zhangguanheng66

Differential Revision: D26369005

fbshipit-source-id: b1e6b5d77810bb8f67d14b8a1c7ec0a9f4831cab
…ataset (pytorch#1142)

Reviewed By: zhangguanheng66

Differential Revision: D26368999

fbshipit-source-id: 4b50e5d9e5fbdf633e8b3f0072223eed050af793
Reviewed By: zhangguanheng66

Differential Revision: D26368998

fbshipit-source-id: 84e883562a9a3d0fe47b54823b22f7b2cd82fca4
Reviewed By: zhangguanheng66

Differential Revision: D26369006

fbshipit-source-id: 608f42fa180db9ebcfaaeadc6b8cdd29393262af
Reviewed By: zhangguanheng66

Differential Revision: D26368996

fbshipit-source-id: 52741015139c302b7b0ddf8c8f50ab45a609fd2f
Reviewed By: zhangguanheng66

Differential Revision: D26368995

fbshipit-source-id: 0352c04e422c835350bd42df35d4054d543fee36
…torch#1135)

Reviewed By: zhangguanheng66

Differential Revision: D26369001

fbshipit-source-id: f5a67a2a812d568073505ec4d181f6e418eb4a3f
Reviewed By: zhangguanheng66

Differential Revision: D26368997

fbshipit-source-id: f5ef78f5f4a224db497f47f774eaddedd0498b4b
…1134)

Reviewed By: zhangguanheng66

Differential Revision: D26369000

fbshipit-source-id: c687c0f0c2697dbd9c17a79a1291a2e279bbd1b8
… the downstream libraries

Summary: This diff is doing: 1) move the legacy code in torchtext to the legacy folder; 2) for the downstream libraries in fbcode, if they are using the legacy code, add "legacy" to the path.

Reviewed By: cpuhrsch

Differential Revision: D23718437

fbshipit-source-id: 1660868aaa95ac6555ad6793dda5ce02a9acdc08
@zhangguanheng66 zhangguanheng66 changed the title Merge fbsync into master branch - retire legacy code [WIP][DO NOT REVIEW]Merge fbsync into master branch - retire legacy code Feb 17, 2021
@codecov
Copy link

codecov bot commented Feb 17, 2021

Codecov Report

Merging #1172 (cf53aa0) into master (7106519) will decrease coverage by 0.52%.
The diff coverage is 81.39%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #1172      +/-   ##
==========================================
- Coverage   78.37%   77.85%   -0.53%     
==========================================
  Files          59       66       +7     
  Lines        3432     3499      +67     
==========================================
+ Hits         2690     2724      +34     
- Misses        742      775      +33     
Impacted Files Coverage Δ
torchtext/data/batch.py 60.00% <0.00%> (-11.43%) ⬇️
torchtext/data/example.py 54.54% <0.00%> (-31.17%) ⬇️
torchtext/data/field.py 53.84% <0.00%> (-38.99%) ⬇️
torchtext/data/iterator.py 60.00% <0.00%> (-2.67%) ⬇️
torchtext/data/pipeline.py 50.00% <0.00%> (-50.00%) ⬇️
torchtext/legacy/datasets/babi.py 21.27% <ø> (ø)
torchtext/legacy/datasets/imdb.py 48.38% <ø> (ø)
torchtext/legacy/datasets/nli.py 47.94% <0.00%> (ø)
torchtext/legacy/datasets/sequence_tagging.py 38.29% <ø> (ø)
torchtext/legacy/datasets/sst.py 37.14% <ø> (ø)
... and 31 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7106519...f82adae. Read the comment docs.


from ..common.torchtext_test_case import TorchtextTestCase
from ...common.torchtext_test_case import TorchtextTestCase
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Triple "." is probably not intended here

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It needs to jump two folders to access TorchtextTestCase class

@zhangguanheng66 zhangguanheng66 changed the title [WIP][DO NOT REVIEW]Merge fbsync into master branch - retire legacy code Merge fbsync into master branch - retire legacy code Feb 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants