Add a new tutorial: Building a Flask API server with PyTorch #537

avinassh · 2019-06-20T17:45:13Z

I was writing this for my blog, however, I noticed that PyTorch Tutorials does not have one on building an API. So I am submitting here. My apologies, since I did not discuss this here first. I think PyTorch Tutorial could really use this 😄

netlify · 2019-06-20T17:49:20Z

Deploy preview for pytorch-tutorials-preview ready!

Built with commit 1401e89

https://deploy-preview-537--pytorch-tutorials-preview.netlify.com

soumith · 2019-06-24T06:01:50Z

@jeffreyksmithjr for review. Questions to ask:

do you want to include this in tutorials?
if you do, any changes you would request on the current draft of the tutorial?

avinassh · 2019-06-26T13:30:56Z

Hey @jeffreyksmithjr, any update on this?

jeffreyksmithjr · 2019-07-01T12:48:32Z

Thanks very much for thinking to add this @avinassh . I didn't see the notification before. I will review this shortly.

jeffreyksmithjr

Lots of tiny easy things to do in one pass. A few are very optional.

beginner_source/README.txt

beginner_source/flask_rest_api_tutorial.py

jeffreyksmithjr · 2019-07-02T16:36:36Z

beginner_source/flask_rest_api_tutorial.py

+                                        transforms.CenterCrop(224),
+                                        transforms.ToTensor(),
+                                        transforms.Normalize(
+                                            [0.485, 0.456, 0.406],


I know that you individually are not the source of these magic numbers within this codebase, but I still wish that their origin were more clearly called out. At least some sort of pointer about where they come from.

beginner_source/flask_rest_api_tutorial.py

jeffreyksmithjr · 2019-07-02T17:52:32Z

Thanks very much @avinassh for this well-conceived tutorial. I have a bunch of small things around clarity and language. Overall, this is a valuable contribution. Once we've got it wrapped up, I want to point to this from other locations as well, to help PT users find this resource.

jspisak · 2019-07-30T16:12:42Z

@avinassh - any update on this one? We'd like to merge this by next week for the Summer Hack..

cc @brianjo @jlin27

avinassh · 2019-07-30T16:22:21Z

somehow I missed it. Really sorry. I will update the PR now.

avinassh · 2019-07-30T18:15:04Z

@jeffreyksmithjr Thank you so much for the PR review. Since I am a non-native English speaker, I ended up making a lot of grammatical mistakes.

I have fixed the PR as per the review suggestions.

Only one thing left is about transforms mean/std deviation magic numbers - #537 (comment)

I have provided a link to torchvision's model doc, but it doesn't explain either how/why about those numbers

Could you suggest me, what to add?

avinassh · 2019-07-30T18:15:43Z

@jspisak I have updated the PR :D

jspisak · 2019-07-30T22:34:42Z

@avinassh - thanks!! @jeffreyksmithjr - take a look and merge?

jeffreyksmithjr · 2019-08-01T17:20:05Z

intermediate_source/flask_rest_api_tutorial.py

-#    method? Or why it is a global variable? Loading a model can be an
-#    expensive operation, memory, CPU wise. If we loaded the model in the
-#    ``get_prediction`` method, then it will get unnecessarily loaded every
+#    Did you notice that why ``model`` variable is not part of ``get_prediction``


why still is incorrect. It should just be Did you notice that model..

oops, somehow I missed it. Sent another PR #583 to fix it.

jspisak · 2019-08-01T17:25:13Z

Merging per Jeff's go ahead..

jeffreyksmithjr · 2019-08-01T17:27:54Z

I think this a great tutorial, and I really appreciate you writing it @avinassh . Thanks for your patience with my various nits around writing style. Your solution to the magic numbers issue seems reasonable, since it doesn't originate in your work. Thank you for taking my feedback and getting this in. It turned out great and will be an asset to the community.

avinassh · 2019-08-01T17:45:51Z

Thank you so much @jeffreyksmithjr! It was really fun writing it. Thanks for your feedback, it was very helpful and I learnt quite a few things about writing a good tutorial :D

avinassh · 2019-08-01T17:54:02Z

Also, may I know when this will go live on https://pytorch.org/tutorials

soumith · 2019-08-01T17:56:29Z

it should be live now, as soon as the CI finishes the job and pushes to the site.

Add a new tutorial: Building a Flask API server with PyTorch

avinassh added 7 commits June 20, 2019 20:11

initial version

7f3f331

fix typos

f3a60ce

Update the tutorial

3af5f1b

add item to the index

35dff3d

fix image path

41299b1

fix relative link

e3fede2

Fix the header

753bd12

soumith requested a review from jeffreyksmithjr June 24, 2019 06:01

jeffreyksmithjr suggested changes Jul 2, 2019

View reviewed changes

avinassh added 3 commits July 3, 2019 17:24

move to intermediate section

0fe9b22

Update main index

cc96dd4

move the file to intermediate directory

3d317f8

avinassh added 4 commits July 30, 2019 22:29

Merge remote-tracking branch 'origin/master' into rest-api

5239d75

clean up index.rst

be03660

Fix grammar issues and improvements from PR review

105da91

some more fixes

c18c831

update flask deploy URL

1401e89

jeffreyksmithjr reviewed Aug 1, 2019

View reviewed changes

jspisak merged commit 18cada0 into pytorch:master Aug 1, 2019

jeffreyksmithjr mentioned this pull request Aug 1, 2019

Update Serving Post to Include Canonical Tutorial pytorch/pytorch.github.io#232

Open

avinassh mentioned this pull request Aug 1, 2019

Fix a typo #583

Closed

avinassh deleted the rest-api branch August 1, 2019 17:45

brianjo mentioned this pull request Aug 1, 2019

Update requirements.txt #584

Closed

rodrigo-techera pushed a commit to Experience-Monks/tutorials that referenced this pull request Nov 29, 2021

Merge pull request pytorch#537 from avinassh/rest-api

e7e3d8d

Add a new tutorial: Building a Flask API server with PyTorch

harshaljanjani mentioned this pull request Jun 3, 2025

Example deployment link broken in "Deploying PyTorch in Python via a REST API with Flask" #3044

Closed

Add a new tutorial: Building a Flask API server with PyTorch #537

Add a new tutorial: Building a Flask API server with PyTorch #537

Uh oh!

Conversation

avinassh commented Jun 20, 2019

Uh oh!

netlify bot commented Jun 20, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

soumith commented Jun 24, 2019

Uh oh!

avinassh commented Jun 26, 2019

Uh oh!

jeffreyksmithjr commented Jul 1, 2019

Uh oh!

jeffreyksmithjr left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

jeffreyksmithjr Jul 2, 2019

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

jeffreyksmithjr commented Jul 2, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jspisak commented Jul 30, 2019

Uh oh!

avinassh commented Jul 30, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

avinassh commented Jul 30, 2019

Uh oh!

avinassh commented Jul 30, 2019

Uh oh!

jspisak commented Jul 30, 2019

Uh oh!

jeffreyksmithjr Aug 1, 2019

Choose a reason for hiding this comment

Uh oh!

avinassh Aug 1, 2019

Choose a reason for hiding this comment

Uh oh!

jspisak commented Aug 1, 2019

Uh oh!

jeffreyksmithjr commented Aug 1, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

avinassh commented Aug 1, 2019

Uh oh!

avinassh commented Aug 1, 2019

Uh oh!

soumith commented Aug 1, 2019

Uh oh!

Uh oh!

netlify bot commented Jun 20, 2019 •

edited

Loading

jeffreyksmithjr commented Jul 2, 2019 •

edited

Loading

avinassh commented Jul 30, 2019 •

edited

Loading

jeffreyksmithjr commented Aug 1, 2019 •

edited

Loading