API server rate limiting

[GitHK]

What do these changes do?

Trying to add some rate limiting to the API server. This will filter based on the IP present in the X-Forwarded-For header added by Traefik.

Note: this solution will not work on local deployments. All traffic is passing from the same IP.

Note2: the limit is very low. @pcrespov you might know better that me what to setup as limits.

Related issue number

How to test

Checklist

• Did you change any service's API? Then make sure to bundle document and upgrade version (make openapi-specs, git commit ... and then make version-*)
• Unit tests for the changes exist
• Runs in the swarm
• Documentation reflects the changes
• New module? Add your github username to .github/CODEOWNERS

[codecov]

Codecov Report

Merging #2031 (6e28da4) into master (e1933ca) will increase coverage by 0.0%.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master   #2031   +/-   ##
======================================
  Coverage    72.9%   72.9%           
======================================
  Files         421     421           
  Lines       15487   15487           
  Branches     1568    1568           
======================================
+ Hits        11291   11296    +5     
+ Misses       3789    3785    -4     
+ Partials      407     406    -1     

Flag	Coverage Δ
integrationtests	63.6% <ø> (+<0.1%)	⬆️
unittests	67.4% <ø> (-0.1%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...ce_webserver/resource_manager/garbage_collector.py	76.6% <0.0%> (-1.9%)	⬇️
...simcore_service_webserver/projects/projects_api.py	84.6% <0.0%> (-0.5%)	⬇️
...webserver/computation_comp_tasks_listening_task.py	90.9% <0.0%> (+9.0%)	⬆️
..._service_webserver/projects/projects_exceptions.py	100.0% <0.0%> (+9.5%)	⬆️

[pcrespov]

Can you create a helper with a client that produces a given request rate? That will help us tuning the limit we wish to have. Could add that e.g. in pytest-simcore/helpers

[GitHK]

Can you create a helper with a client that produces a given request rate? That will help us tuning the limit we wish to have. Could add that e.g. in pytest-simcore/helpers

Yes I will try to have this in place.

[GitHK]

So I've added 2 utils to manually run when testing the rate limit of the service. Based on the parameters the test could run in seconds or in hours.

If you have suggestions on how to transform it into a test I am listening. Also the parameters could be picked up from the docker-compose.yml file to test all configured services automatically. I would do this only if were have a reliable "time boxed" test for bursts and steady rate testing for the rate limits.

@pcrespov @sanderegg