General fixes to import/export (#2120)

* quality was missing from serialization

* archving upgraded for better extract performance

* updated openapi specs

* added study duplication API

* fixed module arhciving tests

* fixed archiving tests

* archiving was refactored:
- destination_folder is required for archiving and unarchiving
- no more race conditions during parallel unrachive

* minor refactor

* using new archiving interface

* added tests to check duplication of project

* removed comment

* test no longer hangs

* adding loop to all the tests

* explicitly adding loop

* fixing pylint

* removing comment

* replaced with TempraryDirectory

* moved comment to a better spot

* renaming function

* removing uncecessary loop

* removing loop where not needed

* removing loop

* minor refactor

* added storage file checksum checking

* removing adminer

* renmed properly

Co-authored-by: Andrei Neagu <[email protected]>

Author: GitHK

api/specs/webserver/openapi-projects.yaml

@@ -201,11 +201,6 @@ paths:
         required: true
         schema:
           type: string
-      - name: compressed
-        in: query
-        required: false
-        schema:
-          type: boolean
     post:
       tags:
         - exporter
@@ -222,6 +217,31 @@ paths:
         default:
           $ref: "#/components/responses/DefaultErrorResponse"
 
+  /projects/{project_id}/duplicate:
+    parameters:
+      - name: project_id
+        in: path
+        required: true
+        schema:
+          type: string
+    post:
+      tags:
+        - exporter
+      summary: duplicates an existing project
+      operationId: duplicate_project
+      responses:
+        "200":
+          description: project was duplicated correctly
+          content:
+            application/json:
+              schema:
+                type: object
+                properties:
+                  uuid:
+                    type: string
+        default:
+          $ref: "#/components/responses/DefaultErrorResponse"
+
   /projects/import:
     post:
       tags:
@@ -238,13 +258,15 @@ paths:
                   type: string
                   format: binary
       responses:
-        "201":
+        "200":
           description: creates a new project from an archive
           content:
             application/json:
               schema:
-                #TODO: change this with an OK response
-                $ref: "#/components/schemas/ProjectEnveloped"
+                type: object
+                properties:
+                  uuid:
+                    type: string
         default:
           $ref: "#/components/responses/DefaultErrorResponse"
 

api/specs/webserver/openapi.yaml

@@ -171,6 +171,9 @@ paths:
   /projects/{project_id}:xport:
     $ref: "./openapi-projects.yaml#/paths/~1projects~1{project_id}~1xport"
 
+  /projects/{project_id}:duplicate:
+    $ref: "./openapi-projects.yaml#/paths/~1projects~1{project_id}~1duplicate"
+
   /projects:import:
     $ref: "./openapi-projects.yaml#/paths/~1projects~1import"
 

packages/models-library/src/models_library/projects.py

@@ -87,7 +87,9 @@ class Project(BaseModel):
     ui: Optional[StudyUI] = None
 
     # Quality
-    quality: Dict[str, Any] = {}
+    quality: Dict[str, Any] = Field(
+        {}, description="stores the study quality assessment"
+    )
 
     # Dev only
     dev: Optional[Dict] = Field(description="object used for development purposes only")