Merge branch 'develop' into 232-upload-file-to-folder

Author: lmarini

.github/workflows/swagger.yml

@@ -0,0 +1,28 @@
+name: swagger
+
+# This will run when:
+# - when new code is pushed to master/develop to make sure the
+#   code does compile.
+# - when a pull request is created and updated to make sure the
+#   code does compile.
+on:
+  push:
+    branches:
+      - master
+      - develop
+
+  pull_request:
+
+# Check to make sure swagger document is valid
+jobs:
+
+  # downloads all the dependencies and compiles the scala code
+  lint:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v2
+
+      - name: openapi-lint 
+        uses: mhiew/redoc-lint-github-action@v2
+        with:
+          args: 'public/swagger.yml --skip-rule operation-operationId'

CHANGELOG.md

@@ -4,19 +4,42 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](http://keepachangelog.com/)
 and this project adheres to [Semantic Versioning](http://semver.org/).
 
-## Unreleased
-- Added folder and folder id to api datasets files list [#34](https://github.com/clowder-framework/clowder/issues/34)
+## 1.18.1 - 2021-08-16
+
+This release fixes a critical issue where invalid zip files could result in the files not being uploaded correctly. To check to see if you are affected, please use the following query:
+
+```
+db.uploads.find({"status": "CREATED", "contentType": "application/x-zip-compressed"}, {"author.fullName": 1, "author.email": 1, "filename": 1, "uploadDate": 1, "length": 1})
+```
+
+If any files are returned, you should check to see if these files affected and are missing from clowder.
 
 ### Fixed
-- When uploading a file, it would ignore any extractors marked disabled at the space level. [#246](https://github.com/clowder-framework/clowder/issues/246)
-- Added index for comments, will speed up index creation
-- If using S3 storage in docker, it was not reflected correctly in the docker-compose file
+- When zip file is uploaded, it will parse the file to check if it is a valid zip file, this couuld result in files not stored in final storage space [#264](https://github.com/clowder-framework/clowder/issues/264)
+- Updated swagger documentation
+- Return 404 not found when calling file/dataset/space api endpoints with an invalid ID [#251](https://github.com/clowder-framework/clowder/issues/251)
+- Line breaks in welcome message breaks swagger build [#187](https://github.com/clowder-framework/clowder/issues/187)
+
+### Changed
+- Added more information when writing files to make sure files are written correctly
+- Made cilogon group check debug message instead of error message
+
+## 1.18.0 - 2021-07-08
 
 ### Added
-- Status endpoint will now show what storage is used
+- Added folder and folder id to API call `GET /api/datasets/:id/files`. [#34](https://github.com/clowder-framework/clowder/issues/34)
+- Ability to queue archive / unarchive for full datasets.
+- API status endpoint `GET /api/status` will now show what storage type is used and for superadmins will show more 
+  information about the backend storage. 
+- `GET /api/files/bulkRemove` now returns status of files deleted, not found, no permission, or errors.
 
 ### Fixed
-- Docker image for mongo-init now based on python:3.7-slim reduces size
+- When uploading a file, any extractors marked disabled at the space level would be ignored. [#246](https://github.com/clowder-framework/clowder/issues/246)
+- RabbitMQ will not use connection if it does not exist.
+- Previews returns 404 if preview is not found `GET /api/previews/:id`.
+- Added index for comments, will speed up index creation.
+- If using S3 storage in docker, it was not reflected correctly in the docker-compose file.
+- Docker image for mongo-init now based on python:3.7-slim to reduce size.
 
 ### Added
 - Endpoint '/api/files/uploadToDataset' now allows folder_id for uploading file to folder. [#232](https://github.com/clowder-framework/clowder/issues/232)
@@ -36,6 +59,8 @@ and this project adheres to [Semantic Versioning](http://semver.org/).
 ### Changed
 - Updated Sphinx dependencies due to security and changes in required packages.
 
+- Updated the three.js libraries for the FBX previewer
+
 ## 1.16.0 - 2021-03-31
 
 ### Fixed
@@ -103,6 +128,7 @@ script to fix this.
 ## 1.14.0 - 2021-01-07
 
 ### Added
+- Added a previewer for FBX files.
 - Added a new `/api/reports/metrics/extractors` report for summarizing extractor usage by user. Database administrators
   can use `scripts/updates/UpdateUserId.js` to assign user IDs to older extraction event records based on resource ownership
   in order to improve the accuracy of the report for older data.