[backend] Fix handling of platform_entity_files_ref config (#7406)

[JeremyCloarec]

Proposed changes

• Added fileId to external reference schema attributes
• Fixed creation of external ref in createEntityRaw when platform_entity_files_ref is configured
• Fixed updater for external ref deletion

Related issues

• ExternalReferences with automatic creation is broken #7406

Checklist

• I consider the submitted work as finished
• I tested the code for its functionality
• I wrote test cases for the relevant uses case (coverage and e2e)
• I added/update the relevant documentation (either on github or on notion)
• Where necessary I refactored code to improve the overall quality

Further comments

[codecov]

Codecov Report

Attention: Patch coverage is 18.18182% with 9 lines in your changes missing coverage. Please review.

Project coverage is 67.70%. Comparing base (cb75aec) to head (2b56b11).
Report is 8 commits behind head on master.

Files	Patch %	Lines
...latform/opencti-graphql/src/database/middleware.js	10.00%	9 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #7417      +/-   ##
==========================================
+ Coverage   67.59%   67.70%   +0.11%     
==========================================
  Files         561      561              
  Lines       69190    69258      +68     
  Branches     5880     5964      +84     
==========================================
+ Hits        46769    46894     +125     
+ Misses      22421    22364      -57     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Archidoit]

Creation works but we can't delete or remove the external ref from the entity.

• Enforce external ref creation at file upload for Malwares
• Create a malware with a file
• An external reference associated with the file is well created and well associated to the malware
• But you can't remove / delete the external ref from the malware

If you click on 'delete', the file is deleted but the external ref is still there :

If you try to delete again, error message :

[Kedae]

Have you checked stixCoreObject@stixCoreObjectsImportPush ?

[JeremyCloarec]

Yes, tested both entity creation and import push behavior. stixCoreObjectsImportPush was working properly once fileId was added back as an external ref attribute

[Archidoit]

We have only the choices 'update' or 'delete'.

We should also have 'remove', like it is proposed when we add the external ref after creation via the 'add' button :

What's more, when we click on 'delete', the external ref is from the object. But if you reload the external ref still apears (but without the file). And the external ref is still present (it has not been deleted from the platform) :

[Archidoit]

Create an object with a file, an external reference with the file is created.

Go to an entity overview.
Click on 'add external reference' :

You can't select the external references created via the file upload (see test.txt in the list of the screenshot below) :

[Archidoit]

Create an entity with a file. The external ref is well created.
Click on Update the external ref :

Change the source name. An error occurs for the URL field :

But the external ref is well updated if we leave the edition form :

[JeremyCloarec]

URL validation problem has been moved to a separate issue: #7431

[JeremyCloarec]

The questions about the expected behavior of these external references have been moved to this issue #7432