Trigger files are files that are created when a file gets ingested into your environment to trigger subsequent processing pipelines. Why are these files used to trigger processing pipelines, and not the actual files that get ingested?

Trigger files bypass any message queues, which can slow down processing

Having trigger files means you do not have to reference actual ingested files

Creating a generic trigger file system allows you to create generic data pipelines and ingestion $($e$.$g$.,$ locating the files ingested$)$

It is not possible to trigger a pipeline based on actual files to be processed

Trigger files do not take any space on disk