Getting Filenames of files from a Google Cloud Storage

[mark-cale]

Hello,
I'm attempting to retrieve the filenames of files stored in my Google Cloud Storage. How can I achieve this? I've been experimenting with metadata, but so far, I haven't had any success. Any guidance would be greatly appreciated.

[mihaitodor]

Hey @mark-cale 👋 If you only need the filenames, the gcp_cloud_storage input is going to be wasteful, since it will also read the contents of the files. If you also need the contents, then what I think you want is to look at the gcs_key metadata field. Try adding a log processor like so:

- log:
     message: |
       Filename: ${! @gcs_key }

You can also dump all the metadata fields if you just use @ instead of @gcs_key.

[mark-cale]

Cool Thanks!