Add PathTemplate to customize the directory for exporting logs

[sharkpc138]

PathTemplate

• As the exported logs are transformed into various formats, the requirements for log paths have also increased
• With the PathTemplate based on Go templates, you can freely structure fields using the template fields described below

Template Fields

• Reserved keywords are provided to allow flexible directory composition in the path
• Each field can be used multiple times
• If this feature is not used, the default path structure is applied
  • /{time layout(2006-01)}/{Namespace}/{LobsterSink name}/{Contents name}/{Pod}/{Container}/{Start time of log}_{End time of log}.log

Field	Description
{{TimeFunc "2006-01-02"}}	Time based directory layout
{{.Cluster}}	Cluster name
{{.Namespace}}	Log source namespace name
{{.SinkName}}	Lobster sink name
{{.RuleName}}	Rule name in Lobster sink
{{.Pod}}	Pod name
{{.Container}}	Container name or __emptydir__
{{.SourceType}}	stdstream or emptydir
{{.SourcePath}}	A file path within an emptyDir volume

Example

spec:
  logExportRules:
  - basicBucket:
      destination: http://a-dev.nubes.sto.navercorp.com:8000/v1/n3r-logging
      pathTemplate: /pathtest/{{TimeFunc "20060102"}}/{{.Container}}
  ...

PathTemplate	Exported file
/lobster	/lobster/2025-01-06T14:17:15%2B09:00_2025-01-06T14:17:17%2B09:00.log
/{{TimeFunc "2006-01"}}	/2025-01/2025-01-06T14:17:15%2B09:00_2025-01-06T14:17:17%2B09:00.log
/{{.Pod}}	/loggen-123/2025-01-06T14:17:15%2B09:00_2025-01-06T14:17:17%2B09:00.log
/{{.SourcePath}}	/renamed_namespaceA_test.log/loggen-123/2025-01-06T14:17:15%2B09:00_2025-01-06T14:17:17%2B09:00.log
/lobster/{{TimeFunc "2006-01"}}/123/{{.SourcePath}}	/lobster/2025-01/123/renamed_namespaceA_test.log/2025-01-06T14:17:15%2B09:00_2025-01-06T14:17:17%2B09:00.log
/{{TimeFunc "2006-01"}}/{{Time "2006-01-02"}}	/2025-01-06/2025-01/2025-01-06T14:17:15%2B09:00_2025-01-06T14:17:17%2B09:00.log

Cautions

• Customization introduces potential risks of conflicts due to insufficient delimiters
• For example, with configurations like /{{.Pod}}, where delimiters are insufficient,
  conflicts may arise when exporting logs from multiple containers, each having the same log timestamp
  • container A - 2025-01-06T18:20:24%252B09:00_2025-01-06T18:21:23%252B09:00.log
  • container B - 2025-01-06T18:20:24%252B09:00_2025-01-06T18:21:23%252B09:00.log