Skip to content

Added environment variable support for indices and environment#84

Merged
shraddha5718 merged 5 commits intomasterfrom
feature/JOBS-1114
Sep 23, 2025
Merged

Added environment variable support for indices and environment#84
shraddha5718 merged 5 commits intomasterfrom
feature/JOBS-1114

Conversation

@deepakkjfrog
Copy link
Copy Markdown
Collaborator

@deepakkjfrog deepakkjfrog commented Sep 16, 2025

Currently the index names for log and metrics are hardcoded, now its configurable

So we support two additional param in env now:

  • SPLUNK_LOGS_INDEX: Splunk index name for storing logs (default: jfrog_splunk)
  • SPLUNK_METRICS_INDEX: Splunk index name for storing metrics (default: jfrog_splunk_metrics)

The logs are flowing and the index it is flowing to is the one which we configured:

image

The metrics are also shipped and the index it is flowing to is the one which we configured:

image

- Add target_platform and request_timeout parameters to match Datadog approach
- Use token parameter instead of password for proper authentication
- Update both fluent.conf.rt and fluent.conf.xray
- Update Helm values to use feature branch
- Use placeholder token in jfrog_helm.env
@deepakkjfrog deepakkjfrog changed the title Added support for custom tag in logs and metrics Currently the index names for log and metrics are hardcoded, now its configurable Sep 19, 2025
- >
mkdir -p {{ .Values.artifactory.persistence.mountPath }}/etc/fluentd/;
curl https://raw.githubusercontent.com/jfrog/log-analytics-splunk/master/fluent.conf.rt -o {{ .Values.artifactory.persistence.mountPath }}/etc/fluentd/fluentd.conf
curl https://raw.githubusercontent.com/jfrog/log-analytics-splunk/feature/JOBS-1114/fluent.conf.rt -o {{ .Values.artifactory.persistence.mountPath }}/etc/fluentd/fluentd.conf
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is testing change - pls revert to master

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Addressed

- >
mkdir -p {{ .Values.artifactory.persistence.mountPath }}/etc/fluentd/;
curl https://raw.githubusercontent.com/jfrog/log-analytics-splunk/master/fluent.conf.rt -o {{ .Values.artifactory.persistence.mountPath }}/etc/fluentd/fluentd.conf;
curl https://raw.githubusercontent.com/jfrog/log-analytics-splunk/feature/JOBS-1114/fluent.conf.rt -o {{ .Values.artifactory.persistence.mountPath }}/etc/fluentd/fluentd.conf;
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as above

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Addressed

@shraddha5718
Copy link
Copy Markdown
Collaborator

Can we make the change to use -

postgresql.auth.password=$POSTGRES_PASSWORD

@deepakkjfrog deepakkjfrog force-pushed the feature/JOBS-1114 branch 2 times, most recently from 46abd31 to bab9e89 Compare September 21, 2025 07:26
fluent.conf.xray Outdated
metric_value_key value
insecure_ssl "#{ENV['SPLUNK_INSECURE_SSL']}"
gzip_compression "#{ENV['SPLUNK_COMPRESS_DATA']}"
<buffer>
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this needed ?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These changes are not relevant. Removed.

fluent.conf.rt Outdated
metric_value_key value
insecure_ssl "#{ENV['SPLUNK_INSECURE_SSL']}"
gzip_compression "#{ENV['SPLUNK_COMPRESS_DATA']}"
<buffer>
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this needed ?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These changes are not relevant. Removed.

@prathyu1729
Copy link
Copy Markdown

@deepakkjfrog can we add proper commit message which is short and crisp. For example the commit message for this one could be, Added environment variable support for indices and environment.

@deepakkjfrog deepakkjfrog changed the title Currently the index names for log and metrics are hardcoded, now its configurable Added environment variable support for indices and environment Sep 23, 2025
@shraddha5718 shraddha5718 merged commit 4155e7b into master Sep 23, 2025
@shraddha5718 shraddha5718 deleted the feature/JOBS-1114 branch September 23, 2025 07:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants