Skip to content

bug: filebeat default path does not work for all configurations #76

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
qdzlug opened this issue Dec 21, 2021 · 2 comments
Open

bug: filebeat default path does not work for all configurations #76

qdzlug opened this issue Dec 21, 2021 · 2 comments
Labels
bug Something isn't working

Comments

@qdzlug
Copy link
Contributor

qdzlug commented Dec 21, 2021

Describe the bug
When running in EKS, the default filebeat path (/var/lib/docker/containers) works fine. However, other deployments use different paths - for example, RKE2 uses /var/log/containers.

Need to make this configurable.

To Reproduce
Steps to reproduce the behavior:

  1. Deploy to RKE or microk8s.
  2. Watch as no logs get scraped.

Expected behavior
We need to make this configurable; I don't know that we can automatically guess what we're running on, so this may just be up to the user (or handled as part of the configuration process).

Your environment

  • n/a

Additional context
n/a

@qdzlug qdzlug added the bug Something isn't working label Mar 15, 2022
@qdzlug
Copy link
Contributor Author

qdzlug commented May 6, 2022

Since we are seeing more deployments on K3s, Microk8s, and Minikube this is becoming more of a problem. Looking into some other options to manage this from the OS side (ie, doing a symlink) which may be slightly easier than trying to detect and configure appropriately.

@qdzlug
Copy link
Contributor Author

qdzlug commented May 6, 2022

Relevant code is here: https://github.com/nginxinc/kic-reference-architectures/blob/master/pulumi/python/kubernetes/logagent/__main__.py#L68-L73

Default path is /var/lib/docker/containers/${data.kubernetes.container.id}/*.log\noutput.elasticsearch:\n",

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant