Streaming logs to Hydrolix?
Thinking about streaming logs to Hydrolix. Any tips to the instructions before I follow the Fastly instructions?
-
Hello John,
Thank you for submitting your question.
If you have shielding enabled on your service, VCL will run twice, once on the edge node and again on the shield node. If you want vcl_log to run only on the edge node, you can attach the following condition to your logging endpoint:
fastly.ff.visits_this_service == 0. On the other hand, if you want vcl_log to run only on the shield node then, the condition would befastly.ff.visits_this_service > 0orreq.backend.is_shieldreq.http.Fastly-Client-IPis the true client IP whereas,client.ipis always the immediate client of the current server.Docs to reference:
Hydrolix: https://docs.hydrolix.io/guide/ingestion/fastly
https://docs.fastly.com/en/guides/changing-where-log-files-are-writtenreq.http.Fastly-Client-IPhttps://developer.fastly.com/reference/http-headers/Fastly-Client-IP/Have you already attempted to configure the logging endpoint on your Fastly service? If you have questions about your use case, please contact Fastly Support by emailing support@fastly.com
-
Hi John! Thanks for your interest in Fastly and Hydrolix. I just posted a comprehensive tutorial that covers the basics around how to configure, use, and visualize Fastly CDN logs on Hydrolix. Here are a few links to get you started but please don't hesitate to reach out if we can be of additional assistance:
Hydrolix Streaming Intake for Fastly CDN Logs
https://www.hydrolix.io/blog/hydrolix-streaming-intake-for-fastly-cdn-logsAnalyzing Fastly CDN transaction logs with Hydrolix
https://www.hydrolix.io/blog/analyzing-fastly-cdn-transaction-logs-with-hydrolixVisualizing Fastly data with Hydrolix and Grafana
https://www.hydrolix.io/blog/visualizing-fastly-data-with-hydrolix-and-grafanaFull Tutorial
https://docs.hydrolix.io/tutorials/fastlyBest wishes,
Tobin
Please sign in to leave a comment.
Comments
2 comments