icecheng/freeleaps-ops
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,105 Commits 1 Branch 0 Tags 29 MiB
7c4b975a62
Commit Graph

72 Commits

Author SHA1 Message Date
Nicolas
38ae6e7b17 feat(opentelemetry): enhance logging attributes for Kubernetes integration 2025-09-28 09:04:18 +08:00
Nicolas
a8d6af93aa restore: add Kubernetes metadata to JSON logs 
- Restore ParseJSON operations to add Kubernetes metadata to log body
- Add kubernetes.pod, kubernetes.namespace, kubernetes.pod_ip, etc. to JSON
- This will enrich the JSON logs with Kubernetes context information
- Maintain original JSON structure while adding K8s metadata
 2025-09-22 21:46:38 +08:00
Nicolas
2983250d07 fix: remove json_parser to preserve original JSON format 
- Remove json_parser operator to keep logs in original JSON format
- This should maintain the structured JSON content in Grafana
- Logs will be sent as raw JSON without parsing into attributes
 2025-09-22 21:45:14 +08:00
Nicolas
cda371e74f fix: change start_at to beginning to read existing logs 
- Change start_at from end to beginning
- This should allow OpenTelemetry Collector to read existing log content
- May cause duplicate logs but should make logs visible in Grafana
 2025-09-22 21:38:59 +08:00
Nicolas
620bacdbbf fix: remove move operator that may be causing log processing failure 
- Remove move operator from json_parser configuration
- Keep only json_parser with parse_to: attributes
- This should allow logs to be processed correctly
 2025-09-22 21:38:00 +08:00
Nicolas
802698bcb7 fix: align authentication logging with chat service configuration 
- Add parse_to: attributes to json_parser operator
- Add move operator to move text content to body
- Use application instead of service_name for consistency
- Use global.environment for environment setting
- Add global.environment to values files for both alpha and prod
- This should fix the unknown_service classification issue
 2025-09-22 21:21:19 +08:00
Nicolas
fe2b7200de simplify: remove where clause from transform processor 
- Remove complex where clause that may cause syntax errors
- Set environment to alpha by default for all logs
- This should fix the transform processor execution issue
 2025-09-22 20:45:02 +08:00
Nicolas
c4719493af fix: add service.name attribute to prevent unknown_service classification 
- Add service.name resource attribute in addition to service_name
- This should prevent logs from being classified as unknown_service in Loki
- Keep both attributes for compatibility
 2025-09-22 20:40:30 +08:00
Nicolas
b1554522b5 Fix the configuration of the JSON parser 2025-09-22 20:35:06 +08:00
Nicolas
b60c5c9324 simplify: remove ParseJSON operations from OpenTelemetry transform 
- Remove complex JSON parsing operations that may cause issues
- Keep only essential resource attribute mapping
- This should help logs be properly processed and sent to Loki
 2025-09-22 20:22:40 +08:00
Nicolas
a9d3930ba3 fix: use where clause for conditional environment setting 
- Replace if statement with where clause for environment mapping
- Set default to alpha, then override to prod for freeleaps-prod namespace
 2025-09-22 19:54:57 +08:00
Nicolas
0774325bf6 fix: use if statement instead of ReplaceAll for environment mapping 
- Replace ReplaceAll function with if statement for environment mapping
- This avoids undefined function error in OpenTelemetry Collector OTTL
 2025-09-22 19:53:13 +08:00
Nicolas
a9d6ab93e6 fix the bug of auth 2025-09-22 19:44:52 +08:00
Nicolas
b1f6ce8a1d Set the log environment for authentication using string replacement 2025-09-22 17:47:40 +08:00
Nicolas
61509dabf2 roll back 2025-09-22 17:33:22 +08:00
Nicolas
d9209e89ef fix authentication 2025-09-22 17:31:11 +08:00
Nicolas
5b185972a8 update authentication log set 2025-09-22 16:53:54 +08:00
Nicolas
efa0b55236 change authentication log env set 2025-09-22 16:23:01 +08:00
zhenyus
84e4eb9f02 fix(opentelemetry): update logging level to info and remove debug exporter 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 20:11:45 +08:00
zhenyus
bd31bcda9d fix(opentelemetry): simplify log body assignment by removing unnecessary type conversion 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 20:06:59 +08:00
zhenyus
dc3e06738c fix(opentelemetry): update log body processing to directly use resource attributes 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 20:05:40 +08:00
zhenyus
ef0cf0fa87 fix(opentelemetry): add batch configuration for log processing 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 20:03:10 +08:00
zhenyus
ebeea26864 fix(opentelemetry): enhance log body processing by restructuring Kubernetes attributes handling 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 20:01:45 +08:00
zhenyus
6588193c7d fix(opentelemetry): reorder processors in log pipeline for correct processing sequence 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 19:53:40 +08:00
zhenyus
32d9f41ee5 fix(opentelemetry): update processor attributes to use environment variable values for improved metadata extraction 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 19:48:24 +08:00
zhenyus
ddabde9dc0 fix(opentelemetry): update environment variables and resource attributes for improved metadata extraction 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 19:43:22 +08:00
zhenyus
15dd1fba0b fix(opentelemetry): update resource attributes in distributor and log transformation for improved metadata extraction 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 17:43:08 +08:00
zhenyus
5c2ea75928 fix(opentelemetry): correct sources key in pod association configuration 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 17:29:14 +08:00
zhenyus
9ceaaa3e0b fix(opentelemetry): restore and configure k8sattributes processor for enhanced metadata extraction 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 17:28:25 +08:00
zhenyus
c08ddf7f76 fix(opentelemetry): add resource attributes for application and environment in log transformation 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 17:20:39 +08:00
zhenyus
473f5cea54 fix(opentelemetry): update log transformation to use resource attributes for application and environment 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 17:17:40 +08:00
zhenyus
802b9bf8ba fix(opentelemetry): correct attribute path for service and deployment in log transformation 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 17:07:42 +08:00
zhenyus
c106c9a624 fix(loki): update resource_attributes to use regex for indexing labels 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 17:05:53 +08:00
zhenyus
f45f79e32e fix(opentelemetry): update processors in logs pipeline to use transform instead of attributes 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:44:36 +08:00
zhenyus
fb368eb8d8 fix(opentelemetry): remove commented-out k8sattributes actions for clarity 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:44:13 +08:00
zhenyus
b0a1e56a75 fix(opentelemetry): correct syntax for accessing context attributes in log transformation 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:43:24 +08:00
zhenyus
5f1742e22e refactor(opentelemetry): reorganize log transformation logic for clarity and consistency 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:42:28 +08:00
zhenyus
2e1879298f fix(opentelemetry): remove k8sattributes processor from logs pipeline for simplification 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:32:06 +08:00
zhenyus
1967a7444c fix(opentelemetry): comment out unused k8sattributes processor and related actions for clarity 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:31:29 +08:00
zhenyus
80e75eea27 fix(opentelemetry): add telemetry logging level configuration for improved log management 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:26:06 +08:00
zhenyus
4ee81552a2 fix(opentelemetry): streamline attributes configuration by removing redundant labeling actions 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:19:03 +08:00
zhenyus
222f5ee0fb feat(opentelemetry): add structured metadata support and update log transformation logic 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:16:03 +08:00
zhenyus
6bbc81a940 fix(opentelemetry): restore otlphttp/logs exporter configuration for log ingestion 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 16:00:50 +08:00
zhenyus
44e1213253 fix(opentelemetry): add labeling attributes for app and environment context 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 15:59:59 +08:00
zhenyus
8dda0bada9 fix(opentelemetry): enhance log transformation by adding log statements and updating exporters 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 15:27:46 +08:00
zhenyus
4d591a03c0 fix(opentelemetry): reduce batch send size for log processing to improve performance 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 15:15:30 +08:00
zhenyus
0e967bf12c fix(opentelemetry): add debug exporter to log pipeline for detailed verbosity 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 15:09:44 +08:00
zhenyus
544293f7b2 fix(opentelemetry): refine log processing by removing unnecessary fields and enhancing attribute insertion 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 15:05:05 +08:00
zhenyus
90b4b3bb9b fix(opentelemetry): simplify log transformation by removing unnecessary merge operation 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 14:49:20 +08:00
zhenyus
3daf27cb4d fix(opentelemetry): enhance log transformation logic to include merging attributes 
Signed-off-by: zhenyus <zhenyus@mathmast.com>
 2025-04-21 14:46:52 +08:00