Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs updates #779

Merged
merged 5 commits into from
Feb 21, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions _sidebar.idoc.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,11 @@
@global-contents-table-plugin-output|links-list

- **Pipeline**
- [Match modes](pipeline/README.md#match-modes)
- [Experimental: Do If rules](pipeline/doif/README.md#experimental-do-if-rules)
- [About](/pipeline/README.md)
- [Settings](/pipeline/README.md#settings)
- [Datetime parse formats](/pipeline/README.md#datetime-parse-formats)
- [Match modes](/pipeline/README.md#match-modes)
- [Experimental: Do If rules](/pipeline/doif/README.md#experimental-do-if-rules)

- **Other**
- [Contributing](/docs/contributing.md)
Expand Down
7 changes: 5 additions & 2 deletions _sidebar.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,11 @@


- **Pipeline**
- [Match modes](pipeline/README.md#match-modes)
- [Experimental: Do If rules](pipeline/doif/README.md#experimental-do-if-rules)
- [About](/pipeline/README.md)
- [Settings](/pipeline/README.md#settings)
- [Datetime parse formats](/pipeline/README.md#datetime-parse-formats)
- [Match modes](/pipeline/README.md#match-modes)
- [Experimental: Do If rules](/pipeline/doif/README.md#experimental-do-if-rules)

- **Other**
- [Contributing](/docs/contributing.md)
Expand Down
2 changes: 1 addition & 1 deletion pipeline/README.idoc.md
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ Type of `EventPool`. `std` pool is an original pool with the slice of `Event` po

## Datetime parse formats

Most of the plugins which work with parsing datetime call `pipeline.ParseTime` function. It accepts datetime layouts the same way as Go `time.Parse` (in format of datetime like `2006-01-02T15:04:05.999999999Z07:00`) except unix timestamp formats, they can only be specified via aliases.
Most of the plugins which work with parsing datetime call `pipeline.ParseTime` function. It accepts datetime layouts the same way as Go [time.Parse](https://pkg.go.dev/time#Parse) (in format of datetime like `2006-01-02T15:04:05.999999999Z07:00`) except unix timestamp formats, they can only be specified via aliases.

For the comfort of use there are aliases to some datetime formats:

Expand Down
2 changes: 1 addition & 1 deletion pipeline/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ Type of `EventPool`. `std` pool is an original pool with the slice of `Event` po

## Datetime parse formats

Most of the plugins which work with parsing datetime call `pipeline.ParseTime` function. It accepts datetime layouts the same way as Go `time.Parse` (in format of datetime like `2006-01-02T15:04:05.999999999Z07:00`) except unix timestamp formats, they can only be specified via aliases.
Most of the plugins which work with parsing datetime call `pipeline.ParseTime` function. It accepts datetime layouts the same way as Go [time.Parse](https://pkg.go.dev/time#Parse) (in format of datetime like `2006-01-02T15:04:05.999999999Z07:00`) except unix timestamp formats, they can only be specified via aliases.

For the comfort of use there are aliases to some datetime formats:

Expand Down
60 changes: 55 additions & 5 deletions plugin/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -531,7 +531,12 @@ It renames the fields of the event. You can provide an unlimited number of confi
When `override` is set to `false`, the field won't be renamed in the case of field name collision.
Sequence of rename operations isn't guaranteed. Use different actions for prioritization.

**Example:**
**Note**: if the renamed field name starts with underscore "_", it should be escaped with preceding underscore. E.g.
if the renamed field is "_HOSTNAME", in config it should be "___HOSTNAME". Only one preceding underscore is needed.
Renamed field names with only one underscore in config are considered as without preceding underscore:
if there is "_HOSTNAME" in config the plugin searches for "HOSTNAME" field.

**Example common:**
```yaml
pipelines:
example_pipeline:
Expand All @@ -543,14 +548,59 @@ pipelines:
...
```

The resulting event could look like:
```yaml
Input event:

```
{
"my_object": {
"field": {
"new_sub_field":"value"
"subfield":"value"
}
},
}
}
```

Output event:

```
{
"my_object": {
"field": {
"new_sub_field":"value" # renamed
}
}
}
```

**Example journalctl:**
```yaml
pipelines:
example_pipeline:
...
actions:
- type: rename
override: false
__HOSTNAME: host
___REALTIME_TIMESTAMP: ts
...
```

Input event:

```
{
"_HOSTNAME": "example-host",
"__REALTIME_TIMESTAMP": "1739797379239590"
}
```

Output event:

```
{
"host": "example-host", # renamed
"ts": "1739797379239590" # renamed
}
```

[More details...](plugin/action/rename/README.md)
Expand Down
60 changes: 55 additions & 5 deletions plugin/action/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -374,7 +374,12 @@ It renames the fields of the event. You can provide an unlimited number of confi
When `override` is set to `false`, the field won't be renamed in the case of field name collision.
Sequence of rename operations isn't guaranteed. Use different actions for prioritization.

**Example:**
**Note**: if the renamed field name starts with underscore "_", it should be escaped with preceding underscore. E.g.
if the renamed field is "_HOSTNAME", in config it should be "___HOSTNAME". Only one preceding underscore is needed.
Renamed field names with only one underscore in config are considered as without preceding underscore:
if there is "_HOSTNAME" in config the plugin searches for "HOSTNAME" field.

**Example common:**
```yaml
pipelines:
example_pipeline:
Expand All @@ -386,14 +391,59 @@ pipelines:
...
```

The resulting event could look like:
```yaml
Input event:

```
{
"my_object": {
"field": {
"new_sub_field":"value"
"subfield":"value"
}
},
}
}
```

Output event:

```
{
"my_object": {
"field": {
"new_sub_field":"value" # renamed
}
}
}
```

**Example journalctl:**
```yaml
pipelines:
example_pipeline:
...
actions:
- type: rename
override: false
__HOSTNAME: host
___REALTIME_TIMESTAMP: ts
...
```

Input event:

```
{
"_HOSTNAME": "example-host",
"__REALTIME_TIMESTAMP": "1739797379239590"
}
```

Output event:

```
{
"host": "example-host", # renamed
"ts": "1739797379239590" # renamed
}
```

[More details...](plugin/action/rename/README.md)
Expand Down
60 changes: 55 additions & 5 deletions plugin/action/rename/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,12 @@ It renames the fields of the event. You can provide an unlimited number of confi
When `override` is set to `false`, the field won't be renamed in the case of field name collision.
Sequence of rename operations isn't guaranteed. Use different actions for prioritization.

**Example:**
**Note**: if the renamed field name starts with underscore "_", it should be escaped with preceding underscore. E.g.
if the renamed field is "_HOSTNAME", in config it should be "___HOSTNAME". Only one preceding underscore is needed.
Renamed field names with only one underscore in config are considered as without preceding underscore:
if there is "_HOSTNAME" in config the plugin searches for "HOSTNAME" field.

**Example common:**
```yaml
pipelines:
example_pipeline:
Expand All @@ -15,14 +20,59 @@ pipelines:
...
```

The resulting event could look like:
```yaml
Input event:

```
{
"my_object": {
"field": {
"subfield":"value"
}
}
}
```

Output event:

```
{
"my_object": {
"field": {
"new_sub_field":"value"
"new_sub_field":"value" # renamed
}
},
}
}
```

**Example journalctl:**
```yaml
pipelines:
example_pipeline:
...
actions:
- type: rename
override: false
__HOSTNAME: host
___REALTIME_TIMESTAMP: ts
...
```

Input event:

```
{
"_HOSTNAME": "example-host",
"__REALTIME_TIMESTAMP": "1739797379239590"
}
```

Output event:

```
{
"host": "example-host", # renamed
"ts": "1739797379239590" # renamed
}
```

<br>*Generated using [__insane-doc__](https://github.com/vitkovskii/insane-doc)*
60 changes: 55 additions & 5 deletions plugin/action/rename/rename.go
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,12 @@ It renames the fields of the event. You can provide an unlimited number of confi
When `override` is set to `false`, the field won't be renamed in the case of field name collision.
Sequence of rename operations isn't guaranteed. Use different actions for prioritization.

**Example:**
**Note**: if the renamed field name starts with underscore "_", it should be escaped with preceding underscore. E.g.
if the renamed field is "_HOSTNAME", in config it should be "___HOSTNAME". Only one preceding underscore is needed.
Renamed field names with only one underscore in config are considered as without preceding underscore:
if there is "_HOSTNAME" in config the plugin searches for "HOSTNAME" field.

**Example common:**
```yaml
pipelines:
example_pipeline:
Expand All @@ -23,14 +28,59 @@ pipelines:
...
```

The resulting event could look like:
```yaml
Input event:

```
{
"my_object": {
"field": {
"subfield":"value"
}
}
}
```

Output event:

```
{
"my_object": {
"field": {
"new_sub_field":"value"
"new_sub_field":"value" # renamed
}
},
}
}
```

**Example journalctl:**
```yaml
pipelines:
example_pipeline:
...
actions:
- type: rename
override: false
__HOSTNAME: host
___REALTIME_TIMESTAMP: ts
...
```

Input event:

```
{
"_HOSTNAME": "example-host",
"__REALTIME_TIMESTAMP": "1739797379239590"
}
```

Output event:

```
{
"host": "example-host", # renamed
"ts": "1739797379239590" # renamed
}
```
}*/

Expand Down