Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

datetime fields' output_format : "unix_timestamp_nanos" returns incorrect (truncated) values #5007

Open
ddelemeny opened this issue May 20, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@ddelemeny
Copy link
Contributor

Describe the bug
Timestamps with nanosecond precision can't currently be retrieved without precision loss. The unix_timestamp_nanos output format returns truncated values.

Expected behavior
A timestamp ingested with nanosecond precision should be serialized back to its ingest value in search results when using the output format unix_timestamp_nanos.

Quickwit 0.8.0 (x86_64-unknown-linux-gnu 2024-04-25T10:11:08Z 9de883d)
version: 0.7

index_id: otel-logs-v0_7-FASTNANO

doc_mapping:
  mode: dynamic
  field_mappings:
    - name: timestamp_nanos
      type: datetime
      input_formats: [unix_timestamp]
      output_format: unix_timestamp_nanos
      indexed: false
      fast: true
      fast_precision: nanoseconds
    - name: observed_timestamp_nanos
      type: datetime
      input_formats: [unix_timestamp]
      output_format: unix_timestamp_nanos
    - name: severity_text
      type: text
      tokenizer: raw
      fast: true
    - name: severity_number
      type: u64
      fast: true
    - name: body
      type: json
      tokenizer: default
    - name: attributes
      type: json
      tokenizer: raw
      fast: true

  timestamp_field: timestamp_nanos

indexing_settings:
  commit_timeout_secs: 10

search_settings:
  default_search_fields: [body.message]

Blocking for quickwit-oss/quickwit-datasource#118

@ddelemeny ddelemeny added the bug Something isn't working label May 20, 2024
@trinity-1686a
Copy link
Contributor

related to quickwit-oss/tantivy#2380

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants