Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clickhouse SQL Query CSV download doesn’t give full data #138

Open
chiragb1994 opened this issue Feb 10, 2023 · 3 comments
Open

Clickhouse SQL Query CSV download doesn’t give full data #138

chiragb1994 opened this issue Feb 10, 2023 · 3 comments
Labels
clarification Waiting for clarification

Comments

@chiragb1994
Copy link

System info: driver version - 1.0.1
Metabase version: v0.45.2.1

My Query: select * from user_seen_fares limit 10000
I expect 10000 rows in CSV but I get 270 on the first try and 223 on the second try.
I see an error in the logs. Stack trace:

2023-02-09 05:38:25,675 DEBUG middleware.log :: #033[32mPOST /api/dataset/csv 202 [ASYNC: canceled] 1.0 s (6 DB calls) App DB connections: 0/10 Jetty threads: 2/50 (7 idle, 0 queued) (121 total active threads) Queries in flight: 0 (0 queued); clickhouse DB 2 connections: 0/1 (0 threads blocked)#033[0m
2023-02-09 05:38:26,042 ERROR middleware.catch-exceptions :: Error processing query: Error running query
{:database_id 2,
:started_at #t "2023-02-09T05:38:24.671878Z[UTC]",
:json_query
{:type "native",
:native {:query "select * from user_seen_fares limit 10000", :template-tags {}},
:database 2,
:middleware {:process-viz-settings? true, :skip-results-metadata? true, :format-rows? false},
:async? true,
:viz-settings
{:table.pivot false,
:table.pivot_column "is_hand_baggage_only_fare",
:table.cell_column "provider",
:table.column_formatting [],
:metabase.shared.models.visualization-settings/column-settings {},
:metabase.shared.models.visualization-settings/table-columns
[{:metabase.shared.models.visualization-settings/table-column-name "provider",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "provider" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "is_hand_baggage_only_fare",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "is_hand_baggage_only_fare" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "base_fare",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "base_fare" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "total_fare_for_one_adult",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "total_fare_for_one_adult" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "offered_fare",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "offered_fare" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "published_fare",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "published_fare" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "taxes",
:metabase.shared.models.visualization-settings/table-column-field-ref [:field "taxes" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fees",
:metabase.shared.models.visualization-settings/table-column-field-ref [:field "fees" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "inbound_fare",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "inbound_fare" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "outbound_fare",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "outbound_fare" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "discount",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "discount" {:base-type :type/Float}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "cabin_class",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "cabin_class" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "is_refundable",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "is_refundable" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "currency_code",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "currency_code" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "is_return",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "is_return" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "timestamp",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "timestamp" {:base-type :type/BigInteger}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "timestamp_datetime",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "timestamp_datetime" {:base-type :type/DateTime}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "overall_journey_key",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "overall_journey_key" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "origin",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "origin" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "origin_city",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "origin_city" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "origin_state",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "origin_state" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "origin_country",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "origin_country" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "destination",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "destination" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "destination_city",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "destination_city" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "destination_state",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "destination_state" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "destination_country",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "destination_country" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "departure_date",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "departure_date" {:base-type :type/Date}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "departure_time",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "departure_time" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "flight_keys",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "flight_keys" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "seats_remaining",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "seats_remaining" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fare_types",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fare_types" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "num_of_adult",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "num_of_adult" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "num_of_children",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "num_of_children" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "num_of_infant",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "num_of_infant" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "user_id",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "user_id" {:base-type :type/TextLike}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "departure_timestamp",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "departure_timestamp" {:base-type :type/BigInteger}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "return_date",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "return_date" {:base-type :type/Date}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_departure_timestamp",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_departure_timestamp" {:base-type :type/BigInteger}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "arrival_time",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "arrival_time" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "forward_duration",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "forward_duration" {:base-type :type/BigInteger}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "return_duration",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "return_duration" {:base-type :type/BigInteger}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "pax_combination_type",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "pax_combination_type" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "is_international",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "is_international" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_flight_number",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_flight_number" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_flight_number",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_flight_number" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_flight_codes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_flight_codes" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_flight_codes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_flight_codes" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_duration_in_minutes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_duration_in_minutes" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_duration_in_minutes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_duration_in_minutes" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_layover_time_in_minutes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_layover_time_in_minutes" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_layover_time_in_minutes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_layover_time_in_minutes" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_total_layover_time_in_minutes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_total_layover_time_in_minutes" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_total_layover_time_in_minutes",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_total_layover_time_in_minutes" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_num_of_stops",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_num_of_stops" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_num_of_stops",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_num_of_stops" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_layovers",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_layovers" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_layovers",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_layovers" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_airport_terminals",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_airport_terminals" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_airport_terminals",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_airport_terminals" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_checkin_baggages",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_checkin_baggages" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_checkin_baggages",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_checkin_baggages" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_cabin_baggages",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_cabin_baggages" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_cabin_baggages",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_cabin_baggages" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_arrival_timestamp",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_arrival_timestamp" {:base-type :type/BigInteger}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ret_arrival_timestamp",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ret_arrival_timestamp" {:base-type :type/BigInteger}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "session_id_time_util",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "session_id_time_util" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "search_id",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "search_id" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_first_flight_code",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_first_flight_code" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "fwd_first_airline_code",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "fwd_first_airline_code" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "hours_till_departure",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "hours_till_departure" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "advance_purchase_days",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "advance_purchase_days" {:base-type :type/Integer}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "result_search_id",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "result_search_id" {:base-type :type/Text}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "scrapper_ids",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "scrapper_ids" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "scrapper_search_ids",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "scrapper_search_ids" {:base-type :type/Array}],
:metabase.shared.models.visualization-settings/table-column-enabled true}
{:metabase.shared.models.visualization-settings/table-column-name "ingestion_time",
:metabase.shared.models.visualization-settings/table-column-field-ref
[:field "ingestion_time" {:base-type :type/DateTime}],
:metabase.shared.models.visualization-settings/table-column-enabled true}]}},
:status :failed,
:class org.eclipse.jetty.io.EofException,
:stacktrace
["org.eclipse.jetty.server.HttpConnection$SendCallback.reset(HttpConnection.java:735)"
"org.eclipse.jetty.server.HttpConnection$SendCallback.access$300(HttpConnection.java:694)"
"org.eclipse.jetty.server.HttpConnection.send(HttpConnection.java:553)"
"org.eclipse.jetty.server.HttpChannel.sendResponse(HttpChannel.java:1009)"
"org.eclipse.jetty.server.HttpChannel.write(HttpChannel.java:1086)"
"org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:285)"
"org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:269)"
"org.eclipse.jetty.server.HttpOutput.flush(HttpOutput.java:751)"
"java.base/java.util.zip.DeflaterOutputStream.flush(DeflaterOutputStream.java:282)"
"--> async.streaming_response$delay_output_stream$fn__20038.invoke(streaming_response.clj:119)"
"async.streaming_response.proxy$java.io.OutputStream$ff19274a.flush(Unknown Source)"
"query_processor.streaming.csv$fn$reify__39795.finish_BANG_(csv.clj:39)"
"query_processor.streaming$streaming_reducedf$fn__40560.invoke(streaming.clj:128)"
"query_processor.context$reducedf.invokeStatic(context.clj:77)"
"query_processor.context$reducedf.invoke(context.clj:72)"
"query_processor.context.default$default_reducef.invokeStatic(default.clj:63)"
"query_processor.context.default$default_reducef.invoke(default.clj:48)"
"query_processor.context$reducef.invokeStatic(context.clj:69)"
"query_processor.context$reducef.invoke(context.clj:62)"
"query_processor.context.default$default_runf$respond_STAR___39690.invoke(default.clj:68)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:506)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:485)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:493)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:485)"
"driver.sql_jdbc$fn__88601.invokeStatic(sql_jdbc.clj:58)"
"driver.sql_jdbc$fn__88601.invoke(sql_jdbc.clj:56)"
"query_processor.context$executef.invokeStatic(context.clj:59)"
"query_processor.context$executef.invoke(context.clj:48)"
"query_processor.context.default$default_runf.invokeStatic(default.clj:67)"
"query_processor.context.default$default_runf.invoke(default.clj:65)"
"query_processor.context$runf.invokeStatic(context.clj:45)"
"query_processor.context$runf.invoke(context.clj:39)"
"query_processor.reducible$identity_qp.invokeStatic(reducible.clj:12)"
"query_processor.reducible$identity_qp.invoke(reducible.clj:9)"
"query_processor.middleware.cache$maybe_return_cached_results$maybe_return_cached_results_STAR___53600.invoke(cache.clj:220)"
"query_processor.middleware.permissions$check_query_permissions$fn__49259.invoke(permissions.clj:109)"
"query_processor.middleware.mbql_to_native$mbql__GT_native$fn__52545.invoke(mbql_to_native.clj:23)"
"query_processor$fn__55076$combined_post_process__55081$combined_post_process_STAR___55082.invoke(query_processor.clj:212)"
"query_processor$fn__55076$combined_pre_process__55077$combined_pre_process_STAR___55078.invoke(query_processor.clj:209)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__53521$fn__53526.invoke(resolve_database_and_driver.clj:35)"
"driver$do_with_driver.invokeStatic(driver.clj:76)"
"driver$do_with_driver.invoke(driver.clj:72)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__53521.invoke(resolve_database_and_driver.clj:34)"
"query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__49525.invoke(fetch_source_query.clj:314)"
"query_processor.middleware.store$initialize_store$fn__49715$fn__49716.invoke(store.clj:11)"
"query_processor.store$do_with_store.invokeStatic(store.clj:45)"
"query_processor.store$do_with_store.invoke(store.clj:39)"
"query_processor.middleware.store$initialize_store$fn__49715.invoke(store.clj:10)"
"query_processor.middleware.normalize_query$normalize$fn__53793.invoke(normalize_query.clj:22)"
"query_processor.middleware.constraints$add_default_userland_constraints$fn__50803.invoke(constraints.clj:53)"
"query_processor.middleware.process_userland_query$process_userland_query$fn__53732.invoke(process_userland_query.clj:145)"
"query_processor.middleware.catch_exceptions$catch_exceptions$fn__54104.invoke(catch_exceptions.clj:167)"
"query_processor.reducible$async_qp$qp_STAR___45514$thunk__45516.invoke(reducible.clj:100)"
"query_processor.reducible$async_qp$qp_STAR___45514$fn__45518.invoke(reducible.clj:105)"],
:card_id nil,
:context :csv-download,
:error nil,
:row_count 0,
:running_time 0,
:data {:rows [], :cols []}}
2023-02-09 05:38:39,873 DEBUG middleware.log :: #033[32mPOST /api/dataset 202 [ASYNC: completed] 2.0 s (6 DB calls) App DB connections: 1/10 Jetty threads: 3/50 (7 idle, 0 queued) (121 total active threads) Queries in flight: 0 (0 queued); clickhouse DB 2 connections: 0/1 (0 threads blocked)#033[0m
@paoliniluis
Copy link

Is this a normal table? a pivot table? does the table have any specific visualization setting that might be relevant to debug the issue?

@chiragb1994
Copy link
Author

chiragb1994 commented Feb 14, 2023

This is not table specific. I tried for a smaller table. It has 265k rows but in CSV I get around 20k rows.

Table structure:

CREATE TABLE distributed.archival_archives
(
    `db_table` LowCardinality(FixedString(50)),
    `start_millis` UInt64,
    `end_millis` UInt64,
    `file_index` UInt16,
    `num_rows` UInt64,
    `file_path` String,
    `partition_column` LowCardinality(FixedString(50)) ALIAS db_table
)
ENGINE = Distributed('dwh_cluster', 'replica', 'archival_archives_dist', sipHash64(db_table, start_millis))

Exception:

:class org.eclipse.jetty.io.EofException,

To me, it seems like an issue with pagination handling.

@slvrtrn
Copy link
Collaborator

slvrtrn commented Feb 17, 2023

@paoliniluis, do you think it might be a Metabase bug? I see no driver source mention in the stack trace.

@slvrtrn slvrtrn added the clarification Waiting for clarification label Mar 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
clarification Waiting for clarification
Projects
None yet
Development

No branches or pull requests

3 participants