You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In #150, In order to enhance our query performance after users send the API request to run our data endpoint to get the result from the data source. We need to provide a Caching (pre-loading) Layer with the duckDB to enhance query performance.
Describe the solution you’d like
According to #153, we should make sure the DataSource have export method contract or not, if not please add it to make your BQDataSource could implement it.
exportinterfaceExportOptions{// The sql query result to exportsql: string;// The directory to export result to filedirectory: string;// The profile name to select to export dataprofileName: string;// export file format typetype: CacheLayerStoreFormatType|string;}
.....
@VulcanExtension(TYPES.Extension_DataSource,{enforcedId: true})exportabstractclassDataSource<C=any,PROFILE=Record<string,any>>extendsExtensionBase<C>{privateprofiles: Map<string,Profile<PROFILE>>;constructor(
@inject(TYPES.ExtensionConfig)config: C,
@inject(TYPES.ExtensionName)moduleName: string,
@multiInject(TYPES.Profile) @optional()profiles: Profile[]=[]){super(config,moduleName);this.profiles=profiles.reduce((prev,curr)=>prev.set(curr.name,curr),newMap());}
..../** * Export query result data to cache file for cache layer loader used */publicexport(options: ExportOptions): Promise<void>{thrownewError(`Export method not implemented`);}
.....}
What’s the problem you're trying to solve
In #150, In order to enhance our query performance after users send the API request to run our data endpoint to get the result from the data source. We need to provide a Caching (pre-loading) Layer with the duckDB to enhance query performance.
Describe the solution you’d like
According to #153, we should make sure the
DataSource
haveexport
method contract or not, if not please add it to make yourBQDataSource
could implement it.Additional Context
BigQuery support export the result to parquet by SQL syntax, refer export data to Parquet format by sql, and use @google-cloud/bigquery to send a query.
The text was updated successfully, but these errors were encountered: