Use dagster's custom loggers in standard python functions called from solids

[ivanov-slk]

I can configure a custom logger (say, a file logger) which I can successfully use from within a solid from context.log.info (for example). How can I use that same logger from within a standard Python function / class ?

I am using the standard colored_console_logger so that I can directly see in the console what is happening. The idea is to swap it (or use alongside it) with another (custom) logger.

Reproducible example:
test_logging.py

from dagster import solid, pipeline, execute_pipeline, Field, ModeDefinition
from dagster.loggers import colored_console_logger

from random_func import random_func


@solid
def test_logs(context):
    context.log.info("Hello, world!")
    random_func()


@pipeline(mode_defs=[
    ModeDefinition(logger_defs={"console_logger": colored_console_logger})
])
def test_pipeline():
    test_logs()


if __name__ == "__main__":
    execute_pipeline(test_pipeline,
                     run_config={
                         'loggers': {
                             'console_logger': {
                                 'config': {
                                     'log_level': 'DEBUG',
                                     'name': 'console_logger',
                                 }
                             }
                         }
                     })

random_func.py

import logging

lgr = logging.getLogger('console_logger')


def random_func():
    lgr.info('in random func')
    print('\nhi\n')

[dpeng817]

I think we can support this by providing a top-level function to build an InitLoggerContext. Then, you could do something like this:

@logger
def basic_logger(init_context):
    ...

init_context = build_logger_context()
logger = basic_logger.logger_fn(init_context)

Will put this on the radar for 0.12.0

[OwenKephart]

As of 0.13.0, you can use the get_dagster_logger() function (from dagster import get_dagster_logger) to get a logger within the body of a function that will work essentially identically to context.log