Notebook Logs

[DennesTorres]

Hi,

We can link a workspace with log analytics, I did with mine.

How could I from a notebook generate a log which is recorded in the log analytics linked to the workspace ?

Kind Regards,

Dennes

[v-nikhilan-msft · Accepted solution]

Hi @DennesTorres 
Thanks for using Fabric Community.
You can add a code cell in your notebook as follows:

// Test log4j MDC/NDC
// https://github.com/mspnp/spark-monitoring/issues/28 
import org.apache.log4j.MDC 
val LOGGER_PREFIX = "[Gluten]" 
val logger = org.apache.log4j.LogManager.getLogger(LOGGER_PREFIX + " " +
"com.contoso.LoggerExample") 

logger.info("Hello, info message") 
logger.warn("Hello, warn message") 
logger.error("Hello, error message")

You can validate the log here:

Hope this helps. Please let me know if you have any further queries.

[DennesTorres]

Hi, @v-nikhilan-msft ,

This example seems made for Databricks, I couldn't manage to make it work in Fabric.

First problem is the import: This library doesn't exist and pip install doesn't work for it as well. Is there other way to make this import work ?

I tried to work around the import in two different way:

First attempt:

logger = spark.sparkContext._jvm.org.apache.log4j.LogManager.getLogger(LOGGER_PREFIX + " " + "com.contoso.LoggerExample")

Second Attempt: 

logger = spark.sparkContext._jvm.org.apache.log4j.LogManager.getRootLogger()

The workspace was linked to log analytics. The table you exemplified in log analytics doesn't exist. I tried many other tables related to power bi or spark, but none of them registered the log messages.

What else am I missing?

Thank you in advance!

Kind Regards,

Dennes

[DennesTorres]

Thank you, this seems great!

[v-nikhilan-msft]

Hi @DennesTorres 
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks