Summary

The context describes a process of setting up Databricks job notifications in Microsoft Teams using Incoming Webhook.

Abstract

The content of the context provides a step-by-step guide on how to set up Databricks job notifications in Microsoft Teams. It begins by explaining the need for this setup and proceeds to outline the steps required to add an Incoming Webhook app in Teams. It then moves on to describe how to set up notifications in Databricks using the previously generated webhook URL. The process involves adding a new system destination, selecting Microsoft Teams as the destination type, and inputting the webhook URL. The final step is to choose when a notification should be sent. The content also includes images for visual guidance and ends with an example of what the interactive card posted in the Teams channel looks like after the notification condition is met.

Bullet points

The guide is for sending Databricks Job notifications to a Teams channel.
The first step is setting up the 'Incoming Webhook' app in Teams.
The guide provides a step-by-step process to add the Incoming Webhook app.
The guide also includes steps to set up job notifications in Databricks.
The process involves adding a new system destination and selecting Microsoft Teams as the destination type.
The guide includes images for visual guidance.
The guide ends with an example of what the interactive card posted in the Teams channel looks like.

Databricks Notifications in Microsoft Teams

Tired of Databricks Job notifications disappearing in a random mailbox to be never seen again? There is a different way. With a little bit of webhook-magic we can send notifications to a Teams channel. This is great when you want to share the outcomes of Databricks jobs with your team and/or stakeholders.

Webhook Incoming!

First we need to set up the ‘Incoming Webhook’ app in Teams. Let’s do this in five simple steps:

Open the Teams channel in which you want to add the webhook and select ••• from the upper-right corner.
Then select ‘Connectors’ from the drop down.

3. Search for ‘Incoming Webhook’ and select ‘Add’.

Sidenote: Your Teams administrator must have enabled the use of the ‘Incoming Webhook’ app in the Teams Admin Portal.

4. Select ‘Configure’, then provide a fitting name. You can also upload an image if you so desire.

5. Make sure to save the unique webhook URL. This is the bit of webhook magic which lets you send messages to the channel. Click ‘Done’ after saving the URL.

Now that we have our webhook URL we can set up some job notifications in Databricks.

Getting your notifications set up in Databricks is fast and easy. The only prerequisite is that that you have admin access, or access to an admin. Simply find the job (or task) you want notifications for and proceed with the following steps:

Locate the job or task you want to set up a notification for and click on ‘Edit notifications’.

2. In the pop-up, click on ‘Add notification’.

3. Here click ‘Add new system destination’. A new tab will open where you can add a destination.

4. Select ‘Microsoft Teams’ as the destination type. Think of a name for your destination and add the previously generated webhook url.

5. Go back and redo steps 1 & 2. This time you will be able to select your teams webhook destination.

6. Choose when you want a notification to be sent, and click ‘Save’. All done!

The Notification

After the condition for the notification is met, an interactive card like the one below will be posted in the channel. Pretty neat!