Keebo Product Update – December 2023

The Keebo engineering team is always working on new features and improvements. Our latest update to Keebo Warehouse Optimization for Snowflake brings you more security, privacy, and fine-grained control. Here are the highlights.

You can read about previous updates here.

Support for AWS PrivateLink

If your organization requires that data never traverses the public internet, we have good news for you. Keebo now supports AWS PrivateLink so you can connect us to your Snowflake warehouses without any data leaving your private network. AWS PrivateLink allows you to connect your VPC to other services, now including Keebo, as if they were in your VPC. You control the specific API endpoints, sites, and services that you want to reach from your VPC.

To use a PrivateLink endpoint, there are some initial steps to take before provisioning Keebo, and we can give you that information when we are setting up your free trial (or if you already have Keebo running, contact your Keebo account manager). Once the endpoint is ready to go, you simply specify it in the advanced settings of the Keebo portal, where we include the Snowflake credentials that Keebo uses:

privatelink endpoint shadow bkgnd

If you are new to Keebo, this Snowflake user name, role, and schema you see in the screenshot are what Keebo uses to do our analysis and optimization of your warehouses. These only have access to usage metadata, not to any user or business data. You can see all the details about this account here.

Controlling Change Detection

When a member of your data team changes a Snowflake warehouse parameter, such as the warehouse size or suspend interval, Keebo pauses optimizations for that warehouse. We do this because if Keebo and your data team keep changing parameters back-and-forth, this could cause performance issues for your users, not to mention be very frustrating for your data team.

However, our customers wanted more control in these circumstances, so we now allow fine-grained control over Keebo’s change detection behavior. This allows an even more hands-off approach if you’d like, which could be especially valuable if you have many warehouses being optimized. In large and busy environments, it can be hard to keep track of all the changes going on, which can result in warehouses not being optimized for a long time and thus less Snowflake savings for you.

When you go to the edit button of a warehouse in the Keebo portal, you’ll notice these new settings:

change detection settings shadow bkgnd

There are two choices for you:

  • Pause optimizations. This is the default behavior. Like with previous versions of Keebo, we will pause optimizations when a change is made. However, we will now auto-resume if the warehouse is set back to the default settings. Or, like before, we will resume once you re-enable Keebo for that warehouse.
  • Keep optimizing. In this case, we will make the latest changes the new default settings and then keep optimizing.

To illustrate how this works, let’s consider what will happen if a member of your data team changed the warehouse size from large to medium:

  • With a setting of “pause optimizations” (the default) Keebo will stop optimizing the warehouse until you re-enable it, or until your data team changes the size back to large.
  • With a setting of “keep optimizing” Keebo will make medium the new default size and keep going.

As a reminder, you can re-enable a Keebo warehouse in the settings screen of the portal. In this screenshot you can see that the “Bravo” warehouse is disabled but it can be re-enabled with a simple flick of a switch:

disabled warehouse shadow bkgnd

Also remember that Keebo will email you whenever Keebo is disabled by change detection. If you’d like to manage this, go to your Keebo user account by clicking your account name/icon in the upper right corner and then choosing “My Account.” You can then control how often you get notifications about all kinds of Keebo operations, including “external warehouse changes” which is what we are discussing here:

manage notifications shadow bkgnd

If you haven’t visited these email settings before, you should do so now. You can get informative reports on optimizations as well as notifications to make sure you aren’t leaving any money on the table by being unaware of warehouses that aren’t being optimized.

Thanks for a Great Year!

We hope you’ve enjoyed using Keebo in 2023 and seeing big savings with our fully automated Snowflake optimizations. We wish you a prosperous new year in 2024! Look for more new features and products from us in the months ahead. If you haven’t seen our top 5 blogs of 2023 (by number of unique viewers), here are some links so you can check them out:

  1. Lessons from Instacart and Snowflake: Why We Need a Paradigm Shift
  2. How Top Snowflake Customers Optimize Costs
  3. Snowflake Optimization: Avoiding Query Mistakes
  4. Snowflake Optimization: Warehouse Settings
  5. Keebo Product Update – September 2023
Carl Dubler
Carl Dubler
Articles: 35