December is often a busy time of last-minute buying, events, celebrations, and wrapping items. As we closed out December, we spent lots of time giving the present of extra nice options and enhancements to the Atlan platform.

Listed here are our 11 favourite options from December 2022, that includes new integrations, insights, price optimizations, automations, metrics, and extra.

Supporting and integrating your (meta)information household

The 12 months’s finish is a superb time to mirror on the previous 12 months and look ahead to the 12 months forward. At Atlan, we need to create the lively metadata layer throughout your entire information stack. From fashionable cloud warehouses to conventional documentation instruments, we launched new connections and integrations in December to assist all of your wants.

1. New Hive Connector bundle

Individuals typically ask about our assist for file techniques like Parquet, Avro, Iceberg, and extra. We all know all your information is essential, so we’re excited to introduce our Hive integration to deal with these distributed file techniques.

Now you’ll be able to hook up with Hive, catalog all your tables, and consider pattern information extracted from the desk. As soon as the information is introduced in, customers can leverage the asset 360° profiles for his or her Hive property to assign possession, apply certificates, tag classifications, affiliate the right enterprise phrases, and even run queries to additional discover the information.

2. Google Sheets: assist for brand spanking new information property and downloadable lineage influence evaluation

Spreadsheets have at all times been the OG of knowledge documentation. Earlier within the 12 months, we launched our integration with Google Sheets to hurry up the metadata documentation course of for information groups. Now, we now have expanded that integration to make documentation even simpler and extra sturdy throughout your whole information property.

Now you’ll be able to import column-level metadata from Tableau information sources, Energy BI tables, Looker Explores, and Salesforce objects straight into Google Sheets. This makes it simpler to doc metadata from a number of information property, lowering handbook documentation and releasing up priceless time for information groups.

As well as, now you can fetch and obtain an information asset’s downstream influence in Google Sheets. Understanding how a easy change to 1 asset can influence property downstream is vital to the steadiness and belief of the enterprise. One change to a dataset upstream can create chaos in downstream information pipelines and dashboards, leading to a disruption to the enterprise. This downstream influence evaluation will assist customers stop breaks and keep belief as they modify upstream property.

Purchasing the preferred information property and saving on prices

Each vacation season, individuals are searching for methods to seek out and save on these “must-have” objects. Wouldn’t it’s nice if we might assist information groups and information customers with the identical idea? This set of releases helps information groups not solely save prices but additionally perceive the “most-used” property of their information property.

3. Value-optimized information preview for BigQuery

Everyone seems to be wanting to economize through the holidays, and it’s no totally different in relation to your cloud information warehouse payments.

With this launch, customers can now get monetary savings with a brand new information preview characteristic for all BigQuery table-type property. Out there within the Belongings and Insights tab, customers obtain a value nudge with the exact bytes that will likely be spent whereas executing a question. This seems for all property, similar to views, materialized views, and so forth. From there, customers can resolve in the event that they nonetheless need to proceed operating the question based mostly on the quantity of bytes spent.

4. Reputation and utilization metrics for Snowflake

Controlling information prices typically comes all the way down to understanding which information property you’ll be able to belief, which have contemporary information, that are used typically, and which may be eradicated. That’s why we’ve added new utilization and recognition metrics to assist information groups handle their Snowflake property.

Use these capabilities to avoid wasting cloud information warehouse spending prices by figuring out essentially the most used property, studying which queries are gradual or costly, discovering folks with essentially the most context on every information asset, and extra.

Empowering everybody with queries and insights

Whether or not you have fun the tip of the 12 months with Christmas, Hanukkah, Kwanzaa, or one other custom fully, the vacations are about embracing range — and Atlan is simply the identical. Information groups like to question data in quite a lot of methods. One of many methods we assist this range is thru Atlan’s Insights tab, the place you should utilize customized SQL-based queries to discover and analyze all your information property. Now we now have made this expertise even simpler, extra intuitive, and extra highly effective.

5. Search and kind capabilities come to question outcomes

Who doesn’t love to question information? However what occurs when the outcomes are within the incorrect order, otherwise you neglect to write down a kind command in your SQL? Or what if you happen to merely can’t discover an merchandise within the outcomes that you simply’re searching for?

At Atlan, we by no means miss an opportunity to reinforce our consumer expertise. Now, with simply the press of a button, you’ll be able to type the information columns in both ascending or descending order. You too can use the search bar to seek out an merchandise you need and get the outcomes you want. These two capabilities restrict the necessity for SQL and cut back the variety of queries you want to get the correct outcomes.

6. Higher management over question collections

Capturing and disseminating essential data is vital for empowering numerous information folks and serving to them succeed.

With this launch, extra folks can add their data to question collections. Whereas solely the gathering proprietor can delete a set, different members can now invite, replace, and handle the gathering. All of this ensures that essential data is captured and maintained even when the question proprietor leaves or is unavailable.

7. Updates to the Insights Dashboard

Understanding how individuals are querying your group’s information generally is a problem. Now, within the Atlan Reporting Middle, you will get the insights you want with the Insights tab.

• Examine what number of visible queries have been saved, and who the highest customers are
• Monitor the entire saved queries, for each SQL and visible queries
• Discover all scheduled queries arrange in Atlan, sorted by frequency, together with the highest customers scheduling queries
• Discover different facets like connectors, licensed property, classifications, and extra.

Activating the trendy information stack with end-to-end lineage

Information lineage performs a key function in fixing issues like root trigger evaluation or influence evaluation. And the extra numerous your information property, the extra essential lineage turns into for understanding how they’re all associated. That’s why Atlan is all about activating end-to-end information lineage in your whole information property, from information sources to the BI layer.

8. New Atlan + dbt partnership is now GA!

A few of you will have heard about Atlan and dbt’s partnership and Semantic Layer integration. At this time, we’re excited to launch Atlan + dbt for everybody!

Atlan pulls in metrics and fashions from dbt and maps column-level lineage throughout the trendy information stack, creating 360° context in your information and serving to information groups work collectively higher. Atlan’s deep integration with dbt and its Semantic Layer additionally allows you to create repeatable, metadata properties — like desk house owners and verified tags — in your dbt fashions.

9. Listing-based search in lineage graphs

When making an attempt to view a big lineage graph, the power to seek for property in that graph is useful. To make that have way more seamless, we now have launched list-based search that will help you rapidly discover lineage.

The entire property in a graph will now present up as a listing as quickly as you attempt to search the lineage graph. Merely click on or sort the asset identify you might be searching for, and the asset and its related lineage will likely be highlighted.

Delivering the magic of automation

The tip of the 12 months is often hectic — a lot to do, so little time. Wouldn’t it’s nice if there was a magic wand to assist full the entire duties that you’ve in your record?

Whereas we aren’t magicians right here at Atlan, we do like to automate wherever potential. Previously, we’ve introduce options like our Google integration or Trident solutions to automate handbook duties. However this month included our greatest automation win to this point.

10. Introducing Atlan Playbooks

One of many widespread questions we get from information groups is, “How can we automate our metadata?” Whereas different groups like advertising or gross sales can do action-based automation at scale with instruments like Zapier or Salesforce, information groups don’t have the bandwidth to code customized automations for every numerous use case. Why can’t there be a Zapier for metadata?

That’s the reason we now have developed the primary low-code/no-code metadata automation for information groups. With Atlan’s Playbooks, customers can now create rule-based automations at scale. These can drive countless use circumstances throughout your group, all the things from deprecating unused property and defending delicate information to altering possession and reporting failed property.

Including a sprinkle of vacation cheer for Admins

We will always remember those that are accountable for governing and managing a company’s information property. Sure, the admins. The individuals who play one of the essential roles in a company — disseminating the information property that information groups must assist numerous enterprise use circumstances.

11. New overview web page for Workflows

Workflows is a busy place, with connections to create, jobs to run, and the newest runs to watch. All of this may be tough for admins to handle with out a single view into all these actions. To make life simpler, we now have added an outline web page for every connection, permitting admins to immediately get details about the newest runs for a selected workflow and extra.

We’re at all times working to assist information groups get essentially the most from metadata throughout their information property, and this month’s new options are only a few of the 200 updates we delivered all year long. Try our favourite options from 2022 or our November product roundup for much more metadata magic.

💡 To study extra in regards to the newest options in Atlan, try shipped.atlan.com. You too can subscribe to our Product Updates publication for all updates.

💡 To study extra about all of our releases, try shipped.atlan.com. You too can subscribe to our Product Updates publication for all the newest information.

💡 To take a look at Atlan for your self, go to our product tour.

💡 Prepared to start out utilizing these new options? Attain out to our Gross sales crew or your Buyer Success Supervisor to learn the way.