---
title: "Markit EDM Best Practices: Database Cleanup Strategy"
description: Huge Markit EDM database causing problems? Here's how we cleaned up a 200+ GB database to improve functionality and cut big costs for one FinServ company.
image: https://blog.continuus.ai/hubfs/2016%20Blog%20Images/Markit%20EDM%20Best%20Practices_Database%20Cleanup%20Strategy_161221.png
---

[Skip to content](https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy#main-content)

[![Continuus Logo 2024 - Horizontal - Full Color - Padded-1](https://blog.continuus.ai/hs-fs/hubfs/Continuus%20Logo%202024%20-%20Horizontal%20-%20Full%20Color%20-%20Padded-1.png?width=1803&height=665&name=Continuus%20Logo%202024%20-%20Horizontal%20-%20Full%20Color%20-%20Padded-1.png)](https://www.continuus.ai/)

- [Services](https://www.continuus.ai/services)
- [Partners](https://www.continuus-technologies.com/partners)
- Company
  
  Show submenu for Company 
  
    - [About](https://www.continuus.ai/about)
    - [Our Team](https://www.continuus.ai/our-team)
    - [Careers](https://www.continuus.ai/careers)
    - [News](https://www.continuus.ai/news-recognition)
- [Resources](https://blog.continuus-technologies.com/)
- [Contact](https://www.continuus-technologies.com/contact)

Open main navigation

Close main navigation

- [Services](https://www.continuus.ai/services)
- [Partners](https://www.continuus-technologies.com/partners)
- Company
  
  Show submenu for Company 
  
    - [About](https://www.continuus.ai/about)
    - [Our Team](https://www.continuus.ai/our-team)
    - [Careers](https://www.continuus.ai/careers)
    - [News](https://www.continuus.ai/news-recognition)
- [Resources](https://blog.continuus-technologies.com/)
- [Contact](https://www.continuus-technologies.com/contact)

[All posts](https://blog.continuus.ai/all)

 July 19, 2024

# Markit EDM Best Practices: Database Cleanup Strategy

![Picture of Matt Moeser](https://blog.continuus.ai/hs-fs/hubfs/continuus-tech-july2019-19%20(1).jpeg?width=50&name=continuus-tech-july2019-19%20(1).jpeg) By  [Matt Moeser](https://blog.continuus.ai/author/matt-moeser)  ·   1 minute read

[Return to Resources](https://blog.continuus.ai/)

How big is your Markit EDM database? If your installation was completed more than a few months ago, there’s a good chance it’s enormous. Often, Markit EDM is implemented at a financial services firm without putting policies in place for database size and maintenance. In many cases, databases approach hundreds of gigabytes of data in less than two years. This impacts the functionality of Markit, makes it difficult to refresh development environments, and costs your firm more for unneeded disc storage.

If you’re in this situation, it’s time to prune some data. While there are programs that can automate this process, it’s critical to remember that implementing an automated process on an extremely large database can yield unexpected (and unfortunate) results. A customized approach is much faster and will ensure that the right data is eliminated, archived, or selected to remain in the database.

Recently, we worked on a project for a financial services firm whose database had grown over several hundred Gigabytes of data. We began by meeting with the various business users to understand which tables contained large amounts of information that was not needed, which tables were duplicate information, and which tables needed to be archived for compliance or analysis purposes. We then built a custom process that removed over 200 GB of data, reallocated the newly available space, and re-indexed all the indexes that were affected – all in a single weekend. Once the database was cleaned up, we implemented an ongoing process that will keep the database a manageable size. This custom process is much simpler to implement and maintain than some other programmatic options the firm could have considered.

Of course, the best solution to database cleanup is to consider a data management policy during your Markit EDM installation. However, that doesn’t always happen. We understand. If you’re in a situation where the size of your database is impacting your firm’s performance, give us a call. We can help you improve your Markit EDM system’s performance, your ability to refresh your development environment, and achieve cost savings.

Share: [facebook-f icon](http://www.facebook.com/share.php?u=https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy) [linkedin-in icon](http://www.linkedin.com/shareArticle?mini=true&url=https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy) [twitter icon](https://twitter.com/intent/tweet?url=https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy) [pinterest-p icon](http://pinterest.com/pin/create/link/?url=https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy) [envelope icon](mailto:?body=https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy)

## Related posts

[![](https://blog.continuus.ai/hubfs/Automated%20Database%20Refresh%20with%20deltaRefresh%20for%20Markit%20EDM_191121.png)](https://blog.continuus.ai/automated-database-refresh-deltarefresh-markit-edm)

[Blog](https://blog.continuus.ai/tag/blog)

### [Automated Database Refresh with deltaRefresh for Markit EDM](https://blog.continuus.ai/automated-database-refresh-deltarefresh-markit-edm)

[![](https://blog.continuus.ai/hubfs/2019%20Blog%20Images/How%20Open-Source%20Can%20Transform%20Your%20Markit%20EDM%20Practice_190403/How%20Open-Source%20Can%20Transform%20Your%20Markit%20EDM%20Practice_Thumbnail_190403.png)](https://blog.continuus.ai/open-source-transform-markit-edm-practice)

[Blog](https://blog.continuus.ai/tag/blog)

### [How Open-Source Can Transform Your Markit EDM Practice](https://blog.continuus.ai/open-source-transform-markit-edm-practice)

[![](https://blog.continuus.ai/hubfs/Website%20Resources%20Header%20Graphic%20-%201000x800%20-%20Partnership%20Profile%20-%20Snowflake.png)](https://blog.continuus.ai/solution-brief-snowflake-continuus-partnership-profile)

[Snowflake](https://blog.continuus.ai/tag/snowflake)

### [Solution Brief | Snowflake and Continuus Partnership Profile](https://blog.continuus.ai/solution-brief-snowflake-continuus-partnership-profile)

### Pages

---

### Resources

---

[Home](https://www.continuus.ai/)

[Services](https://www.continuus.ai/services)

[Partners](https://www.continuus.ai/partners)

[About](https://www.continuus.ai/about)

 

[Our Team](https://www.continuus.ai/our-team)

[Careers](https://www.continuus.ai/careers)

[News](https://www.continuus.ai/news-recognition)

[Contact](https://www.continuus.ai/contact)

Blog Posts

Case Studies

Solution Briefs

Webinars

Demos

Videos

All

[Cookies Policy](https://www.continuus.ai/cookies-policy) | [Privacy Policy](https://www.continuus.ai/privacy-policy) | [Accessibility](https://www.continuus.ai/accessibility) | *©* [*Continuus Technologies*](https://www.continuus.ai/) *2024*

```json
{
  "@context" : "https://schema.org",
  "@type" : "BlogPosting",
  "author" : {
    "@type" : "Person",
    "name" : "Matt Moeser",
    "url" : "https://blog.continuus.ai/author/matt-moeser"
  },
  "dateModified" : "2024-07-19T19:19:06.805Z",
  "datePublished" : "2016-12-22T02:50:00.000Z",
  "headline" : "Markit EDM Best Practices: Database Cleanup Strategy",
  "image" : [ "https://blog.continuus.ai/hubfs/2016%20Blog%20Images/Markit%20EDM%20Best%20Practices_Database%20Cleanup%20Strategy_161221.png" ],
  "mainEntityOfPage" : {
    "@id" : "https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy",
    "@type" : "WebPage"
  },
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "url" : "https://blog.continuus.ai/hubfs/Continuus%20Logo%202024%20-%20Horizontal%20-%20Full%20Color%20-%20Padded-1.png"
    },
    "name" : "Continuus"
  }
}
```

```json
{
  "@context" : "http://schema.org",
  "@type" : "Article",
  "author" : {
    "@type" : "Person",
    "name" : [ "Matt Moeser" ],
    "url" : "https://blog.continuus.ai/author/matt-moeser"
  },
  "datePublished" : "2016-12-22T02:50:00+0000",
  "description" : "Huge Markit EDM database causing problems? Here's how we cleaned up a 200+ GB database to improve functionality and cut big costs for one FinServ company.",
  "headline" : "Markit EDM Best Practices: Database Cleanup Strategy",
  "image" : "https://21082575.fs1.hubspotusercontent-na1.net/hubfs/21082575/2016%20Blog%20Images/Markit%20EDM%20Best%20Practices_Database%20Cleanup%20Strategy_161221.png",
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "url" : "https://21082575.fs1.hubspotusercontent-na1.net/hubfs/21082575/Continuus%20Logo%202024%20-%20Horizontal%20-%20Full%20Color%20-%20Padded-1.png"
    },
    "name" : "Continuus"
  },
  "url" : "https://blog.continuus.ai/markit-edm-best-practices-database-cleanup-strategy"
}
```