IT checklist for evaluating a SaaS service

This checklist provides a generic list of items to consider when evaluating a SaaS service.

Authentication

  1. Is SAML based Single Sign-On supported? Make sure your company’s IDP is supported (Azure, Okta, etc) and make sure your company’s user name format is support (SSO is no longer SSO if name format is not supported).

User management

  1. How are new users added? Manually, or automatically (consider the SCIM protocol if not aware already)
  2. How are users removed? Manually or automatically if removed from your enterprise directory?
  3. How are permissions applied to users? Manually in with the application or automatically (for the later, permissions assigned via Active Directory security groups provides central auditing advantages)

Security

  1. Does the SaaS provider have security certifications (e.g. ISO27001)
  2. Has a third party independent PEN test been completed, if so, how often is it repeated?
  3. Is user and/or admin multi factor authentication available?
  4. Is there security auditing on who/ when / what? can this be automatically shipped to a log platform?
  5. Are the roles based permissions defined that an be leveraged?
  6. Who and what can SaaS provider staff access?
  7. Does the provider offer a bug bounty program? (this gives some insight into how serious they consider security)

Data sovereignty

  1. Where is your data stored, and do you have location restrictions to consider?

Disaster Recovery

  1. Does the SaaS provider have a published disaster recovery plan?
  2. How often is the disaster recovery plan tested?

Backup and restore

  1. What is backed up by the provider, and what is your responsibility to backup?
  2. How often are backups taken?
  3. What is the process for restore? (how long does it take, can you restore only certain items, or is only full restore possible?)
  4. Is there capability for customers to take independent backups and store outside of the SaaS environment? (if so, can this be done automatically?)

Import / Export

  1. What data can be imported (and in what format) to assist with service setup?
  2. What data can be exported (and is the format useable) if you choose to leave the service?

API access

  1. Is there published API availability to enable automation?
  2. Are the APIs sufficient to be useful?

Licensing

  1. Is the licensing model understandable?
  2. Is the licensing approach for archived or non-active data/users treated differently? (paying full licences for archived users is never nice!)

Reporting

  1. Is there useful management reports available?

Roadmaps

  1. Is there a clear roadmap on how long versions are supported and when/ how upgrades are enforced?
  2. Is there a clear roadmap on upcoming features?
  3. Is the vendor actively developing the service? (this provides insight on their priority on the service)

Availability

  1. Is historic service availability publicly published?

Training and support methods

  1. Is there an online knowledge base?
  2. Is there a user forum?
  3. How are support tickets logged and what are the service level options?

If you liked this checklist, please give me a clap. If you have suggested additions please let us know via the comments.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s