Methods for automatically testing a business intelligence artifact in a business intelligence system include authoring a business intelligence artifact; creating an assertion with conditions to verify the proper functioning of the business intelligence artifact; testing, with an automated agent interfaced with the business intelligence system, the business intelligence artifact to verify its proper functioning by determining whether the conditions of the assertion are satisfied; and reporting if the conditions of the assertion are not satisfied.