While photocatalysis is considered a promising sustainable technology in the field of heterogeneous catalysis as well as biocatalysis, figures of merit (FOM) for comparing catalytic performance, especially between disciplines, are not well established. Here, photocatalytic water splitting was conducted using a semiconductor (NiO/La-NaTaO3) and a bio-photocatalyst (Synechocystis sp. PCC 6803) in the same setup under similar reaction conditions, eliminating the often ill-defined influence of the setup on the FOMs obtained. Comparing the results enables the critical evaluation of existing FOMs and a quantitative comparison of both photocatalytic systems. A single FOM is insufficient to compare the photocatalysts, instead a combination of multiple FOMs (reaction rate, photocatalytic space time yield and a redefined apparent quantum yield) is superior for assessing a variety of photocatalytic systems.