The image generation device and the endoscope system which depend on one feature of this invention have, usually usually the image which generates the image which is the white image on the basis of the RGB data which is the multiple color element information which are acquired generation circuit (21) with, the hue calculation circuit which calculates the hue of the RGB data (22) with, the yellow component detector which detects the yellow component on the basis of the hue which was calculated (23) with, the yellow component removal circuit (24) with, the spectrum image generation circuit (25) with. The yellow component removal circuit (24), the yellow component detector (23) the yellow removal G data which removes the yellow component which is detected (GY) it generates from the G data. The spectrum image generation circuit (25), the yellow removal G data (GY) with the spectrum image which the B data is the vascular image on the basis of is generated.本発明の一態様にかかる画像生成装置および内視鏡システムは、取得された複数の色要素情報であるRGBデータをもとに白色画像である通常画像を生成する通常画像生成回路(21)と、RGBデータの色相を算出する色相算出回路(22)と、算出された色相をもとに黄色成分を検出する黄色成分検出回路(23)と、黄色成分除去回路(24)と、分光画像生成回路(25)と、を備える。黄色成分除去回路(24)は、Gデータから黄色成分検出回路(23)が検出した黄色成分を除去した黄色除去Gデータ(GY)を生成する。分光画像生成回路(25)は、黄色除去Gデータ(GY)とBデータとをもとに血管画像である分光画像を生成する。