Police are searching for a man who was caught on video stealing a cross from a chapel in Boyle Heights on Holy Thursday.