After the sky divers exited the airplane at 12,000 feet, the engine lost power while the airplane was descending through 10,000 feet. The pilot switched fuel tanks and engine power was reestablished. The engine again lost power at 4,000 feet and the pilot attempted a forced landing at his home base airport.