Heat oil in large nonstick skillet over medium-high heat.
Season scallops with salt and pepper.
Cook scallops until golden on bottom, about 2 minutes. Turn over; saute until just cooked through, about 1 minute. Drain on paper towels. Cool to room temperature.
Top each scallop with 1/2 teaspoon creme fraiche. Top with caviar.