Well. Lots of subjects to cover. First you have to consider how often you are using it and what is your priorities. If just using for recreational use, you can be surprised what you can do without. Now if you are staying for weeks at a time, you may want to improve upon some of the things below. Another thing is what you can afford to update. Whatever you do, I would suggest doing it right.
A few questions.
1. Is the current wood stove usable?
2. Is the current outhouse usuable?
If they are then I would use those while I updated some other things.
For electric, I have a 2000 KW inverter generator that I can take to camp, but I seldom take it unless I am working on something and need power tools. For a while we got by with some LED lanterns and we just recently installed a small solar setup with marine battery.
We don't use a refrigerator, but instead we have a couple of RTIC coolers. I have been looking for a propane refrigerator, but those suckers are expensive. Honestly the coolers aren't that big of a pain.
We did purchase a used gas stove that we converted to propane. It works great.
Propane lights work well from what I have heard, but they do give off heat which can be an issue in the summer. They also make me a bit nervous.
If you go with propane heat make sure to go with a vented heater and not a ventless. Ventless shouldn't be installed in sleeping quarters. I would still keep the wood stove as a camp just needs a wood stove. We have both a direct vent propane heater and a wood stove.
We carry water in with us. Not really too bad. We have a surflo 12v pump to run to the sink and shower. Showers are military type and water is heated on the stove. The 5 of us can shower on about 10-11 gallons of water. You can get those blue containers to haul it in. We have a place about 5 minutes away from camp where we can refill them.
Post up some pics of the place. We love pics!
Traditions only last if you pass them down to your kids!