My first step would be to try and "undelete" the file from FS, even if it was overwriten, it is possible that some of it is still salvageable.
Ask HN: Ever worked with a service that can never be restarted?
71–80 of 201 posts
Re: Ask HN: Ever worked with a service that can never be restarted?
#72capture packet's and see what kind of traffic it receives most commonly The modern solution would be to capture the incoming packets as a training set then apply machine learning to create a model that can perfectly recreate the outgoing packets. It’s still an inexplicable black box of course, that is the nature of ML, but at least you can run it in the cloud now.
Sorry that nobody else got it, but I like that joke. Do you think we can put some crypto in there, too?
Definitely a use case for blockchain ;-)
Too subtle for HN but I don’t mind.
Re: Ask HN: Ever worked with a service that can never be restarted?
#73A lot of talk about what to do yourself, I'd say do nothing yourself. Find an expert who has masses of experience who can consult on it. This isn't a good time to be learning and testing those lessons.
This is the solution in my experience aswell. Doing even minor things that could distrupt the execution for any time (attaching debugger, installing packet sniffer that blocks network traffic for a sec or cause a packet lost, etc) could deadlock the application. Wouldn’t risk it.
The only thing I would risk is copy/pasting the binary/executable that is running to somewhere else so I could try and decompile it. Anything beyond that is a nope.
Re: Ask HN: Ever worked with a service that can never be restarted?
#74This is also metioned by dijit, but here's more concrete instructions on how to potentially recover the config from /proc/
: https://web.archive.org/web/20171226131940/https://www.linux...
Re: Ask HN: Ever worked with a service that can never be restarted?
#75Earlier quoted context omitted.
Sorry that nobody else got it, but I like that joke. Do you think we can put some crypto in there, too?
Definitely a use case for blockchain ;-) Too subtle for HN but I don’t mind.
Ah apologies for not realising this was /s, I see people who genuinely advocate this sort of stuff on HN so it went way over my head!
Re: Ask HN: Ever worked with a service that can never be restarted?
#76I remember reading some time ago an old story about folks recovering accidentally deleted system files from the currently running system. Can't find it, I think it was Ritchie who told it but I'm not sure. The long and short is that it might be possible to recover the lost config from what's currently running.
Re: Ask HN: Ever worked with a service that can never be restarted?
#77I remember reading some time ago an old story about folks recovering accidentally deleted system files from the currently running system. Can't find it, I think it was Ritchie who told it but I'm not sure. The long and short is that it might be possible to recover the lost config from what's currently running.
Re: Ask HN: Ever worked with a service that can never be restarted?
#78Actually, I have experience here. The problem is that anything you do that's potentially destructive in service of getting the system to be more sustainable is going to be met with heavy criticism. So you must be careful, the company has accepted the risk that they're in and you'll have to contend with that most likely. First thing is first: is it a VM or a Physical machine? Things get a little easier if it's a VM be…
I have a personal theory that Really Bad Things (TM) usually tend to happen during the response to other, relatively minor, problems. So whatever is done cannot risk the running process . So personally I'd be loathed to try anything that touches the running process - even if they seem low risk. Edit: One thing I would do is make it clear that building a replacement and keeping this thing running are different respons…
Yep. Responding to an outage increases the probability of having an outage.
Re: Ask HN: Ever worked with a service that can never be restarted?
#79Earlier quoted context omitted.
Is this seriously done? I just completed a small literature review for neural program synthesis which uses inputs as training data to generate a program using neural networks that can generate the right outputs but it's a huge search problem and I assume for anything non-trivial this is out of our reach? As an example, Deepmind achieved binary multiplication using this technique in 2018 and this was notable.
I’ve never done it but it should be feasible. An IP packet is 1518x8 == 12144 bits which is not especially big for a one-hot style encoding these days. You would just need to be sure to capture representative traffic e.g. accounting for monthly jobs.
Most IO is larger than one packet.
Re: Ask HN: Ever worked with a service that can never be restarted?
#80The is how most systems work, at some scale.