Live data from Hacker News

Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

birls.org

31–40 of 76 posts

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#31
post #13

Spent a few minutes trying to find an answer to "why do this?" Beyond just implying that it should be done and the most I was able to find was one sentence buried amongst paragraphs and paragraphs of "what" and "how". > these materials were largely unknown and inaccessible to historians, journalists, and genealogists I think it would be worthwhile to lead with that and include a little more detail too. If there isn't…

I think it’s critically important to mention that the VA provided all this data to Ancestry.com years ago. According to the newletter op linked, Ancestry.com charges $300/year for access to this data. This unfairness is what prompted the lawsuit and ultimate release of data.

Indeed. This is ABSOLUTELY not the first time we’ve dealt with a government agency (at the local, state, or federal levels) providing a copy of a public dataset to Ancestry.com and not to the general public. Our taxpayer-funded data keeps ending up solely behind a $300/year paywall. It’s not fair.

(Also, the stripped-down version of BIRLS that has been on the Ancestry website for a while now is much smaller and older.)

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#32

Thanks for your efforts in liberating this data so that Ancestry.com isn’t the only ones with it! Reminds me a bit muckrock.com as well.

We love MuckRock! And we made the original FOIA request to the VA for this dataset via MuckRock’s platform. You can see the actual screenshot in the “Reclaiming These Records” legal papers section. They also get a shoutout in our colophon for indirectly inspiring the FOIA-by-fax-via-web method, although I believe their site uses e-mail, including interfacing with agency FOIA portals when possible.

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#34
post #7

Neat, Submitted a request for my grandfather's records. Some comments: 1) May want to auto-magically handle input for things like apostrophes. E.g. "O'Hare"... It looks like somewhere in the process this data was not preserved/saved/sent, but people will probably try to search with it. Might also want to handle the accent marks and what not too 2) The terms & conditions for Step 3, the checkbox at the bottom doesn't…

Thanks. The original data set, as provided by the VA, has all sorts of data errors and oddities in it. The major ones involving surnames include the inconsistent use of apostrophes in names like O’BRIEN, often written as O BRIEN, and/or vice versa — or the inconsistent formatting of MC and MAC names like MCMAHON as MC MAHON, and/or vice versa. There are also some names where the VA includes an errant dash, not meant…

>names like MCMAHON as MC MAHON, and/or vice versa.

My mom has a Van name and it's hell trying to use government and insurance websites, because they'll take the space out or add one in irregardless of what you use when signing up and then fail to find the account when doing a lookup for things like password resets or for activating the account that they created for her.

It'd seem logical that some sort of fuzzy matching for apostrophe and spaces would be built in, but I've yet to find a government site where that's the case.

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#35
post #33

Somewhat related: there was a fire in 1973 that destroyed the military records of a large fraction of former military personnel at the time: https://en.wikipedia.org/wiki/National_Personnel_Records_Cen... .

Yes, a terrible fire, although there are efforts ongoing to restore some of those files, even reading the data from charred papers and edges with newer technology.

However, these particular files (benefits claims files, or C-Files) are a different type of file and never burned. Better yet, they often have some parts of the veteran’s OMPF that were copied *into* the C-File, to establish eligibility for those benefits — copies that were made before the fire! In other words, these files could serve as partial backups…

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#36
post #19

I previously tried getting military records for my deceased grandfather. From what I can recall, it was complicated by the fact that I wasn't "next of kin", which would limit the data I'd have access to. Even my parent, who was next of kin, would have needed additional paperwork as proof, e.g. a death/marriage certificate for my grandmother. On one hand, if this works then I'll be happy to have the information I othe…

>From what I can recall, it was complicated by the fact that I wasn't "next of kin", which would limit the data I'd have access to.

My state has a process for claiming unclaimed funds that banks and such report to the government and that is what is keeping me from claiming some funds my grandmother has listed on the site. It's not even clear to me what constitutes 'next of kin' legally, presumably it'd be one of her kids, but it's not like we have laws designating the oldest male heir and then on down the list.

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#37
post #9
post #4

Are you aware that the API appears to be publishing the SSN of each individual? Although I’m aware most SSNs are leaked in one breach or another, I still thought it was customary in the U.S. to attempt to keep such information somewhat protected.

I agree it probably isn't a great idea to publish it... I'm guessing some malicious actor could find a way to use this information to fiddle with the remaining benefits their family might be receiving... That said, the _typical_ things an SSN is used for would not be terribly useful for someone that's been dead >2-4 years... Automated checks should flag e.g. credit applications as being for a dead person :-)

Social Security Admin publishes a master death file containing a list of SSNs of those who have died. This is how institutions know to close credit, deposit, and brokerage accounts; they subscribe to and consume the file. Some copies of it have been uploaded to the Internet Archive when someone has obtained a copy (cost to obtain from NTIS is prohibitive for individuals, but reasonable for commercial customers).

Broadly speaking, right to privacy evaporates at death, and when the Machine is working properly, SSNs have no value once they have been marked as deceased in SSA's system of record (as that flows through to various gov and commercial systems to ensure benefits cease and next of kin processes kick off for anything of value).

https://en.wikipedia.org/wiki/Death_Master_File

https://www.ntis.gov/ladmf/ladmf.xhtml

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#38
post #7

Neat, Submitted a request for my grandfather's records. Some comments: 1) May want to auto-magically handle input for things like apostrophes. E.g. "O'Hare"... It looks like somewhere in the process this data was not preserved/saved/sent, but people will probably try to search with it. Might also want to handle the accent marks and what not too 2) The terms & conditions for Step 3, the checkbox at the bottom doesn't…

[deleted]

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#39
post #27

Earlier quoted context omitted.

As a person, not a Veteran, I totally agree. This data should not be public domain. Definitely only accessible to family members (if at all). Having obtained my father’s military records, I can definitely say that I’m glad these weren’t online, searchable. Via those records I learnt much concerning my father and I’m glad I obtained them. To get those records, I had to prove I was his son, that my father was indeed de…

The military uses the gun of the taxman to force us to pay for them. If they're going to put me in a tiny cage for not paying up while they're galavanting around the world drone striking brown people and us citizens the least I can get out of it is the records.

This dump will give you the personal records of the rank and file. The “military” that you’re talking about is really congress and the president. It makes much more sense to go after the actions and communication of those folks than some grunts who gave their bodies shoveling shit for a chance at a future.

Re: Show HN: New search engine and free-FOIA-by-fax-via-web for US veteran records

#40
post #7

Neat, Submitted a request for my grandfather's records. Some comments: 1) May want to auto-magically handle input for things like apostrophes. E.g. "O'Hare"... It looks like somewhere in the process this data was not preserved/saved/sent, but people will probably try to search with it. Might also want to handle the accent marks and what not too 2) The terms & conditions for Step 3, the checkbox at the bottom doesn't…

> 3) I appreciate the warning on the terms and conditions about seeing things you might not want to see. I'd echo this. I found that to be exceptionally well-written and helped me understand the records I'd receive were unlikely to be the records I was interested in, so I cancelled at that point. Your abandon rate at that step could make for interesting reading!

>> 3) I appreciate the warning on the terms and conditions about seeing things you might not want to see. A good reminder for those that might not want to tarnish a memory of someone... Reminds me of the DNA tests for Christmas, or learning about Punnett Squares and genetics, sometimes you might not want to go looking :-)

> I'd echo this. I found that to be exceptionally well-written and helped me understand the records I'd receive were unlikely to be the records I was interested in, so I cancelled at that point.

I was curious, so clicked through the form far enough to get those warnings:

> ...

> The specific type of FOIA request that you can make through this website is one that asks the VA for a copy of a deceased veteran's Claims File (C-File). This file primarily contains a record of the veteran's contact with the VA (or the veteran's heirs' and family's contact with the VA) specifically regarding veterans' benefits. It may include copies of some of the veteran's service-related records, including entry/induction and separation/discharge documents, but often only to the extent that those records were considered necessary in order to establish their identity or to make a claim for a benefit. A C-File is not the same as an Official Military Personnel File (OMPF), although it sometimes may contain parts of the OMPF within it.

> Many of these C-Files will include medical information and medical claims that were brought by the veteran (or their family or heirs) from before, during, and/or after their service. This often includes basic physical and health information about the veteran, including their height, weight, descriptions of childhood illnesses, past surgeries, notations of scars or distinctive markings, and so on. However, these files might also include medical information that would otherwise be considered private or sensitive, including graphic depictions of injuries, illnesses or diseases, and/or wartime trauma suffered while the veteran was in the service, or after service, or concerning end-of-life care. The file may also include discussions of disabilities, service-related or not, only some of which may have been covered by veterans' benefits, while others may have been denied by the VA, possibly unfairly.

> The file may also include sensitive information about the veteran's mental health, including their experiences with, treatment for, and/or claims for disability for psychological trauma or for mental illnesses. This may include descriptions of what we would today recognize as service-related Post-Traumatic Stress Disorder (PTSD), but which may be listed in the veteran's file with outdated phrases such as "shell shock" or "psychoneurosis, anxiety state" or even more overtly disparaging terms from former military or VA medical personnel. It may also include archaic medical terminology, depictions, presumed causes, or treatments for various types of mental illness. This information may be troubling to read, not just for the sometimes graphic depiction of the veteran's trauma or mental state, but also because of the way it was often treated (or negligently untreated) in their official VA file.

> (For example, in one C-File we've seen, an Army doctor officially "diagnosed" a hospitalized World War I veteran with "hypochondriasis on a constitutionally inferior basis" [sic] before discharging him from the service. This record remained in his file, even after his death in 1973.)

> The file may also include information about the veteran's alcohol use, drug use, and/or tobacco use, or at least to the extent that the veteran reported their "habits" to the Armed Services or to VA personnel or to medical doctors.

> The file may also include information about the veteran's sexual behavior or sexual orientation, including possible military discharge or punishment for same-sex relations or non-heterosexual identity, whether actual or perceived.

> The file may also make explicit note of any venereal diseases or sexually transmitted infections experienced by the veteran, including documentation of ongoing or past treatments for what may have (at the time) been a chronic incurable illness such as advanced or tertiary syphilis. This information may therefore be medically relevant or potentially damaging to the veteran's spouse(s) or partner(s) or other family members.

> The file may also have information about the veteran's financial or educational information, or other typically-private information, particularly if they were using or attempting to qualify for a pension, a disability benefit, a VA Home Loan, the GI Bill of Rights for educational benefits, or other benefits.

> In addition to the veteran's own information, the veteran's C-File may sometimes include information about their non-veteran family members, including their parents and spouses and siblings and sometimes even extended family members, even a veteran's spouse's former spouse. This is generally just basic information, including for example the parents' places of birth or a spouse's date of marriage, but it may include family medical information (including reports of physical or mental health conditions that might be genetic), financial information, educational information, or other details of their lives. The file sometimes contains actual copies of family members' vital records such as birth, marriage, divorce, and death records. While the veteran is deceased, making their C-File largely open to the public under FOIA (as the Privacy Act of 1974 only refers to the files of living people), it is still possible that some of the other people mentioned in that now-open file may still be alive. If you come across sensitive information about a third party referenced in a deceased veteran's file that was (wrongly) not redacted by the VA, you are strongly urged to not disseminate, re-publish, or misuse any part of that information which could affect a living person's privacy.

> You, the FOIA requester, therefore understand that these files might contain all sorts of information which might be considered sensitive, objectionable, upsetting, disparaging, invasive, or otherwise cause you or the veteran's family members or heirs distress. If you are not okay with the possibility of learning this kind of information, then you should not make a FOIA request for this kind of file, and you should hit the cancel button now.

> ...

Post reply on HN