Live data from Hacker News

Show HN: Daily price tracking for Trader Joe's

traderjoesprices.com

111–120 of 154 posts

Re: Show HN: Daily price tracking for Trader Joe's

#112
post #81

Earlier quoted context omitted.

I'd also change it to `Referer`, as that is what Chrome seems to be using. And referrer is set twice!

Indeed, he spelled it the right way, which is the wrong way. He should spell it wrong, which is the right way. :) I think it is funny that this misspelling hasn't been fixed after all of these years. It was typo'ed in the original http spec in 1996: https://en.wikipedia.org/wiki/HTTP_referer

If the web server is following RFC 8969, it will treat "referrer" as "referer" and throw a 397 TOLERATING to let you know you should change it to the latter on your end. See Section 3.

https://pastebin.com/TPj9RwuZ

(Yes it's my April Fool's RFC.)

Re: Show HN: Daily price tracking for Trader Joe's

#113
post #88

surprised to see trader joe's exposes prices via graphql: https://github.com/cmoog/traderjoes/blob/54588336f3b7a4ce23c... one of the few notable production gql users?

This caught me completely by surprise. I never would have imagined that a grocery chain, even Trader Joe's, would have a publicly-accessible API endpoint for its current product catalog.

I wonder how the author even found the endpoint! Is this at risk of Trader Joe's noticing and moving to require an auth token? I can't imagine the openness being intentional, at least outside that brief period of techno-optimism in the late 2000s where it seemed like everyone was offering data sources to build into your Twitter bot.

Possible secondary application: could this GraphQL endpoint potentially be used to determine when a product is being discontinued?

Re: Show HN: Daily price tracking for Trader Joe's

#114
post #94
post #81

Earlier quoted context omitted.

Indeed, he spelled it the right way, which is the wrong way. He should spell it wrong, which is the right way. :) I think it is funny that this misspelling hasn't been fixed after all of these years. It was typo'ed in the original http spec in 1996: https://en.wikipedia.org/wiki/HTTP_referer

Most things that care about that field accept both because so many programmers make that mistake. But you're technically right, the best kind of right.

They make the mistake of spelling it correctly, lol. Silly programmers.

Re: Show HN: Daily price tracking for Trader Joe's

#115
post #22
post #17

Earlier quoted context omitted.

https://docs.paperless-ngx.com Nextcloud also has OCR. You can use a scanner with either. Avoid touching the receipts. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5453537/

didn't see anything specifically receipt oriented but found a little blurb here that mentions receipts almost tangentially https://docs.paperless-ngx.com/usage/#basic-searching

I run paperless on an Unraid server at home and it works really well. It has "machine learning" (based on a model that you host yourself that grows as you use it). It has good search, impressive OCR, and generally works really well.

My only complaint is that it lacks a good organization workflow. I have a shared network folder and any file (image, pdf, etc) that you put on that folder gets immediately consumed into Paperless. This happens almost immediately. I have a printer/scanner that allows me to scan to a SMB network drive. So I configured any scans from it to go to that shared folder, which makes integration really nice. I also use GeniusScan on my phone to scan to the same network drive (which requires pro, which is ~$16 a year I think). Genius Scan can save locally to your phone and upload later when you get home, which makes for a good workflow. The problem is that once it gets into Paperless, there's not a good workflow for reviewing and labeling the file. I have been meaning to sit down and provide a contribution to the open source project to improve this, but haven't found the time to do it yet. This is the biggest weakness of the project imo.

For those that have never used paperless. The naming may confuse you. It started off as an open source project named paperless. Then it got abandoned and a team picked it up to update it and make it more modern, and they renamed it paperless-ng (for angular I assume, the new frontend). Then that project lost momentum, so it was forked again and is now paperless-ngx which is the current iteration of it. It currently has a very strong community and gets good updates.

Re: Show HN: Daily price tracking for Trader Joe's

#116
post #88

surprised to see trader joe's exposes prices via graphql: https://github.com/cmoog/traderjoes/blob/54588336f3b7a4ce23c... one of the few notable production gql users?

This caught me completely by surprise. I never would have imagined that a grocery chain, even Trader Joe's, would have a publicly-accessible API endpoint for its current product catalog. I wonder how the author even found the endpoint! Is this at risk of Trader Joe's noticing and moving to require an auth token? I can't imagine the openness being intentional, at least outside that brief period of techno-optimism in t…

Trader Joes just doesn’t really compete on price except for a few loss leaders like milk and eggs. Most people I know who go to TJs treat it as their default store because of the shopping experience. The stores are smaller but well staffed, have a well curated and consistent product selection, and are just more pleasant than other grocery stores.

Re: Show HN: Daily price tracking for Trader Joe's

#117
post #46

Earlier quoted context omitted.

That's a misconception. Prices are not the same across stores. I live in Los Angeles. Many times I've shopped at the TJ's in Silver Lake and one of the TJ's in Pasadena on the same day. Most prices are the same, but on many items the Silver Lake store is consistently 5-10% higher. I've also shopped in midwestern TJ's and noted that the prices were generally lower than LA. Products differ significantly, too. Items wit…

Are you sure? They list prices on their website even without a local store selected. And then picking a local store in different locations, I can't find any prices that change. I mean, obviously there might be exceptions. And I assume local produce varies, the same way it varies in every supermarket not just by the season but by the week. Most fresh produce isn't even listed on their site, and things like fresh salad…

You can find some that change, like here for LA vs. Chicago: https://preview.redd.it/stumbled-on-a-website-that-tracks-tj...

Re: Show HN: Daily price tracking for Trader Joe's

#119
post #5

Interesting! I’ve always held on to my grocery receipts for the last 8 years. I took pictures of them but when I moved a box got water damaged so now I only have like the last 3ish years. Is there any open source software that I can use to transfer these receipts into a useful csv? I have an idea for a few interesting data visualizations as I’d often buy the same things every week. Grocery bill went from like $70 to…

I do the same with WholeFoods receipts. The pipeline is:

1. Scan to FTP dir to TIFF

2. Nightly job submits image(s) from the dir to Veryfi (their free tier is enough and they looks like the best for receipts OCR)

3. Save that raw JSON, enhanced JSON (fix occasional mis-attribution for discounts, calculate unit price), and CSV. Filename is a purchase date - correctly extracted by Veryfi.

4. Render with bash + gnuplot.

5. TODO: store into some DB and render with Grafana or something.

Edit: formatting

Re: Show HN: Daily price tracking for Trader Joe's

#120

Open food fact recently launched Open Prices ( https://prices.openfoodfacts.org/ ). It's currently crowd-sourced instead of an automated crawling, but prices are localized in space and time which could lead to intersting results. This will lead to an open database of food product prices.

This is super cool! I'd hoped to build something like this.
Post reply on HN