Live data from Hacker News

Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

twitter.com

61–70 of 260 posts

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#61

My company is in the middle of a multi year transition from selfhosting atlassian products to using their cloud offerings, and I am sure the infrastructure team/management is very thrilled to see this news.

I'm sure they will also be thrilled waiting sometimes seconds for a character to echo. Good Luck, I suffer with cloud Atlassian every day.

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#62
post #33

Earlier quoted context omitted.

Reminder: never delete data for real as your first step. Always mark it deleted along with a time stamp saying when. Then you can hide deleted itemsfrom everything. When a maintenance script goes haywire you can fix the problem quickly. Have a daily job that really deletes records marked deleted after 30 days. If that is too complicated to retrofit then have any mass cleanup script move the records to a CSV file or t…

Works until you get a bug in the deletion job. I've seen exactly this happen.

You don't even need a bug. Just a wrong system clock.

We had a few windows laptops where something caused them to time travel to 8000 years in the future. Then, they'd slowly spend a few hours deleting every local profile, as nobody had logged in to them for 8000 years. Then, they'd do something to their time zone database and travel back 8000 years.

When they started the process, it was unstoppable. Trying to modify the system clock to something sane just caused them to depart to the future again, even if disconnected from the network. None of our users was very amused by this behavior, even if everything important was backed up.

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#63
post #22

We're mere weeks aware from migrating to their could platform after the self-hosted rugpull. This really doesn't give me confidence in their ability to not break my stuff.

Same situation.

Absolutely no one even knew this was happening and doesn’t give a shit now because it’s a project death march.

JIRA as a whole has been a fucking shit show of a product over the last decade even on-prem.

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#64

Earlier quoted context omitted.

Supposedly they’re having to basically restore everyone from backups because a system designed to delete old data was a bit more efficient than it should have been: https://reddit.com/r/sysadmin/comments/u14qqq/_/i4a0mk8/?con...

Reminder: never delete data for real as your first step. Always mark it deleted along with a time stamp saying when. Then you can hide deleted itemsfrom everything. When a maintenance script goes haywire you can fix the problem quickly. Have a daily job that really deletes records marked deleted after 30 days. If that is too complicated to retrofit then have any mass cleanup script move the records to a CSV file or t…

I agree that data must never be "deleted and forever gone" unless you've already been very sure about it a few time.

But I would like to warn people about certain implementations of database "soft deletes" that I'm not a fan of. To be clear, I'm talking about the idea of having a "deleted" and/or a "date_deleted" column and using those columns in the WHERE clause to filter out rows that shouldn't be visible.

That pattern complicates the table structure, queries, and indexes. It increases table and index size, thus more data has to be sifted through (either table data or index data) to ensure only non-deleted entries are returned. More data to go through means slower queries. It's also really easy for people to write SQL that accidentally leaves the "deleted" column out of the WHERE clause. Then old, irrelevant data is being returned.

Accidentally deleting data that needs to be undeleted is usually rare so I don't think people should optimize for it. We should optimize for things that happen frequently.

I have dealt with the rare "Oops! I deleted important data!" by restoring from backups and it has worked fine. I think it may be too strong to say you should never be in a position to restore data from a backup. In fact, I think it's important to streamline the restore process.

For cases where we know ahead of time that we want to query deleted data I'll move deleted data to another database table that exists solely for maintaining history. For example, an ORDER table will have a DELETED_ORDER table, or an ORDER_HISTORY table. The HISTORY tables can also record data overwritten from updates.

These tables take up disk space, but never affect the structure or size of the original table and its indexes. Queries to the original table don't need to be modified to account for soft deletes.

To guarantee that things go to the delete/history tables, I'll usually put a trigger on the original table to move data over to the history tables. This way no application-specific code is needed.

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#65

Earlier quoted context omitted.

If technical competency had any bearing on stock prices they should've been at 0 since long ago. Their stock price is tied to the amount of clueless/shitty companies that will still cling onto their products regardless of what happens, and I don't think this incident is going to change much.

Honest question: Since Trello is part of Atlassian aswell - what are good, reliable and above all lightweight alternatives for managing projects without the “pseudo-agile” rabbit holes of functionality?

Microsoft Planner is included in most Microsoft 365 plans. Pretty much if you've got Teams, you've got Planner (and you can just add Planner as Tab in a Teams channel). At this point it has surprising feature parity with Trello.

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#66
So, let me get this straight:

* It's been deleted for a week already, they estimate they might need two more weeks. Three in total.

* They claim to have "extensive backups", and hundreds of engineers working on it.

What? How? This simply doesn't go together. Why would restoring from backup take three weeks?

Either their backups aren't complete, or they need new software written for the restore, or something else doesn't add up.

I haven't administered their software yet, but what I've learned from the sidelines, at least Jira doesn't seem to be rocket science. A database, an application server (maybe a few instances for larger sites), a bit of config, some caches. This really shouldn't take three weeks to restore.

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#67
post #43

Earlier quoted context omitted.

> or bad SQL WHERE clause Tip: Begin an SQL session with BEGIN TRANSACTION; at the end you can either COMMIT or ROLLBACK.

Bonus tip: don't even type COMMIT until after you've run a few select queries to verify the data has in fact changed how you expected it to change.

super duper bonus tip: Don't execute SQL in a production environment that you just typed out on the fly.

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#68
As the person responsible for running Jira and Confluence on premises at my employer I‘m looking forward for the next time one of their sales droids contacts me to make us move to their cloud services (despite me stating that we are not interested multiple times)…

Re: Atlassian: We estimate the rebuilding effort to last for up to 2 more weeks

#69
post #63
post #22

We're mere weeks aware from migrating to their could platform after the self-hosted rugpull. This really doesn't give me confidence in their ability to not break my stuff.

Same situation. Absolutely no one even knew this was happening and doesn’t give a shit now because it’s a project death march. JIRA as a whole has been a fucking shit show of a product over the last decade even on-prem.

I will say that back when Bugzilla was it, JIRA rocked. It was amazing the new power you had and the functionality it provided.

We self-hostd JIRA from 2008ish to 2014ish. (memory is fading on exact dates) By the time we decided to stop using JIRA, we fracking hated JIRA and would never return.

Since then, GitHub Issues, Trello, Clubhouse (neé Shortcut) all provide less friction in day to day use. As an Enterprise, I do believe Shortcut is your best bet.

Post reply on HN