Does anyone here run #gitlab in #kubernetes?
I'm interested in moving my Omnibus gitlab instance to my #k8s cluster, but I'm a bit confused about how it all interacts to be honest.

@mhamzahkhan I have looked I to it, but my bigger concern is that there is no way back >.> means once migrated I'm required to run K8s or at least can't re-unify the data endpoint such as artifacts and alike.

@sheogorath Oh you mean because the data is stored in S3 (or some other similar storage provider)?

I'm actually already storing artifacts, and everything that I can in S3 ("uploads", artifacts, registry, and LFS).

The bit I am confused about is how to handle the actual repository data.

@sheogorath From my understanding the repo data can't be stored in S3, but rather the recommended way is to create a Gitaly Cluster with some form of storage (probably local storage), and Gitaly replicates the repos across all the gitaly nodes.
I'm a bit stuck with that because my K8S cluster only has NFS as a PV provider, and NFS isn't recommended.

@mhamzahkhan yes, repodata is storend on a PVC. But I also wouldn't say it has to be super super fast, so NFS might be fast enough. Maybe try it without performing a full migration but just setting up a test instance?

@sheogorath Do you know if performance is the only reason NFS isn't recommended? I'm not too fussed about speed to be honest. My Gitlab instance only has two users.

I was more concerned about integrity if I use NFS. I mean, for most cases, NFS is just fine, but a while back I tried to setup Elasticsearch on my K8S cluster using NFS, and it was not happy at all and I had all sorts of issues. As far as I know Git should be fine on NFS, but I was weary just because the docs say it's a bad idea!


@mhamzahkhan well, integrity concerns are valid in general, because NFS does local caching and data considered written to disk might not have made it to the NFS server yet. But honestly speaking, as long as your host machine isn't crashing, that should be fine.

Latency can be considered a problem for something like a database or elasticsearch. There is not much you can do about that. For the plain git storage however right now, I see no problem with NFS.

Sign in to participate in the conversation
Sheogorath's Microblog

This is my personal microblog. It's filled with my fun, joy and silliness.