Ahrefs · posted · checked
Database Engineer
C++LinuxRustOn-site · Cambridge, Palo Alto, Singapore and Japan
Who can apply
On-site · Cambridge, Palo Alto, Singapore and Japan
Location: Cambridge, Massachusetts, United States; Palo Alto, California, United States; Singapore; Tokyo, Japan
Own the data layer behind one of the biggest crawlers on the web.
Ahrefs helps marketers get their brands found in search, in AI answers and on social. Under the product sits one of the largest datasets on the web, and someone has to keep it fast, correct and alive.
The team
The Database team owns our databases and storage end to end, from the source code to production. We run ClickHouse, MooseFS, SeaweedFS, TiDB and Elasticsearch on about 1,200 servers holding hundreds of petabytes, in data centres in Singapore, the US and the UK.
We don’t file tickets with vendors and wait. When a system doesn’t do what we need, we change its source, prove the change on production data and roll it out ourselves.
The job
You’ll build and run our data layer: ClickHouse, the MooseFS and SeaweedFS storage under it, and the TiDB and Elasticsearch clusters beside it. You write the code, you ship it, and you’re there when it meets production. You’ll work with AI coding agents as a normal part of the job.
Examples of what you’ll work on
Build storage and query features in ClickHouse, such as replication over a shared file system, and storage policies that place data by its merge history.
Keep up with upstream ClickHouse LTS releases, keep CI green and ship our own releases regularly.
Make MooseFS and SeaweedFS highly available and durable: Raft-based metadata servers, follower reads, an intent log, automatic re-replication.
Find performance problems in production profiles and fix them in the code, from query plans to FUSE clients.
Trace data corruption to its root cause, even when it’s in compression, the memory allocator or the compiler, and repair the damaged data.
Roll out releases and storage migrations across about 1,200 servers in three regions, without downtime.
Show the full posting
Run and tune TiDB, TiKV, TiCDC and Elasticsearch: scheduling, replication lag, backups, disk balance.