Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)LA
Posts
183
Comments
100
Joined
2 yr. ago

Technology @lemmy.world

Google lays off hundreds of 'Core' employees, moves some positions to India and Mexico

Technology @lemmy.world

Higher-paid employees looking for work are having a tough time, and it could be a sign of a shift in the workplace

Selfhosted @lemmy.world

The Immich core team goes full-time | Immich

Technology @lemmy.world

Elon Musk Laid Off Supercharger Team After Taking $17 Million in Federal Charging Grants

Canada @lemmy.ca

Canadian GDP Growth Hits Half The Estimate, Previous Data Revised Lower - Better Dwelling

Canada @lemmy.ca

Ottawa to propose new asylum rules to allow for faster deportations - National | Globalnews.ca

Canada @lemmy.ca

International student’s video on getting free food in Canada unleashes anger and abuse: ‘Please die’

Canada @lemmy.ca

Canada's economy is losing momentum — quickly

Canada @lemmy.ca

Federal public servants to return to the office 3 days a week this fall

Canada @lemmy.ca

12 people arrested, 102 charges laid in major credit fraud scheme: Toronto police

Canada @lemmy.ca

International students will be allowed to work 24 hours a week starting in September

Canada @lemmy.ca

Service dog removed from Ontario home because it got too fat

Canada @lemmy.ca

CSIS director says China’s concerted effort to steal Canadian technology is ‘mind-boggling’

Technology @lemmy.world

Google layoffs: Sundar Pichai-led company fires entire Python team for ‘cheaper labour’

Canada @lemmy.ca

'Deeply unhappy' grocery shoppers plan to boycott Loblaw-owned stores in May

Canada @lemmy.ca

Rising unemployment hits Canada's international students hard

Videos @lemmy.ml

WE WERE TOO YOUNG TO UNDERSTAND

Canada @lemmy.ca

‘I feel terrible’: Wilfrid Laurier international student at centre of storm over post about how to get free food

Canada @lemmy.ca

London Drugs says stores in western Canada closed until further notice | Globalnews.ca

Canada @lemmy.ca

Canada's population growth is exploding. Here's why - The Hub

  • The fediverse is a few thousand servers, from Mastodon, Lemmy, etc. Can't say the amount of posts but there are a lot.

    So on the more technical side, I plan on using a light weight fast search engine called Sonic (It's written in rust). I have already used it in other projects and it can handle billions of messages / posts. But it has a cost it doesn't have faceted search, like for example if you want to exclude certain texts from the results. I think this is a fair trade off. The other solution would be to use something more mature like ElasticSearch but it'll be expensive (I'm assuming not much money will be made from this and I'm talking about donations)

    For scanning sites there are premade lists to start with and it'll be possible to scan new sites from other instances if found. So a bit of both.