commits

edavis.dev / monarch

an app.bsky.* indexer

fork atom

Author

Commit

Message

Date

Eric Davis

b1698d0a

only attach firehose cursor if there is one master

3mo ago

Eric Davis

485ca60e

drop locks

3mo ago

Eric Davis

e634a35d

drop the final firehose cursor save on ctx Done

3mo ago

Eric Davis

0e2e52b4

include firehose URL

3mo ago

Eric Davis

1f1cebef

set default sync request limit to 10/s

3mo ago

Eric Davis

9cd84375

add --sync-requests-limit flag

3mo ago

Eric Davis

39855a6e

include which host is skipped

3mo ago

Eric Davis

4a03f371

add more record types

3mo ago

Eric Davis

caba3915

Merge branch 'jsonb'

3mo ago

Eric Davis

56e4a6ca

cleanup

3mo ago

Eric Davis

e669ccdf

drop actor profiles for now

3mo ago

Eric Davis

77446847

only crawl hosts once

3mo ago

Eric Davis

fdec2f90

use jsonEncode

3mo ago

Eric Davis

4a8d1810

different approach

3mo ago

Eric Davis

557eea02

unmarshal CBOR

3mo ago

Eric Davis

ceeab327

use json.RawMessage

3mo ago

Eric Davis

445374ef

first pass at JSONB

3mo ago

Eric Davis

d890b13e

bring back HandleUpsert

3mo ago

Eric Davis

353ee934

do one final firehose persist on exit

3mo ago

Eric Davis

6c13a22c

add Model

3mo ago

Eric Davis

0523a904

use cursor service in census, fixup firehose cursor saving

3mo ago

Eric Davis

fd27375b

go fmt

4mo ago

Eric Davis

fe6b736c

dynamic host/repo updates

4mo ago

Eric Davis

6cef528f

create firehoseCursor model, drop cursorRecord model

4mo ago

Eric Davis

70cd3cf2

remove indigo replace directive

4mo ago

Eric Davis

b9e567bb

upgrade indigo

4mo ago

Eric Davis

d89ebf9b

add relay-host flag

4mo ago

Eric Davis

02dbec40

fix(census): set curs before next page fetch

4mo ago

Eric Davis

2a2a947f

drop "errors" import

4mo ago

Eric Davis

f5a081eb

don't wait on endctx

4mo ago

Eric Davis

3b335763

move app.Stop out of go routine, use simple chan receive for endctx

4mo ago

Eric Davis

fa63ed0b

fixup context stop/cancel patterns

4mo ago

Eric Davis

56fbded0

convert firehose seq to string

4mo ago

Eric Davis

191eef0d

omit associations when creating

4mo ago

Eric Davis

2f19a2a3

use SetReposCursor, log cursor flush

4mo ago

Eric Davis

4aa8b136

add flags for backfill workers/consumers

4mo ago

Eric Davis

23ab318d

move to cli/v2 and cliutil

4mo ago

Eric Davis

0a735878

tweak some error handling

4mo ago

Eric Davis

c03aa1e3

add ID primary keys where missing

4mo ago

Eric Davis

29c6ab14

switch to upsertRecord

4mo ago

Eric Davis

3ce4905d

Merge branch 'bad-nulls'

4mo ago

Eric Davis

86e2a43b

go fmt

4mo ago

Eric Davis

08ca8e2b

drop debug

4mo ago

Eric Davis

74e21978

split out create from update

4mo ago

Eric Davis

fcc62363

WIP of why subject/via are inconsistently added

4mo ago

Eric Davis

83aec1a5

make rules generic

4mo ago

Eric Davis

9bbf0eb6

add GraphStarterpackID to GraphStarterpack_Feed

4mo ago

Eric Davis

4dd8dd44

return GraphFollow pointer directly

4mo ago

Eric Davis

b6d51c74

fixup how embedding rules are done on postgates

4mo ago

Eric Davis

b23a5cc9

embed Reply on FeedPost

4mo ago

Eric Davis

d9a9d57a

embed Subject/Via on FeedLike

4mo ago

Eric Davis

baacebf5

embed Embed on ActorStatus

4mo ago

Eric Davis

85c97768

embed JoinedViaStarterPack/PinnedPost on ActorProfile

4mo ago

Eric Davis

4660f09d

go fmt

4mo ago

Eric Davis

75d5677a

rm models/models.go

4mo ago

Eric Davis

39d72823

add ActorDeclaration (chat)

4mo ago

Eric Davis

b97c81e2

add GraphFollow

4mo ago

Eric Davis

51b69705

add FeedThreadgate

4mo ago

Eric Davis

4082807f

add FeedRepost

4mo ago

Eric Davis

9d06a096

add FeedPostgate

4mo ago

only attach firehose cursor if there is one master

b1698d0a Eric Davis

3mo

drop locks

485ca60e Eric Davis

3mo

drop the final firehose cursor save on ctx Done

e634a35d Eric Davis

3mo

include firehose URL

0e2e52b4 Eric Davis

3mo

set default sync request limit to 10/s

1f1cebef Eric Davis

3mo

add --sync-requests-limit flag

9cd84375 Eric Davis

3mo

include which host is skipped

39855a6e Eric Davis

3mo

add more record types

4a03f371 Eric Davis

3mo

Merge branch 'jsonb'

caba3915 Eric Davis

3mo

cleanup

56e4a6ca Eric Davis

3mo

drop actor profiles for now

e669ccdf Eric Davis

3mo

only crawl hosts once

77446847 Eric Davis

3mo

use jsonEncode

fdec2f90 Eric Davis

3mo

different approach

4a8d1810 Eric Davis

3mo

unmarshal CBOR

557eea02 Eric Davis

3mo

use json.RawMessage

ceeab327 Eric Davis

3mo

first pass at JSONB

445374ef Eric Davis

3mo

bring back HandleUpsert

d890b13e Eric Davis

3mo

do one final firehose persist on exit

353ee934 Eric Davis

3mo

add Model

6c13a22c Eric Davis

3mo

use cursor service in census, fixup firehose cursor saving

0523a904 Eric Davis

3mo

go fmt

fd27375b Eric Davis

4mo

dynamic host/repo updates

fe6b736c Eric Davis

4mo

create firehoseCursor model, drop cursorRecord model

6cef528f Eric Davis

4mo

remove indigo replace directive

70cd3cf2 Eric Davis

4mo

upgrade indigo

b9e567bb Eric Davis

4mo

add relay-host flag

d89ebf9b Eric Davis

4mo

fix(census): set curs before next page fetch

02dbec40 Eric Davis

4mo

drop "errors" import

2a2a947f Eric Davis

4mo

don't wait on endctx

f5a081eb Eric Davis

4mo

move app.Stop out of go routine, use simple chan receive for endctx

3b335763 Eric Davis

4mo

fixup context stop/cancel patterns

fa63ed0b Eric Davis

4mo

convert firehose seq to string

56fbded0 Eric Davis

4mo

omit associations when creating

191eef0d Eric Davis

4mo

use SetReposCursor, log cursor flush

2f19a2a3 Eric Davis

4mo

add flags for backfill workers/consumers

4aa8b136 Eric Davis

4mo

move to cli/v2 and cliutil

23ab318d Eric Davis

4mo

tweak some error handling

0a735878 Eric Davis

4mo

add ID primary keys where missing

c03aa1e3 Eric Davis

4mo

switch to upsertRecord

29c6ab14 Eric Davis

4mo

Merge branch 'bad-nulls'

3ce4905d Eric Davis

4mo

go fmt

86e2a43b Eric Davis

4mo

drop debug

08ca8e2b Eric Davis

4mo

split out create from update

74e21978 Eric Davis

4mo

WIP of why subject/via are inconsistently added

fcc62363 Eric Davis

4mo

make rules generic

83aec1a5 Eric Davis

4mo

add GraphStarterpackID to GraphStarterpack_Feed

9bbf0eb6 Eric Davis

4mo

return GraphFollow pointer directly

4dd8dd44 Eric Davis

4mo

fixup how embedding rules are done on postgates

b6d51c74 Eric Davis

4mo

embed Reply on FeedPost

b23a5cc9 Eric Davis

4mo

embed Subject/Via on FeedLike

d9a9d57a Eric Davis

4mo

embed Embed on ActorStatus

baacebf5 Eric Davis

4mo

embed JoinedViaStarterPack/PinnedPost on ActorProfile

85c97768 Eric Davis

4mo

go fmt

4660f09d Eric Davis

4mo

rm models/models.go

75d5677a Eric Davis

4mo

add ActorDeclaration (chat)

39d72823 Eric Davis

4mo

add GraphFollow

b97c81e2 Eric Davis

4mo

add FeedThreadgate

51b69705 Eric Davis

4mo

add FeedRepost

4082807f Eric Davis

4mo

add FeedPostgate

9d06a096 Eric Davis

4mo