Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snapshotter Legacy v2 #63

Draft
wants to merge 73 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
73 commits
Select commit Hold shift + click to select a range
f7c023d
feat:update rpc.py to support block height and state override
getjiggy Dec 13, 2023
ae3b39e
chore: update config refs
getjiggy Dec 13, 2023
9b1b910
chore: update config refs
getjiggy Dec 13, 2023
278ee7b
chore: update config refs
getjiggy Dec 13, 2023
7456fcf
chore: update compute refs
getjiggy Dec 13, 2023
c6cfb56
fix: update rpc.py to support state override and block height
getjiggy Dec 13, 2023
f4ae0bd
fix: update abis to UniswapV3
getjiggy Dec 14, 2023
f21804a
chore:update config refs
getjiggy Dec 14, 2023
8085ee3
chore: update compute refs
getjiggy Dec 15, 2023
4bced1d
chore: update compute refs
getjiggy Dec 16, 2023
7177a00
chore: update config refs
getjiggy Dec 16, 2023
3c1be06
fix: update rpc exception to include payload
getjiggy Dec 18, 2023
32de387
chore: update compute refs
getjiggy Dec 18, 2023
15e3289
chore: update config refs
getjiggy Dec 18, 2023
790a591
fix: remove unreachable code
getjiggy Dec 18, 2023
723c2ac
chore: update compute refs
getjiggy Dec 19, 2023
7094d4b
chore: update commit and config refs
xadahiya Dec 20, 2023
037a5cb
chore: update compute refs
getjiggy Dec 20, 2023
615fd92
Merge branch 'uniswap-v3' of https://github.com/PowerLoom/pooler into…
getjiggy Dec 20, 2023
7592031
chore: update compute refs
getjiggy Dec 20, 2023
043039b
chore: update compute refs
getjiggy Dec 20, 2023
06f49ad
chore: update compute refs
getjiggy Dec 20, 2023
8a5733f
chore: update compute ref
getjiggy Dec 21, 2023
9448f50
fix: fix event topics lists generation, rpc get events parsing
getjiggy Dec 21, 2023
ad686ff
chore: update compute refs
getjiggy Dec 21, 2023
dc54bf8
fix: fix event topics lists generation, rpc get events parsing
getjiggy Dec 21, 2023
d84e208
chore: remove debugging value and comment
getjiggy Dec 21, 2023
85c1e77
fix: revert abi changes
getjiggy Dec 21, 2023
6ba2f5a
fix: event sig gen
getjiggy Dec 21, 2023
c36a600
fix: event sig gen
getjiggy Dec 21, 2023
4fe2726
Revert "fix: event sig gen"
getjiggy Dec 21, 2023
3cdeaf1
temp: add debug logs
getjiggy Dec 21, 2023
0ff3bfd
chore: update compute refs
getjiggy Dec 21, 2023
84993a0
chore: remove extraneous logs
getjiggy Dec 21, 2023
f7bfbc1
chore: update compute ref
getjiggy Dec 21, 2023
528cd2e
fix: debug rpc.py logs
getjiggy Dec 21, 2023
552156b
chore: update compute ref
getjiggy Dec 21, 2023
a06f049
fix: rpc.py updates
getjiggy Dec 21, 2023
174c6ea
chore: update compute ref
getjiggy Dec 21, 2023
7e5bf35
chore: update compute ref
getjiggy Dec 21, 2023
b443b3b
chore: update compute ref
getjiggy Dec 21, 2023
63678bd
chore: update compute refs
getjiggy Dec 22, 2023
373d9e1
chore: update compute ref
getjiggy Dec 22, 2023
9f1b5d5
fix: fix ref before assigntment
getjiggy Dec 22, 2023
6acc97d
fix: price calcs
getjiggy Dec 22, 2023
62d912d
chore: update compute refs
getjiggy Dec 22, 2023
e2d1926
style: fix spacing
getjiggy Dec 22, 2023
1485fab
chore: update compute ref
getjiggy Dec 22, 2023
624b8bd
chore: cleanup logs, improve .gitignore file, update compute and conf…
xadahiya Dec 24, 2023
c01fd62
chore: deprecate transformation lambdas
xadahiya Dec 24, 2023
cfefc68
feat: Add health manager service
xadahiya Dec 24, 2023
bc5a3b6
chore: cleanup processor_distributor (remove respawn logic), remove e…
xadahiya Dec 24, 2023
c8e0076
chore: remove protocol_state_loader_exporter
xadahiya Dec 24, 2023
fd57884
chore: update processor_distributor, data_models, message_models, con…
xadahiya Dec 24, 2023
0998c72
chore: minor cleanup in setting models
xadahiya Dec 24, 2023
a6ee624
chore: cleanup snapshot worker, made bulk mode default
xadahiya Dec 24, 2023
d857d21
chore: cleanup aggregation worker
xadahiya Dec 24, 2023
a4db7d0
chore: minor cleanup
xadahiya Dec 24, 2023
f2e41e6
chore: bug fixes
xadahiya Dec 24, 2023
f74bdf8
chore: remoge generate_project_ids script, add event_log_decoder to s…
xadahiya Dec 25, 2023
8d29f64
chore: rewrite workers to use bulk architecture for base and single a…
xadahiya Dec 25, 2023
06715ca
chore: finish multi aggreagates. First build with dynamic project ids…
xadahiya Dec 25, 2023
c59fda5
chore: cleanup extra commented code
xadahiya Dec 25, 2023
9b01f78
feat: inbuilt signing, no payload commit queue or need for audit prot…
xadahiya Jan 1, 2024
3182f3a
Merge branch 'snapshotter_v2' into feat/no_ap
xadahiya Jan 1, 2024
1651547
chore: bug fixes, submissions working without AP
xadahiya Jan 1, 2024
ba6f0b6
chore: update compute and config refs, improve data utils, update sna…
xadahiya Jan 1, 2024
03a78ca
chore: update GenericProcessor interface, update compute refs
xadahiya Jan 3, 2024
bd5373f
chore: cleanup logs, objects, variable names, etc. Update compute and…
xadahiya Jan 3, 2024
43f954d
chore: improve get_project_last_finalized_cid_and_epoch, update compu…
xadahiya Jan 3, 2024
8b45196
chore: upgrade web3 to latest version
xadahiya Jan 4, 2024
3e94776
chore: replace pysha3 with safe-pysha3
xadahiya Jan 4, 2024
0aff023
chore: update compute refs
xadahiya Jan 5, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Empty file modified Dockerfile
100644 → 100755
Empty file.
Empty file modified LICENSE
100644 → 100755
Empty file.
Empty file modified README.md
100644 → 100755
Empty file.
2 changes: 1 addition & 1 deletion config
Empty file modified dev-requirements.txt
100644 → 100755
Empty file.
2 changes: 1 addition & 1 deletion logs/.gitignore
Original file line number Diff line number Diff line change
@@ -1 +1 @@
*.log
*.log*
Empty file modified mypy.ini
100644 → 100755
Empty file.
11 changes: 11 additions & 0 deletions pm2.config.js
100644 → 100755
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,17 @@ module.exports = {
NODE_ENV: NODE_ENV,
}
},
{
name : "health-manager",
script : `poetry run python -m snapshotter.health_manager`,
max_restarts: MAX_RESTART,
min_uptime: MIN_UPTIME,
error_file: "/dev/null",
out_file: "/dev/null",
env: {
NODE_ENV: NODE_ENV,
}
},
{
name : "core-api",
script : `poetry run python -m snapshotter.gunicorn_core_launcher`,
Expand Down
2,059 changes: 1,208 additions & 851 deletions poetry.lock
100644 → 100755

Large diffs are not rendered by default.

5 changes: 4 additions & 1 deletion pyproject.toml
100644 → 100755
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ importlib = "^1.0.4"
pika = "^1.3.2"
gunicorn = "^20.1.0"
aiohttp = "^3.8.5"
web3 = "^5.31.4"
web3 = "^6.13.0"
async-limits = {git = "https://github.com/powerloom/limits.git"}
tenacity = "^8.2.2"
limits = "^2.8.0"
Expand All @@ -32,6 +32,9 @@ ifps-client = {git = "https://[email protected]/PowerLoom/py-ipfs-client.git"}
aiorwlock = "^1.3.0"
aio-pika = "^9.1.4"
fastapi-pagination = "^0.12.12"
eip712-structs = "^1.1.0"
coincurve = "^18.0.0"
safe-pysha3 = "^1.0.4"


[build-system]
Expand Down
Empty file modified setup.cfg
100644 → 100755
Empty file.
6 changes: 3 additions & 3 deletions snapshotter/core_api.py
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
}

# setup logging
rest_logger = logger.bind(module='Powerloom|CoreAPI')
rest_logger = logger.bind(module='CoreAPI')


protocol_state_contract_abi = read_json_file(
Expand Down Expand Up @@ -93,7 +93,7 @@ async def startup_boilerplate():
await load_rate_limiter_scripts(app.state.auth_aioredis_pool)
app.state.anchor_rpc_helper = RpcHelper(rpc_settings=settings.anchor_chain_rpc)
app.state.protocol_state_contract = app.state.anchor_rpc_helper.get_current_node()['web3_client'].eth.contract(
address=Web3.toChecksumAddress(
address=Web3.to_checksum_address(
protocol_state_contract_address,
),
abi=protocol_state_contract_abi,
Expand Down Expand Up @@ -719,7 +719,7 @@ async def get_task_status_post(

# check wallet address is valid EVM address
try:
Web3.toChecksumAddress(task_status_request.wallet_address)
Web3.to_checksum_address(task_status_request.wallet_address)
except:
response.status_code = 400
return {
Expand Down
Loading
Loading