-
Notifications
You must be signed in to change notification settings - Fork 87
feat: compressed mint photon api #2198
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
sergeytimoshin
wants to merge
38
commits into
main
Choose a base branch
from
sergey/photon-cmints
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
38 commits
Select commit
Hold shift + click to select a range
f403b82
feat: forester: pda & mint compression
sergeytimoshin 9b6ae17
refactor rent exemption calculations
sergeytimoshin 342640c
format
sergeytimoshin 66deaec
feat: add support for compressed mint retrieval in the indexer
sergeytimoshin 12b236c
get_compressed_mints_by_authority authority type filtering
sergeytimoshin 01911fb
fix: update PHOTON_COMMIT version in versions.sh
sergeytimoshin 841a8c2
docs: update CLI parameter descriptions for compressible PDA program
sergeytimoshin 1dea574
feat: add hex dependency and update existing hex usage in Cargo.toml …
sergeytimoshin e748e41
fix: update authority_type field in GetCompressedMintsByAuthorityOpti…
sergeytimoshin 93d61a7
fix: update mint_authority and mint fields in build_expected_mint fun…
sergeytimoshin 9121a06
feat: refactor bootstrap logic to use run_bootstrap helper; enhance m…
sergeytimoshin 0adcca5
fix: update build_expected_mint function to accept version parameter …
sergeytimoshin 265dbaa
fix: adjust calculate_compressible_slot to correctly compute availabl…
sergeytimoshin 10bae7c
bump photon version
sergeytimoshin 005ddfb
wip
sergeytimoshin 4659bb4
cleanup
sergeytimoshin 8e23a82
cleanup
sergeytimoshin a60962e
cleanup
sergeytimoshin 91f5d91
cleanup
sergeytimoshin 32c6cba
new apis
sergeytimoshin fb11ddd
feat: add support for unified account interface with hot/cold context…
sergeytimoshin 5f12024
cleanup
sergeytimoshin d2fbfa9
format
sergeytimoshin 11215b3
refactor account interface
sergeytimoshin 00f85ab
bump photon version
sergeytimoshin 27a78d7
feat: implement batch lookup for multiple compressed accounts in RPC
sergeytimoshin f43212b
enhance account interface
sergeytimoshin f46c619
fix: update account types in get_accounts_to_update test
sergeytimoshin e52e51e
cleanup
sergeytimoshin 5dcf777
bump photon
sergeytimoshin 93ea0bb
cleanup
sergeytimoshin 1e4d918
fix: update error assertion in test_create_ata_failing for invalid mi…
sergeytimoshin 8216d7e
fix: update error assertion in test_create_ata_failing for invalid mi…
sergeytimoshin 44202c2
Potential fix for code scanning alert no. 143: Workflow does not cont…
sergeytimoshin 5ca6ab9
fix: update default version fallback to V2 in LIGHT_PROTOCOL_VERSION …
sergeytimoshin 28b7db0
cleanup
sergeytimoshin 1723ce4
feat: add forester to cli (particularly useful for compression tests)…
sergeytimoshin 311564f
bump photon commit hash in versions.sh
sergeytimoshin File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| # Disable mise's Go management for this project. | ||
| # We use our own Go installation via devenv.sh. | ||
| [settings] | ||
| disable_tools = ["go"] |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,107 @@ | ||
| import which from "which"; | ||
| import { killProcess, spawnBinary, waitForServers } from "./process"; | ||
| import { FORESTER_PROCESS_NAME } from "./constants"; | ||
| import { exec } from "node:child_process"; | ||
| import * as util from "node:util"; | ||
| import { exit } from "node:process"; | ||
| import * as fs from "fs"; | ||
| import * as path from "path"; | ||
|
|
||
| const execAsync = util.promisify(exec); | ||
|
|
||
| async function isForesterInstalled(): Promise<boolean> { | ||
| try { | ||
| const resolvedOrNull = which.sync("forester", { nothrow: true }); | ||
| return resolvedOrNull !== null; | ||
| } catch (error) { | ||
| return false; | ||
| } | ||
| } | ||
|
|
||
| function getForesterInstallMessage(): string { | ||
| return `\nForester not found. Please install it by running: "cargo install --git https://github.com/Lightprotocol/light-protocol forester --locked --force"`; | ||
| } | ||
|
|
||
| export interface ForesterConfig { | ||
| rpcUrl: string; | ||
| wsRpcUrl: string; | ||
| indexerUrl: string; | ||
| proverUrl: string; | ||
| payer: string; | ||
| foresterPort: number; | ||
| compressiblePdaPrograms?: string[]; | ||
| } | ||
|
|
||
| /** | ||
| * Starts the forester service for auto-compression of compressible accounts. | ||
| * | ||
| * @param config - Forester configuration | ||
| */ | ||
| export async function startForester(config: ForesterConfig) { | ||
| await killForester(); | ||
|
|
||
| if (!(await isForesterInstalled())) { | ||
| console.log(getForesterInstallMessage()); | ||
| return exit(1); | ||
| } | ||
|
|
||
| console.log("Starting forester..."); | ||
|
|
||
| const args: string[] = [ | ||
| "start", | ||
| "--rpc-url", | ||
| config.rpcUrl, | ||
| "--ws-rpc-url", | ||
| config.wsRpcUrl, | ||
| "--indexer-url", | ||
| config.indexerUrl, | ||
| "--prover-url", | ||
| config.proverUrl, | ||
| "--payer", | ||
| config.payer, | ||
| "--api-server-port", | ||
| config.foresterPort.toString(), | ||
| "--enable-compressible", | ||
| ]; | ||
|
|
||
| // Add compressible PDA programs if specified | ||
| if (config.compressiblePdaPrograms && config.compressiblePdaPrograms.length > 0) { | ||
| for (const program of config.compressiblePdaPrograms) { | ||
| args.push("--compressible-pda-program", program); | ||
| } | ||
| } | ||
|
|
||
| spawnBinary(FORESTER_PROCESS_NAME, args); | ||
| await waitForServers([{ port: config.foresterPort, path: "/health" }]); | ||
| console.log("Forester started successfully!"); | ||
| } | ||
|
|
||
| export async function killForester() { | ||
| await killProcess(FORESTER_PROCESS_NAME); | ||
| } | ||
|
|
||
| /** | ||
| * Gets the payer keypair as a JSON array string for forester. | ||
| * Reads from ~/.config/solana/id.json or SOLANA_PAYER environment variable. | ||
| * | ||
| * @returns JSON array string of the keypair bytes | ||
| */ | ||
| export function getPayerForForester(): string { | ||
| // Check for SOLANA_PAYER environment variable first | ||
| if (process.env.SOLANA_PAYER) { | ||
| return process.env.SOLANA_PAYER; | ||
| } | ||
|
|
||
| // Default to standard Solana keypair location | ||
| const homeDir = process.env.HOME || process.env.USERPROFILE || ""; | ||
| const keypairPath = path.join(homeDir, ".config", "solana", "id.json"); | ||
|
|
||
| if (fs.existsSync(keypairPath)) { | ||
| const keypairData = fs.readFileSync(keypairPath, "utf-8"); | ||
| return keypairData.trim(); | ||
| } | ||
|
|
||
| throw new Error( | ||
| "No payer keypair found. Set SOLANA_PAYER environment variable or create ~/.config/solana/id.json", | ||
| ); | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🧹 Nitpick | 🔵 Trivial
Test recipe looks functional, consider adding RUST_LOG for consistency.
The recipe structure is correct and the dependency on
build-test-depsmakes sense if the indexer interface tests use thecreate-address-test-program.Unlike the other compressible test recipes (lines 28-37) which set
RUST_LOG=forester=debug,light_client=debug, this one doesn't. If debugging indexer interface issues becomes necessary, operators will need to manually add it.♻️ Optional: Add RUST_LOG for debugging consistency
# Test for indexer interface scenarios (creates test data for photon) test-indexer-interface: build-test-deps + RUST_LOG=forester=debug,light_client=debug \ cargo test --package forester --test test_indexer_interface -- --nocapture📝 Committable suggestion
🤖 Prompt for AI Agents