the relit images appear greenish when using —no-color- calibration

[jiahuisheng]

hi，dr.rao，i found the relit images appear greenish when using —no-color- calibration, is this expected behavior?
using —no-color- calibration as recommended

not using

thank you

[prraoo]

Interesting, I have never encountered this issue. @jiahuisheng, can you please share the exact commands you ran from exr to avif, flow correction, and relighting?

[jiahuisheng]

@prraoo sure, I just translated the Slurm script to Python, preserving the exact same parameters.

exr to avif:
python run_extract.py 001

SCRIPT_PATH = "extract_public.py"
INPUT_DIR = "/data/FaceOLAT/Extracted"
OUTPUT_DIR = "/data/FaceOLAT/OutputEXR"

cmd = [
    "python", SCRIPT_PATH,
    INPUT_DIR,
    OUTPUT_DIR,
    "--subjects", subject_id,
    "--cameras", camera_name,
    "--format", "exr",
    "--frame-count", "350"
]

color-calibration:
python run_avif.py 001 --no-color-calibration or python run_avif.py 001
GAMMA here is set to 1.0, is that the reason?

INPUT_DIR = "/data/FaceOLAT/OutputEXR"
OUTPUT_DIR = "/data/FaceOLAT/OutputAVIF"

AVIF_QUALITY = "99"
EXPECTED_IMAGES = "350"
GAMMA = "1.0"
CALIB_MATRIX = "colorcalib_exr.mat"
WORKERS_PER_TASK = "8" 

cmd = [
    "python", "exr2avif.py",
    INPUT_DIR,
    OUTPUT_DIR,
    "--cameras", camera_name,
    "--quality", AVIF_QUALITY,
    "--expected-images", EXPECTED_IMAGES,
    "--workers", WORKERS_PER_TASK,
    "--gamma", GAMMA
]

if enable_calibration:
    cmd.extend(["--calib-matrix", CALIB_MATRIX])
else:
    cmd.append("--no-color-calibration")

alignment:
python run_align.py 001

WORK_DIR = "."
INPUT_DIR = "/data/FaceOLAT/OutputAVIF"
OUTPUT_DIR = "/data/FaceOLAT/OutputAVIF_aligned"
RAFT_MODEL_PATH = "./RAFT/models/raft-things.pth"

CENTER_FRAME = "188"
FLOW_SCALE_FACTOR = "0.25"
OUTPUT_SCALE_FACTOR = "0.5"

TASKS_PER_GPU = 6
GPU_COUNT = 8
EXPECTED_FRAMES = 350

cmd = [
    "python", "flow_align_avif.py",
    INPUT_DIR, 
    OUTPUT_DIR,
    "--center-frame", CENTER_FRAME,
    "--flow-scale-factor", FLOW_SCALE_FACTOR,
    "--output-scale-factor", OUTPUT_SCALE_FACTOR,
    "--slurm-task-id", "1", 
    "--slurm-total-tasks", "1",
    "--model", RAFT_MODEL_PATH,
    "--cameras", target_camera,
    "--takes"
] + unique_ids

if use_overwrite:
    cmd.append("--overwrite")

relight:
python run_relight.py

WORK_DIR = "."
DATA_ROOT = "/data/FaceOLAT"
RENDER_SCRIPT = "render_reference_envmap_relit.py"

# AVIF_INPUT_ROOT = os.path.join(DATA_ROOT, "OutputAVIF_ncc_aligned")
AVIF_INPUT_ROOT = os.path.join(DATA_ROOT, "OutputAVIF_aligned")
OUTPUT_ROOT = os.path.join(DATA_ROOT, "FaceOLAT_relight")
DEFAULT_ENV_PATH = os.path.join(DATA_ROOT, "FaceOLAT/relighting/envmaps")
INDEX_MAP = "voronoi_indices.exr"

DEFAULT_RESIZE = "2"
DEFAULT_GAMMA = "2.2"
ROTATE_CYCLE = "10"

cmd = [
    "python", RENDER_SCRIPT,
    "--sub", sub,
    "--camera", cam,
    "--outdir", final_output_dir,
    "--indexmap", INDEX_MAP,
    "--env-input", env_path,
    "--envscale", str(scale),
    "--resize-factor", str(resize),
    "--gamma", str(gamma)
]
if srgb: cmd.append("--srgb-input")

[jiahuisheng]

these are the avif image after alignment and calibration(using no color calibration flag). ID20001.000000.avif and ID20001.000001.avif