# Image Exposure Controller

• msckf-vio Issue: About image exposure controller #41 [1]

The auto exposure code is not open source because for one the actual implementation is ugly, and second because it ties into other software that is not open sourced.

Here a few (edited) notes that I sent to somebody who asked about how it works:

• what we implemented is super simple but works well in practice:

$\text{new-shutter-time} = \text{current-shutter-time} \cdot \frac{\text{desired-brightness}}{\text{current-brightness}}$

You can go fancier by implementing

$\text{new-shutter-time} = \text{current-shutter-time} \cdot \left(\frac{\text{desired-brightness}}{\text{current-brightness}}\right)^\alpha$

$$\alpha \leq 1$$, but in practice $$\alpha = 1$$ works just fine.

• brightness is computed from every 16th row and column, so in fact only 1 out of every 256 is used for brightness computation

• threshold on brightness:

we only change shutter time if

$|\text{desired-brightness} - \text{current-brightness}| > \text{threshold}$

This is so that we don't torture the ptgrey cameras with constant shutter speed changes.

• region of interest (ROI) support: we compute brighness only from the bottom X%. Typically X=70, so we will ignore the top 30% of the image, because that's often where the sun or sky are, and where we don't usually pick up features.

• configurable max shutter limit: the max shutter time is the min of the shutter time imposed by frame rate, and a configurable hard shutter limit (in case we get motion blur and decide we'd rather live with a darker image and/or gain noise than the motion blur).

• auto gain: once we hit max shutter, we turn on auto gain (and when it get's brighter again, we take the gain off first, then decrease shutter).

So

$\text{if} \; \left| \bar{B} - B_c \right| > B_{th}: \\ \; T_s \leftarrow T_s \cdot \frac{\bar{B}}{B_c} \\ \; \text{if} \; T_s < T_{min}: \\ \text{auto gain}$

# Implementation

• image_exposure_control for RS cam [2]

• vo-autoexpose [3] : An auto-exposure algorithm for maxing out VO performance in challenging light conditions

# Reference

Image Exposure Controller
https://cgabc.xyz/posts/7d4dd820/

Gavin Gao

2022年6月22日