Linear Regression

Examining how error decreases together with the resulting prediction equation helps you assess why a learning rate or bias is needed.

Starting conditions

The provided code generates synthetic data by adding small noise to y=1.8x+.7 at $x\in\{0,.5\}$,...,3.5. Use seed=7.

Procedure

1. Run the provided 200-epoch baseline example and plot the loss curve and prediction line.
2. Record the learned w and b separately from the data generation coefficients in a table.
3. Given the noise, explain whether the learned coefficients should exactly match the data generation coefficients.

Results to retain

• Plots of the data, prediction line, and loss, plus a coefficient table.

Starting conditions

Fix bias=True and epoch=200, and compare lr=.01,.05,.1.

Procedure

1. Fix the initial seed and data for all runs.
2. Record the final MSE and the loss at epochs 1, 20, and 200.
3. Distinguish the smallest final loss from the fastest initial decrease.

Results to retain

• A 3-row table and 1 loss curve.

Starting conditions

Using the same data, keep lr=.05 and epoch=200, and compare bias=True/False.

Procedure

1. Plot the two prediction lines in the same figure.
2. Record the predictions at $x\in\{0,.25,1.25,2.75\}$ in a table.
3. Explain the difference between increasing training iterations and allowing bias in the model.

Results to retain

• Plots for the two models, a prediction table, and a brief interpretation.