a$)$ Write the correct formulations for augmented Lagrange function for constraint optimization. Please include all four cases of minimization and maximization with only inequality constraints $($ and $$ signs$).$

b$)$ Write the types of optimization algorithm and name few non$-$traditional optimization techniques.

c$)$ Briefly describe the penalty function method of constraint optimization.