ConsMarkovModel¶
Classes to solve and simulate consumption-savings model with a discrete, exogenous, stochastic Markov state. The only solver here extends ConsIndShockModel to include a Markov state; the interest factor, permanent growth factor, and income distribution can vary with the discrete state.
- class HARK.ConsumptionSaving.ConsMarkovModel.ConsMarkovSolver(solution_next, IncShkDstn_list, LivPrb, DiscFac, CRRA, Rfree_list, PermGroFac_list, MrkvArray, BoroCnstArt, aXtraGrid, vFuncBool, CubicBool)¶
Bases:
ConsIndShockSolver
A class to solve a single period consumption-saving problem with risky income and stochastic transitions between discrete states, in a Markov fashion. Extends ConsIndShockSolver, with identical inputs but for a discrete Markov state, whose transition rule is summarized in MrkvArray. Markov states can differ in their interest factor, permanent growth factor, live probability, and income distribution, so the inputs Rfree, PermGroFac, IncShkDstn, and LivPrb are now arrays or lists specifying those values in each (succeeding) Markov state.
- calc_EndOfPrdvP()¶
Calculates end of period marginal value (and marginal marginal) value at each aXtra gridpoint for each current state, unconditional on the future Markov state (i.e. weighting conditional end-of-period marginal value by transition probabilities).
- Parameters:
none –
- Return type:
none
- calc_EndOfPrdvPP()¶
Calculates end-of-period marginal marginal value using a pre-defined array of next period market resources in self.mNrmNext.
- Parameters:
none –
- Returns:
EndOfPrdvPP – End-of-period marginal marginal value of assets at each value in the grid of assets.
- Return type:
np.array
- calc_EndOfPrdvPcond()¶
Calculate end-of-period marginal value of assets at each point in aNrmNow conditional on a particular state occuring in the next period.
- Parameters:
None –
- Returns:
EndOfPrdvP – A 1D array of end-of-period marginal value of assets.
- Return type:
np.array
- calc_HumWealth_and_BoundingMPCs()¶
Calculates human wealth and the maximum and minimum MPC for each current period state, then stores them as attributes of self for use by other methods.
- Parameters:
none –
- Return type:
none
- condition_on_state(state_index)¶
Temporarily assume that a particular Markov state will occur in the succeeding period, and condition solver attributes on this assumption. Allows the solver to construct the future-state-conditional marginal value function (etc) for that future state.
- Parameters:
state_index (int) – Index of the future Markov state to condition on.
- Return type:
none
- def_boundary()¶
Find the borrowing constraint for each current state and save it as an attribute of self for use by other methods.
- Parameters:
none –
- Return type:
none
- make_EndOfPrdvFuncCond()¶
Construct the end-of-period value function conditional on next period’s state.
- Parameters:
EndOfPrdvP (np.array) – Array of end-of-period marginal value of assets corresponding to the asset values in self.aNrmNow.
- Return type:
none
- make_EndOfPrdvPfuncCond()¶
Construct the end-of-period marginal value function conditional on next period’s state.
- Parameters:
None –
- Returns:
EndofPrdvPfunc_cond – The end-of-period marginal value function conditional on a particular state occuring in the succeeding period.
- Return type:
- make_cubic_cFunc(mNrm, cNrm)¶
Make a cubic interpolation to represent the (unconstrained) consumption function conditional on the current period state.
- Parameters:
mNrm (np.array) – Array of normalized market resource values for interpolation.
cNrm (np.array) – Array of normalized consumption values for interpolation.
- Returns:
cFuncUnc
- Return type:
an instance of HARK.interpolation.CubicInterp
- make_linear_cFunc(mNrm, cNrm)¶
Make a linear interpolation to represent the (unconstrained) consumption function conditional on the current period state.
- Parameters:
mNrm (np.array) – Array of normalized market resource values for interpolation.
cNrm (np.array) – Array of normalized consumption values for interpolation.
- Returns:
cFuncUnc
- Return type:
an instance of HARK.interpolation.LinearInterp
- make_solution(cNrm, mNrm)¶
Construct an object representing the solution to this period’s problem.
- Parameters:
cNrm (np.array) – Array of normalized consumption values for interpolation. Each row corresponds to a Markov state for this period.
mNrm (np.array) – Array of normalized market resource values for interpolation. Each row corresponds to a Markov state for this period.
- Returns:
solution – The solution to the single period consumption-saving problem. Includes a consumption function cFunc (using cubic or linear splines), a marg- inal value function vPfunc, a minimum acceptable level of normalized market resources mNrmMin, normalized human wealth hNrm, and bounding MPCs MPCmin and MPCmax. It might also have a value function vFunc and marginal marginal value function vPPfunc. All of these attributes are lists or arrays, with elements corresponding to the current Markov state. E.g. solution.cFunc[0] is the consumption function when in the i=0 Markov state this period.
- Return type:
- make_vFunc(solution)¶
Construct the value function for each current state.
- Parameters:
solution (ConsumerSolution) – The solution to the single period consumption-saving problem. Must have a consumption function cFunc (using cubic or linear splines) as a list with elements corresponding to the current Markov state. E.g. solution.cFunc[0] is the consumption function when in the i=0 Markov state this period.
- Returns:
vFuncNow – A list of value functions (defined over normalized market resources m) for each current period Markov state.
- Return type:
- solve()¶
Solve the one period problem of the consumption-saving model with a Markov state.
- Parameters:
none –
- Returns:
solution – The solution to the single period consumption-saving problem. Includes a consumption function cFunc (using cubic or linear splines), a marg- inal value function vPfunc, a minimum acceptable level of normalized market resources mNrmMin, normalized human wealth hNrm, and bounding MPCs MPCmin and MPCmax. It might also have a value function vFunc and marginal marginal value function vPPfunc. All of these attributes are lists or arrays, with elements corresponding to the current Markov state. E.g. solution.cFunc[0] is the consumption function when in the i=0 Markov state this period.
- Return type:
- class HARK.ConsumptionSaving.ConsMarkovModel.MarkovConsumerType(**kwds)¶
Bases:
IndShockConsumerType
An agent in the Markov consumption-saving model. His problem is defined by a sequence of income distributions, survival probabilities, discount factors, and permanent income growth rates, as well as time invariant values for risk aversion, the interest rate, the grid of end-of-period assets, and how he is borrowing constrained.
- calc_bounding_values()¶
Calculate human wealth plus minimum and maximum MPC in an infinite horizon model with only one period repeated indefinitely. Store results as attributes of self. Human wealth is the present discounted value of expected future income after receiving income this period, ignoring mort- ality. The maximum MPC is the limit of the MPC as m –> mNrmMin. The minimum MPC is the limit of the MPC as m –> infty. Results are all np.array with elements corresponding to each Markov state.
NOT YET IMPLEMENTED FOR THIS CLASS
- Parameters:
None –
- Return type:
None
- check_markov_inputs()¶
Many parameters used by MarkovConsumerType are arrays. Make sure those arrays are the right shape.
- Parameters:
None –
- Return type:
None
- get_Rfree()¶
Returns an array of size self.AgentCount with interest factor that varies with discrete state.
- Parameters:
None –
- Returns:
RfreeNow – Array of size self.AgentCount with risk free interest rate for each agent.
- Return type:
np.array
- get_controls()¶
Calculates consumption for each consumer of this type using the consumption functions.
- Parameters:
None –
- Return type:
None
- get_markov_states()¶
Draw new Markov states for each agent in the simulated population, using the attribute MrkvArray to determine transition probabilities.
- Parameters:
None –
- Return type:
None
- get_shocks()¶
Gets new Markov states and permanent and transitory income shocks for this period. Samples from IncShkDstn for each period-state in the cycle.
- Parameters:
None –
- Return type:
None
- initialize_sim()¶
Prepares this AgentType for a new simulation. Resets the internal random number generator, makes initial states for all agents (using sim_birth), clears histories of tracked variables.
- Parameters:
None –
- Return type:
None
- make_euler_error_func(mMax=100, approx_inc_dstn=True)¶
Creates a “normalized Euler error” function for this instance, mapping from market resources to “consumption error per dollar of consumption.” Stores result in attribute eulerErrorFunc as an interpolated function. Has option to use approximate income distribution stored in self.IncShkDstn or to use a (temporary) very dense approximation.
NOT YET IMPLEMENTED FOR THIS CLASS
- Parameters:
mMax (float) – Maximum normalized market resources for the Euler error function.
approx_inc_dstn (Boolean) – Indicator for whether to use the approximate discrete income distri- bution stored in self.IncShkDstn[0], or to use a very accurate discrete approximation instead. When True, uses approximation in IncShkDstn; when False, makes and uses a very dense approximation.
- Return type:
None
Notes
This method is not used by any other code in the library. Rather, it is here for expository and benchmarking purposes.
- pre_solve()¶
Check to make sure that the inputs that are specific to MarkovConsumerType are of the right shape (if arrays) or length (if lists).
- Parameters:
None –
- Return type:
None
- read_shocks_from_history()¶
A slight modification of AgentType.read_shocks that makes sure that MrkvNow is int, not float.
- Parameters:
None –
- Return type:
None
- reset_rng()¶
Extended method that ensures random shocks are drawn from the same sequence on each simulation, which is important for structural estimation. This method is called automatically by initialize_sim().
- Parameters:
None –
- Return type:
None
- shock_vars_ = ['PermShk', 'TranShk', 'Mrkv']¶
- sim_birth(which_agents)¶
Makes new Markov consumer by drawing initial normalized assets, permanent income levels, and discrete states. Calls IndShockConsumerType.sim_birth, then draws from initial Markov distribution.
- Parameters:
which_agents (np.array(Bool)) – Boolean array of size self.AgentCount indicating which agents should be “born”.
- Return type:
None
- sim_death()¶
Determines which agents die this period and must be replaced. Uses the sequence in LivPrb to determine survival probabilities for each agent.
- Parameters:
None –
- Returns:
which_agents – Boolean array of size AgentCount indicating which agents die.
- Return type:
np.array(bool)
- state_vars = ['pLvl', 'PlvlAgg', 'bNrm', 'mNrm', 'aNrm', 'aLvl', 'Mrkv']¶
- time_vary_ = ['LivPrb', 'PermGroFac', 'MrkvArray']¶
- update_solution_terminal()¶
Update the terminal period solution. This method should be run when a new AgentType is created or when CRRA changes.
- Parameters:
none –
- Return type:
none