780.20: 1094 Session 13
Handouts: Excerpt from Biner/Heermann,
printouts of sampling_test.cpp and Ising model codes
In this session, we'll extend our study of Monte Carlo
We'll compare importance sampling to ordinary random sampling and then
explore a standard example, the two-dimensional Ising
Please read the background notes for an introduction
and then use the Biner/Heermann handout as you go.
Overview: Simulation of 2D Ising Model
To get started, we'll look at a java applet that simulates the
2D Ising model. The goal is to
visualize before looking at code; it is NOT expected
that you will understand all of the physics now.
- Go to
There is a descriptive page and the applet should start after a brief wait.
- You will see a grid of blue or yellow squares, which represent
up or down spins on a lattice. The temperature is indicated graphically
on the left and on the far right the grid size, temperature, average
energy per lattice site, and magnetization (average spin per lattice
site) are given numerically. The system comes up at high temperature
but cooling. Let it get to the lowest temperature.
Does it end up in a uniform ferromagnetic state?
- Switch the "Simulation
Mode" from "Visual" to "Intensive". This reveals a plot, which
is initially of energy E vs. temperature T.
Now press the "Heat" button. Characterize the behavior of
the system as it heats through the critical temperature to high
- Change the "Cell Size" from 1 to 8 (there is a pull-down menu).
What is the change in grid size? Press "Clear Data".
Change the "Y Axis"
from energy E to magnetization M. Cool down.
Describe the behavior of the magnetization with temperature.
What happens at Tc (green vertical line)?
Do you get a different state at low energy
than with cell size 1? How does it decide which magnetization
(blue or yellow) to choose?
- Clear data and heat again. Note the size of the fluctuations
in the magnetization. Now switch cell size to 1, clear data,
and cool than heat. What differences do you observe in the
size of the fluctuations and the behavior of the
- Predict what cell size 4 and 16 will look like, then try them.
Monte Carlo Sampling
In the sampling_test.cpp code, three distributions of energy for a
one-dimensional Ising model [equation (2.1.1) in the handout] are
generated. The first is the exact distribution at temperature kT in
the canonical ensemble;
that is, the
distribution of energies considering every possible configuration of
spins weighted by a normalized Boltzmann factor.
The second is the energy distribution if a large number of spin
configurations are chosen at random. The third is the energy
distribution from a Metropolis Markov process.
- Here are some questions to get you familiar with the model
and its implementation in the code sampling_test.cpp:
- How does the "J" in the Ising model determine whether we
will have a ferromagnet or an anti-ferromagnet? Which
choice does the code start with? What does the ground state
(lowest energy state) of a ferromagnet look like?
[Bonus: What is the physical origin of J for a ferromagnetic?]
- How would you add an external magnetic field H_ext
to the code?
[See Eq.(13.6) in the notes for the Hamiltonian.]
- How many total "microstates" are there for a 1-D Ising
model with the number of sites in the code?
(I.e., how many possible "configurations" of spins are there?)
If calculating the energy of each configuration takes the same
amount of time, how much longer would it take to calculate a
lattice with twice the number of sites?
- Given a number of lattice sites,
what are the values of the minimum and maximum energies?
How many different energy values
You can't get every integer energy between the minimum and
- What are the boundary conditions for the line of
Find where it is used in the code.
What other set of boundary
conditions could be used?
- Find the calculation of the exact partition function in the
code. How is this equal to the same result as (2.1.5) in the
Binder/Heerman notes? [Hint: You can add
exp(-Ei/kT) for each spin configuration separately, or
group all those with the same energy together and multiply by
how many have that energy.]
Can you explain how the complete set of configurations are
constructed in the code using the "next_configuration"
- Compile and link sampling_test.cpp (using make_sampling_test)
and run it to see what the output looks like.
Did you get the correct
answer above for the number of configurations and
the possible energies? (If not, rethink!)
- Look through the code and try to understand how each
distribution is generated.
- Generate and attach
a gnuplot graph of the probability of energy E [called
vs. the energy (this is what is output to the screen)
for kT = 10. and kT = 1.
[You'll need to get the results into data files somehow.
There is a plot file sampling_test.plt
to help with the plot, but you have to put the
results in files with these names. Cutting and pasting is fine.]
- Why is the distribution for ordinary random sampling centered
at E=0? Based on this
what kind of temperature does ordinary random sampling
correspond to? [Hint: What Boltzmann factor would result
in a distribution like this?]
- Compare the exact P(E) for a canonical distribution to those
of random sampling and the Metropolis algorithm. Will the
Metropolis algorithm be effective in
doing importance sampling (which concentrates
points where the integrand is large)?
Why will the random sampling
be a problem for evaluating thermal averages [see figure 2.3 and
the discussion after equation (2.1.33) in Biner/Heermann]?
- Verify that the transition probabilities in (2.1.39a) and
(2.1.39b) both satisfy the condition (2.1.38). Which one
is implemented in the code?
Bonus: Switch to the other
and check that it works.
How do you calculate the average energy at a given temperature?
Modify the code to calculate the average energy at kT = 1.
and kT = 10. using the Metropolis sampling methods and compare to the exact
average energy (according to the canonical Boltzmann distribution).
The Two-D Ising Model
In this section, we explore some aspects of Monte Carlo simulations that
are discussed in section 2.2 of the handout.
We use the two-dimensional Ising model first with a ferromagnetic
interaction (J > 0) and then with an "anti-ferromagnetic"
interaction as our example.
- Take a look at ising_model.cpp and note that one can
switch between the one-d and two-d Ising
models by commenting and uncommenting some lines. The default
is the two-d model.
What are the differences between the one-d and two-d versions?
- Equilibration. Compile and link ising_model.cpp (use
and run for several temperatures.
Make a gnuplot
graph of the energy vs. time for kT = 2.0, 1.0, and 0.5 (all on the
same graph, so rename your files appropriately).
Run repeatedly at kT = 1.0 until you see that you don't always
get the same answer at large times. What does this mean?
- Look at the small time region.
How long does it
take at each temperature to reach "equilibrium"? If you were going
to use the configurations generated here to calculate thermal
averages, would you want to use the
configurations at the beginning? How can you deal with this?
- BONUS: Modify the code so that the output file names automatically
have the temperature in their names. (Recall filename_test.cpp from
- Modify the code to change it from ferromagnetic to
anti-ferromagnetic (only one line needs to be changed!).
What did you change?
- Cooling. At present, the code starts from a random
configuration. Modify the code to implement "cooling" by looping
through temperatures kT = 2.0, 1.0, then 0.5 but start the simulation
at each successive temperature using the final configuration of the
higher temperature as the initial configuration of the lower
temperature. Generate a gnuplot graph of the energy vs. time
for each of the temperatures and compare to your previous results.
- Efficiency. The code at present has several
inefficiencies. Here are some ways to speed it up:
These optimizations speed up the code by a factor of about six!
A new version is ising_opt.cpp (with make_ising_opt).
Look at how the optimizations were implemented.
- The current approach compares energies of
new and old configurations by calculating the full energy of each and
subtracting. Can you devise a (much) more efficient
(You don't need to implement it here.)
- During one MCS, we can update each spin sequentially, which
saves random number calls but also leads to shorter equilibration
- We can reduce the random number calls when deciding if a spin
flips or not.
- We can use a table of nearest neighbors of each spins to save
- Phase Transition
- Modify the optimized code ising_opt.cpp to
calculate the absolute value of the magnetization of the
system (with linear size L=5) for various
temperatures. Starting at kT=4.0, cool down
the system by Delta kT =0.2 until kT=1.0. What do you observe about the
behavior of magnetization? (Make a plot.)
- When we calculate the magnetization, we use the absolute value
of it, why? It may help to look at the time dependence of
the magnetization around kT=2 with size L=5 or less.
[Bonus: Can you explain
your observation in terms of "spontaneous symmetry breaking"?]
Will this problem get better or worse when you increase the system size?
[Hint: Would it be possible for an infinite system to change from a
state with all up spins to one with all down spins?]
- Now change the system size (try L=10, 20, 40).
By changing the system size, can you observe a change in the behavior of
magnetization? If so, can you make an argument why this happens?
780.20: 1094 Session 13.
Last modified: 10:48 am, February 23, 2011.