optimization challenge
The key idea is that you are building a matrix that contains the
solutions to smaller problems which are sub-problems of the big
problem. The first row of the matrix SSQ contains the solution for no
splits, ie SSQ[1,j] is just the sum of squares about the overall mean
for reading chapters1 through j in one day. The iteration then uses
row m-1 to construct row m, since if SSQ[m-1,j] (optimal reading of j
chapters in m-1 days) is part of the overall optimal solution, you
have already computed it, and so don't ever need to recompute it.
TS = SSQ[m-1,j]+(SSQ1[j+1])
computes the vector of possible solutions for SSQ[m,n] (n chapters in n days)
breaking it into two pieces: chapters 1 to j in m-1 days, and chapters j+1 to
n in 1 day. j is a vector in the function, and min(TS) is the minimum
over choices of j, ie SSQ[m,n].
At the end, SSQ[128,239] is the optimal value for reading all 239
chapters in 128 days. That's just the objective function, so the rest
involves constructing the list of optimal cuts, ie which chapters are
grouped together for each day's reading. That code uses the same
idea... constructing a list of lists of cutpoints.
statisticians should study a bit of data structures and algorithms!
albyn
On Wed, Jan 13, 2010 at 10:45:11AM -0700, Greg Snow wrote:
WOW, your results give about half the variance of my best optim run (possibly due to my suboptimal use of optim). Can you describe a little what the algorithm is doing? -- Gregory (Greg) L. Snow Ph.D. Statistical Data Center Intermountain Healthcare greg.snow at imail.org 801.408.8111
-----Original Message-----
From: Albyn Jones [mailto:jones at reed.edu]
Sent: Tuesday, January 12, 2010 5:31 PM
To: Greg Snow
Cc: r-help at r-project.org
Subject: Re: [R] optimization challenge
Greg
Nice problem: I wasted my whole day on it :-)
I was explaining my plan for a solution to a colleague who is a
computer scientist, he pointed out that I was trying to re-invent the
wheel known as dynamic programming. here is my code, apparently it is
called "bottom up dynamic programming". It runs pretty quickly, and
returns (what I hope is :-) the optimal sum of squares and the
cut-points.
function(X=bom3$Verses,days=128){
# find optimal BOM reading schedule for Greg Snow
# minimize variance of quantity to read per day over 128 days
#
N = length(X)
Nm1 = N-1
SSQ<- matrix(NA,nrow=days,ncol=N)
Cuts <- list()
#
# SSQ[i,j]: the ssqs about the overall mean for the optimal partition
# for i days on the chapters 1 to j
#
M = sum(X)/days
CS = cumsum(X)
SSQ[1,]= (CS-M)^2
Cuts[[1]]= as.list(1:N)
#
for(m in 2:days){
Cuts[[m]]=list()
#for(i in 1:(m-1)) Cuts[[m]][[i]] = Cuts[[m-1]][[i]]
for(n in m:N){
CS = cumsum(X[n:1])[n:1]
SSQ1 = (CS-M)^2
j = (m-1):(n-1)
TS = SSQ[m-1,j]+(SSQ1[j+1])
SSQ[m,n] = min(TS)
k = min(which((min(TS)== TS)))+m-1
Cuts[[m]][[n]] = c(Cuts[[m-1]][[k-1]],n)
}
}
list(SSQ=SSQ[days,N],Cuts=Cuts[[days]][[N]])
}
$SSQ
[1] 11241.05
$Cuts
[1] 2 4 7 9 11 13 15 16 17 19 21 23 25 27 30 31
34 37
[19] 39 41 44 46 48 50 53 56 59 60 62 64 66 68 70 73
75 77
[37] 78 80 82 84 86 88 89 91 92 94 95 96 97 99 100 103
105 106
[55] 108 110 112 113 115 117 119 121 124 125 126 127 129 131 132 135
137 138
[73] 140 141 142 144 145 146 148 150 151 152 154 156 157 160 162 163
164 166
[91] 167 169 171 173 175 177 179 181 183 185 186 188 190 192 193 194
196 199
[109] 201 204 205 207 209 211 213 214 215 217 220 222 223 225 226 228
234 236
[127] 238 239
On Tue, Jan 12, 2010 at 11:33:36AM -0700, Greg Snow wrote:
I have a challenge that I want to share with the group. This is not homework (but I may assign it as such if I teach the
appropriate class again) and I have found one solution, so don't need anything urgent. This is more for fun to see if others can find a better solution than I did.
The challenge: I want to read a book in a given number of days. I want to read an
integer number of chapters each day (there are more chapters than days), no stopping part way through a chapter, and at least 1 chapter each day. The chapters are very non uniform in length (some very short, a few very long, many in between) so I would like to come up with a reading schedule that minimizes the variance of the length of the days readings (read multiple short chapters on the same day, long chapters are the only one read that day). I also want to read through the book in order (no skipping ahead to combine short chapters that are not naturally next to each other.
My thought was that the optim function with method="SANN" would be an
appropriate approach, but my first couple of tries did not give very good results. I have since come up with an optim with SANN solution that gives what I consider good results (but I accept that better is possible).
Below is a data frame with the lengths of the chapters for the book
that originally sparked the challenge for me (but the general idea should work for any book). Each row represents a chapter (in order) with 3 different measures of the length of the chapter.
For this challenge I want to read the book in 128 days (there are 239
chapters).
I will post my solutions in a few days, but I want to wait so that my
direction does not influence people from trying other approaches (if there is something better than optim, that is fine).
Good luck for anyone interested in the challenge,
The data frame:
bom3 <- structure(list(Chapter = structure(1:239, .Label = c("1 Nephi
1",
"1 Nephi 2", "1 Nephi 3", "1 Nephi 4", "1 Nephi 5", "1 Nephi 6", "1 Nephi 7", "1 Nephi 8", "1 Nephi 9", "1 Nephi 10", "1 Nephi 11", "1 Nephi 12", "1 Nephi 13", "1 Nephi 14", "1 Nephi 15", "1 Nephi 16", "1 Nephi 17", "1 Nephi 18", "1 Nephi 19", "1 Nephi 20", "1 Nephi 21", "1 Nephi 22", "2 Nephi 1", "2 Nephi 2", "2 Nephi 3", "2 Nephi 4", "2 Nephi 5", "2 Nephi 6", "2 Nephi 7", "2 Nephi 8", "2 Nephi 9", "2 Nephi 10", "2 Nephi 11", "2 Nephi 12", "2 Nephi 13", "2 Nephi 14", "2 Nephi 15", "2 Nephi 16", "2 Nephi 17", "2 Nephi 18", "2 Nephi 19", "2 Nephi 20", "2 Nephi 21", "2 Nephi 22", "2 Nephi 23", "2 Nephi 24", "2 Nephi 25", "2 Nephi 26", "2 Nephi 27", "2 Nephi 28", "2 Nephi 29", "2 Nephi 30", "2 Nephi 31", "2 Nephi 32", "2 Nephi 33", "Jacob 1", "Jacob 2", "Jacob 3", "Jacob 4", "Jacob 5", "Jacob 6", "Jacob 7", "Enos 1", "Jarom 1", "Omni 1", "Words of Mormon 1", "Mosiah 1", "Mosiah 2", "Mosiah 3", "Mosiah 4", "Mosiah 5", "Mosiah 6", "Mosiah
7",
"Mosiah 8", "Mosiah 9", "Mosiah 10", "Mosiah 11", "Mosiah 12", "Mosiah 13", "Mosiah 14", "Mosiah 15", "Mosiah 16", "Mosiah 17", "Mosiah 18", "Mosiah 19", "Mosiah 20", "Mosiah 21", "Mosiah 22", "Mosiah 23", "Mosiah 24", "Mosiah 25", "Mosiah 26", "Mosiah 27", "Mosiah 28", "Mosiah 29", "Alma 1", "Alma 2", "Alma 3", "Alma 4", "Alma 5", "Alma 6", "Alma 7", "Alma 8", "Alma 9", "Alma 10", "Alma 11", "Alma 12", "Alma 13", "Alma 14", "Alma 15", "Alma 16", "Alma 17", "Alma 18", "Alma 19", "Alma 20", "Alma 21", "Alma 22", "Alma 23", "Alma 24", "Alma 25", "Alma 26", "Alma 27", "Alma 28", "Alma 29", "Alma 30", "Alma 31", "Alma 32", "Alma 33", "Alma 34", "Alma 35", "Alma 36", "Alma 37", "Alma 38", "Alma 39", "Alma 40", "Alma 41", "Alma 42", "Alma 43", "Alma 44", "Alma 45", "Alma 46", "Alma 47", "Alma 48", "Alma 49", "Alma 50", "Alma 51", "Alma 52", "Alma 53", "Alma 54", "Alma 55", "Alma 56", "Alma 57", "Alma 58", "Alma 59", "Alma 60", "Alma 61", "Alma 62", "Alma 63", "Helaman 1", "Helaman 2", "Helaman 3", "Helaman 4", "Helaman 5", "Helaman 6", "Helaman 7", "Helaman 8", "Helaman 9", "Helaman 10", "Helaman 11", "Helaman 12", "Helaman 13", "Helaman 14", "Helaman 15", "Helaman 16", "3 Nephi 1", "3 Nephi 2", "3 Nephi 3", "3 Nephi 4", "3 Nephi 5", "3 Nephi 6", "3 Nephi 7", "3 Nephi 8", "3 Nephi 9", "3 Nephi 10", "3 Nephi 11", "3 Nephi 12", "3 Nephi 13", "3 Nephi 14", "3 Nephi 15", "3 Nephi 16", "3 Nephi 17", "3 Nephi 18", "3 Nephi 19", "3 Nephi 20", "3 Nephi 21", "3 Nephi 22", "3 Nephi 23", "3 Nephi 24", "3 Nephi 25", "3 Nephi 26", "3 Nephi 27", "3 Nephi 28", "3 Nephi 29", "3 Nephi 30", "4 Nephi 1", "Mormon 1", "Mormon 2", "Mormon 3", "Mormon 4", "Mormon 5", "Mormon 6", "Mormon 7", "Mormon 8", "Mormon 9", "Ether
1",
"Ether 2", "Ether 3", "Ether 4", "Ether 5", "Ether 6", "Ether 7", "Ether 8", "Ether 9", "Ether 10", "Ether 11", "Ether 12", "Ether 13", "Ether 14", "Ether 15", "Moroni 1", "Moroni 2", "Moroni 3", "Moroni
4",
"Moroni 5", "Moroni 6", "Moroni 7", "Moroni 8", "Moroni 9", "Moroni
10"
), class = "factor"), Words = c(908L, 879L, 1067L, 1262L, 761L, 202L, 992L, 1221L, 259L, 924L, 1315L, 860L, 1899L, 1284L, 1488L, 1618L, 2523L, 1217L, 1292L, 698L, 945L, 1506L, 1543L, 1460L, 1170L, 1300L, 1169L, 895L, 405L, 812L, 2388L, 966L, 338L, 647L, 587L, 203L, 857L, 370L, 687L, 570L, 587L, 928L, 520L, 134L, 587L, 891L, 1699L, 1483L, 1461L, 1240L, 804L, 708L, 988L, 426L, 647L, 719L, 1365L, 619L, 929L, 3758L, 511L, 1242L, 1160L, 734L, 1398L, 857L, 966L, 2112L, 1117L, 1605L, 740L, 309L, 1555L, 938L, 864L, 957L, 1271L, 1291L, 1073L, 391L, 1056L, 560L, 650L, 1382L, 978L, 963L, 1328L, 620L, 1186L, 954L, 837L, 1200L, 1601L, 812L, 1879L, 1496L, 1433L, 1016L, 1035L, 2787L, 390L, 1443L, 1231L, 1511L, 1442L, 1466L, 1858L, 1347L, 1526L, 711L, 1010L, 1848L, 1623L, 1701L, 1279L, 955L, 1871L, 764L, 1509L, 752L, 1665L, 1260L, 575L, 708L, 2666L, 1478L, 1837L, 855L, 1576L, 699L, 1229L, 2027L, 651L, 793L, 1153L, 701L, 1229L, 2221L, 1243L, 911L, 1809L, 1572L, 1073L, 1345L, 1734L, 1682L, 1757L, 1085L, 988L, 1218L, 2177L, 1517L, 1748L, 489L, 1777L, 854L, 2220L, 593L, 1418L, 599L, 1527L, 1076L, 2084L, 1797L, 1142L, 1210L, 1480L, 720L, 1561L, 873L, 1855L, 1241L, 824L, 1025L, 1340L, 769L, 1353L, 1518L, 931L, 1200L, 1132L, 871L, 965L, 807L, 1434L, 1294L, 834L, 628L, 731L, 913L, 879L, 1344L, 1233L, 1538L, 1155L, 507L, 415L, 620L, 183L, 793L, 1269L, 1457L, 394L, 130L, 1949L, 706L, 1262L, 939L, 822L, 1067L, 914L, 454L, 1710L, 1510L, 901L, 1370L, 1253L, 892L, 226L, 1048L, 899L, 1231L, 1424L, 1415L, 762L, 1536L, 1219L, 1132L, 1314L, 147L, 119L, 120L, 153L, 91L, 335L, 1929L, 1064L, 1012L, 1149L), Letters =
c(3746L,
3640L, 4295L, 4968L, 3202L, 777L, 3941L, 4769L, 1075L, 3829L,
5159L, 3527L, 7874L, 5236L, 6149L, 6555L, 10180L, 4960L, 5399L,
2767L, 3758L, 6275L, 6391L, 6151L, 4685L, 5267L, 4767L, 3780L,
1574L, 3261L, 9985L, 4106L, 1332L, 2557L, 2454L, 810L, 3540L,
1406L, 2668L, 2304L, 2474L, 3715L, 2090L, 533L, 2442L, 3587L,
7294L, 6363L, 5809L, 4997L, 3197L, 2941L, 4065L, 1743L, 2539L,
3149L, 5815L, 2765L, 4027L, 15366L, 2091L, 4988L, 4730L, 3149L,
5906L, 3704L, 4188L, 8675L, 4771L, 6586L, 2965L, 1313L, 6326L,
3948L, 3489L, 3942L, 5205L, 5309L, 4300L, 1574L, 4559L, 2393L,
2655L, 5755L, 4070L, 4027L, 5649L, 2651L, 4978L, 3970L, 3610L,
5112L, 6733L, 3513L, 7990L, 6356L, 6179L, 4340L, 4432L, 11260L,
1657L, 5913L, 5033L, 6274L, 5835L, 5865L, 7802L, 5776L, 6295L,
3034L, 4383L, 7842L, 6659L, 6905L, 5104L, 4162L, 7733L, 3321L,
6241L, 3212L, 6840L, 5294L, 2471L, 2748L, 10762L, 6269L, 7479L,
3416L, 6477L, 3043L, 4719L, 8764L, 2494L, 3168L, 4790L, 2983L,
5129L, 9795L, 5043L, 3913L, 7635L, 6693L, 4669L, 5968L, 7508L,
7271L, 7543L, 4730L, 4095L, 5152L, 9129L, 6395L, 7357L, 2166L,
7512L, 3544L, 9554L, 2505L, 6171L, 2568L, 6542L, 4781L, 8655L,
7721L, 4751L, 5134L, 6032L, 3013L, 6536L, 3504L, 7527L, 5106L,
3607L, 4247L, 5524L, 3404L, 5947L, 6506L, 3891L, 5256L, 4944L,
3700L, 4006L, 3392L, 5732L, 5185L, 3402L, 2451L, 2962L, 3679L,
3550L, 5429L, 5083L, 6354L, 4659L, 2155L, 1754L, 2496L, 721L,
3326L, 4917L, 5856L, 1589L, 564L, 8300L, 2987L, 5317L, 3820L,
3595L, 4483L, 3664L, 1805L, 6931L, 6225L, 3508L, 5481L, 5007L,
3623L, 891L, 4265L, 3746L, 5041L, 5823L, 5726L, 3238L, 6443L,
5053L, 4664L, 5370L, 614L, 459L, 491L, 629L, 351L, 1457L, 7812L,
4677L, 4305L, 4603L), Verses = c(20, 24, 31, 38, 22, 6, 22, 38,
6, 22, 36, 23, 42, 30, 36, 39, 55, 25, 24, 22, 26, 31, 32, 30,
25, 35, 34, 18, 11, 25, 54, 25, 8, 22, 26, 6, 30, 13, 25, 22,
21, 34, 16, 6, 22, 32, 30, 33, 35, 32, 14, 18, 21, 9, 15, 19,
35, 14, 18, 77, 13, 27, 27, 15, 30, 18, 18, 41, 27, 30, 15, 7,
33, 21, 19, 22, 29, 37, 35, 12, 31, 15, 20, 35, 29, 26, 36, 16,
39, 25, 24, 39, 37, 20, 47, 33, 38, 27, 20, 62, 8, 27, 32, 34,
32, 46, 37, 31, 29, 19, 21, 39, 43, 36, 30, 23, 35, 18, 30, 17,
37, 30, 14, 17, 60, 38, 43, 23, 41, 16, 30, 47, 15, 19, 26, 15,
31, 54, 24, 24, 41, 36, 25, 30, 40, 37, 40, 23, 24, 35, 57, 36,
41, 13, 36, 21, 52, 17, 34, 14, 37, 26, 52, 41, 29, 28, 41, 19,
38, 26, 39, 31, 17, 25, 30, 19, 26, 33, 26, 30, 26, 25, 22, 19,
41, 48, 34, 27, 24, 20, 25, 39, 36, 46, 29, 17, 14, 18, 6, 21,
33, 39, 9, 2, 49, 19, 29, 22, 23, 24, 22, 10, 41, 37, 43, 25,
28, 19, 6, 30, 27, 26, 35, 34, 23, 41, 31, 31, 34, 4, 3, 4, 3,
2, 9, 48, 30, 26, 34)), .Names = c("Chapter", "Words", "Letters",
"Verses"), row.names = c(NA, -239L), class = "data.frame")
--
Gregory (Greg) L. Snow Ph.D.
Statistical Data Center
Intermountain Healthcare
greg.snow at imail.org
801.408.8111
______________________________________________ R-help at r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-
guide.html
and provide commented, minimal, self-contained, reproducible code.