Difference: DanielHaydenDataSamples (23 vs. 24)

Revision 2417 Aug 2011 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

Data Samples

Line: 30 to 30
 

Setup Area

Changed:
<
<
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 16.0.2, with the setup -tag=16.0.2,setup,32.
>
>
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 16.6.5, with the setup -tag=16.6.5,setup,32.
 

Get joboptions files to use/modify

Line: 50 to 50
  Go to your run directory such as:
Changed:
<
<
> cd testarea/16.0.2
>
>
> cd testarea/16.6.5
 > cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/run

You need to obtain the following two files via, although the latter most is really just an example file:

Line: 70 to 70
 

Making Validation Plots & Collecting Information

Changed:
<
<
The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no (or minimal) cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.
>
>
The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no (or minimal) cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload. I have attached below an example script for doing this:

MCProduction.cxx
MCProduction.h
MCProduction.py

  Important! When the job finishes running, you will be left with a number of log files, namely EvgenCorrAtlfast_trf.log for Evgen.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
Line: 95 to 99
  Now all that's left to do is send all of this information, along with the joboptions file(s), and a link to the Twiki page along to your MC Production representative, and everything should be taken out of your hands from there!
Changed:
<
<

Automated Process

>
>

Semi-Automated Process

  First of all I want to thank Peter Waller for his coding expertise which helped me realise this Process. I was faced with having to do all of the above, for 15 samples, and I thought there must be a simpler way of doing things, which led me to come up with this idea.
Line: 119 to 123
  The result should be that each sample folder is filled with the needed validation plots, and cross-section text file, thus simplifying and automating the whole process to the nth degree!

Added:
>
>

Fully-Automated Process

In some instance you will want to create a lot of samples, but perhaps just to find the cross-sections of a range of mass points using pythia. This is what I did for the Graviton at various couplings, and as good as the process above works, I still had to make each folder and jobOptions which would have taken a while, therefore I wrote this fully automated process. You will need the files above, as well as:

MakeFolders.sh
CollectXS.sh
Extract.py
XSCollection.txt

Once you have these files, you can edit MakeFolders.sh to create the various jobOptions files you want using the iterator to change the mass point (or anything else you care to program). This script will also create the required folders, as well as write your joblist.txt for you. So the whole process can then be run using:

./MakeFolders.sh
./run_all.sh

Once all of your files have been run with pythia, you should be in the state of having all your folders filled with the cross-section lines filtered out into a text file. The final step is to iterate over these to make your XSCollection.txt file which can be done by appropriately editing and then running:

./CollectXS.sh

Note: This process I describe is only really for collecting cross-sections but you can turn on the Validation plot making part in the run_one_job.sh to also make validation for each sample (Warning! This will take much more time if turned on!).

 

Links

Line: 143 to 166
  -->
Changed:
<
<
META FILEATTACHMENT attachment="run_all.sh" attr="h" comment="" date="1299503341" name="run_all.sh" path="run_all.sh" size="52" stream="run_all.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="run_one_job.sh" attr="h" comment="" date="1299503371" name="run_one_job.sh" path="run_one_job.sh" size="1758" stream="run_one_job.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="parse_evgen_log.py.txt" attr="h" comment="" date="1299503400" name="parse_evgen_log.py.txt" path="parse_evgen_log.py" size="726" stream="parse_evgen_log.py" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="job_list.txt" attr="h" comment="" date="1299503415" name="job_list.txt" path="job_list.txt" size="1728" stream="job_list.txt" user="Public.DanielHayden" version="2"
>
>
META FILEATTACHMENT attachment="run_all.sh" attr="h" comment="" date="1313605344" name="run_all.sh" path="run_all.sh" size="52" stream="run_all.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="run_one_job.sh" attr="h" comment="" date="1313605329" name="run_one_job.sh" path="run_one_job.sh" size="1984" stream="run_one_job.sh" user="Public.DanielHayden" version="3"
META FILEATTACHMENT attachment="parse_evgen_log.py.txt" attr="h" comment="" date="1313605364" name="parse_evgen_log.py.txt" path="parse_evgen_log.py" size="726" stream="parse_evgen_log.py" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="job_list.txt" attr="h" comment="" date="1313605503" name="job_list.txt" path="job_list.txt" size="4695" stream="job_list.txt" user="Public.DanielHayden" version="3"
 
META FILEATTACHMENT attachment="ValidationPlots.C" attr="h" comment="" date="1267189084" name="ValidationPlots.C" path="ValidationPlots.C" size="589" stream="ValidationPlots.C" user="Public.DanielHayden" version="1"
Added:
>
>
META FILEATTACHMENT attachment="XSCollection.txt" attr="h" comment="" date="1313606288" name="XSCollection.txt" path="XSCollection.txt" size="1845" stream="XSCollection.txt" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MakeFolders.sh" attr="h" comment="" date="1313606301" name="MakeFolders.sh" path="MakeFolders.sh" size="3021" stream="MakeFolders.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="Extract.py.txt" attr="h" comment="" date="1313606313" name="Extract.py.txt" path="Extract.py" size="519" stream="Extract.py" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="CollectXS.sh" attr="h" comment="" date="1313606326" name="CollectXS.sh" path="CollectXS.sh" size="369" stream="CollectXS.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MCProduction.cxx" attr="h" comment="" date="1313606338" name="MCProduction.cxx" path="MCProduction.cxx" size="14141" stream="MCProduction.cxx" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MCProduction.h" attr="h" comment="" date="1313606348" name="MCProduction.h" path="MCProduction.h" size="2724" stream="MCProduction.h" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MCProduction.py.txt" attr="h" comment="" date="1313606358" name="MCProduction.py.txt" path="MCProduction.py" size="6796" stream="MCProduction.py" user="Public.DanielHayden" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding RHUL Physics Department TWiki? Send feedback