Difference: DanielHaydenDataSamples (1 vs. 35)

Revision 3530 May 2013 - teak_5ftwiki_5furl_5fchanger_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 3430 May 2013 - teak_5ftwiki_5furl_5fchanger_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 3330 May 2013 - teak_5ftwiki_5furl_5fchanger_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 3229 May 2013 - teak_5ftwiki_5furl_5fchanger_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 3129 May 2013 - teak_5ftwiki_5furl_5fchanger_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 3021 Aug 2012 - webmanip_5fw2sw_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 2921 Aug 2012 - webmanip_5fw2sw_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 2818 Aug 2012 - webmanip_5fw2sw_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 2705 Jun 2012 - webmanip_5fw2sw_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 2616 Apr 2012 - webmanip_5fw2sw_2esh

Line: 147 to 147
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 
Changed:
<
<
>
>
 

Revision 2518 Aug 2011 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

Data Samples

Line: 38 to 38
  http://alxr.usatlas.bnl.gov/lxr/source/atlas/Generators/EvgenJobOptions/share/
Changed:
<
<
Or more importantly for MC9 now, here:
>
>
Or more importantly for MC11 now, here:
 
Changed:
<
<
https://svnweb.cern.ch/trac/atlasoff/browser/Generators/MC09JobOptions/trunk/share
>
>
http://alxr.usatlas.bnl.gov/lxr/source/atlas/Generators/MC11JobOptions/share/
  All I did, was find the Particle and Decay I was interested in, take the joboptions file, and modify it for my own needs. Most of the time this just involves changing the Mass or some Coupling, that is well documented in the joboptions file itself. If you want to do something more drastic however, like make a new sample that has not even been roughly coded before, then I have not done this, but I would suggest you start by looking at multiple joboptions files, such as if you wanted to simulate G->ee and G->mumu, where currently there are only seperate files that do this; Take the two seperate files, and copy the lines which correspond to the decaying of each process into a new file, start building your joboptions that way, and after testing with a well known joboptions to see what you would expect, test yours and see if it makes sense.

Revision 2417 Aug 2011 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

Data Samples

Line: 30 to 30
 

Setup Area

Changed:
<
<
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 16.0.2, with the setup -tag=16.0.2,setup,32.
>
>
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 16.6.5, with the setup -tag=16.6.5,setup,32.
 

Get joboptions files to use/modify

Line: 50 to 50
  Go to your run directory such as:
Changed:
<
<
> cd testarea/16.0.2
>
>
> cd testarea/16.6.5
 > cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/run

You need to obtain the following two files via, although the latter most is really just an example file:

Line: 70 to 70
 

Making Validation Plots & Collecting Information

Changed:
<
<
The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no (or minimal) cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.
>
>
The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no (or minimal) cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload. I have attached below an example script for doing this:

MCProduction.cxx
MCProduction.h
MCProduction.py

  Important! When the job finishes running, you will be left with a number of log files, namely EvgenCorrAtlfast_trf.log for Evgen.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
Line: 95 to 99
  Now all that's left to do is send all of this information, along with the joboptions file(s), and a link to the Twiki page along to your MC Production representative, and everything should be taken out of your hands from there!
Changed:
<
<

Automated Process

>
>

Semi-Automated Process

  First of all I want to thank Peter Waller for his coding expertise which helped me realise this Process. I was faced with having to do all of the above, for 15 samples, and I thought there must be a simpler way of doing things, which led me to come up with this idea.
Line: 119 to 123
  The result should be that each sample folder is filled with the needed validation plots, and cross-section text file, thus simplifying and automating the whole process to the nth degree!

Added:
>
>

Fully-Automated Process

In some instance you will want to create a lot of samples, but perhaps just to find the cross-sections of a range of mass points using pythia. This is what I did for the Graviton at various couplings, and as good as the process above works, I still had to make each folder and jobOptions which would have taken a while, therefore I wrote this fully automated process. You will need the files above, as well as:

MakeFolders.sh
CollectXS.sh
Extract.py
XSCollection.txt

Once you have these files, you can edit MakeFolders.sh to create the various jobOptions files you want using the iterator to change the mass point (or anything else you care to program). This script will also create the required folders, as well as write your joblist.txt for you. So the whole process can then be run using:

./MakeFolders.sh
./run_all.sh

Once all of your files have been run with pythia, you should be in the state of having all your folders filled with the cross-section lines filtered out into a text file. The final step is to iterate over these to make your XSCollection.txt file which can be done by appropriately editing and then running:

./CollectXS.sh

Note: This process I describe is only really for collecting cross-sections but you can turn on the Validation plot making part in the run_one_job.sh to also make validation for each sample (Warning! This will take much more time if turned on!).

 

Links

Line: 143 to 166
  -->
Changed:
<
<
META FILEATTACHMENT attachment="run_all.sh" attr="h" comment="" date="1299503341" name="run_all.sh" path="run_all.sh" size="52" stream="run_all.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="run_one_job.sh" attr="h" comment="" date="1299503371" name="run_one_job.sh" path="run_one_job.sh" size="1758" stream="run_one_job.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="parse_evgen_log.py.txt" attr="h" comment="" date="1299503400" name="parse_evgen_log.py.txt" path="parse_evgen_log.py" size="726" stream="parse_evgen_log.py" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="job_list.txt" attr="h" comment="" date="1299503415" name="job_list.txt" path="job_list.txt" size="1728" stream="job_list.txt" user="Public.DanielHayden" version="2"
>
>
META FILEATTACHMENT attachment="run_all.sh" attr="h" comment="" date="1313605344" name="run_all.sh" path="run_all.sh" size="52" stream="run_all.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="run_one_job.sh" attr="h" comment="" date="1313605329" name="run_one_job.sh" path="run_one_job.sh" size="1984" stream="run_one_job.sh" user="Public.DanielHayden" version="3"
META FILEATTACHMENT attachment="parse_evgen_log.py.txt" attr="h" comment="" date="1313605364" name="parse_evgen_log.py.txt" path="parse_evgen_log.py" size="726" stream="parse_evgen_log.py" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="job_list.txt" attr="h" comment="" date="1313605503" name="job_list.txt" path="job_list.txt" size="4695" stream="job_list.txt" user="Public.DanielHayden" version="3"
 
META FILEATTACHMENT attachment="ValidationPlots.C" attr="h" comment="" date="1267189084" name="ValidationPlots.C" path="ValidationPlots.C" size="589" stream="ValidationPlots.C" user="Public.DanielHayden" version="1"
Added:
>
>
META FILEATTACHMENT attachment="XSCollection.txt" attr="h" comment="" date="1313606288" name="XSCollection.txt" path="XSCollection.txt" size="1845" stream="XSCollection.txt" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MakeFolders.sh" attr="h" comment="" date="1313606301" name="MakeFolders.sh" path="MakeFolders.sh" size="3021" stream="MakeFolders.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="Extract.py.txt" attr="h" comment="" date="1313606313" name="Extract.py.txt" path="Extract.py" size="519" stream="Extract.py" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="CollectXS.sh" attr="h" comment="" date="1313606326" name="CollectXS.sh" path="CollectXS.sh" size="369" stream="CollectXS.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MCProduction.cxx" attr="h" comment="" date="1313606338" name="MCProduction.cxx" path="MCProduction.cxx" size="14141" stream="MCProduction.cxx" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MCProduction.h" attr="h" comment="" date="1313606348" name="MCProduction.h" path="MCProduction.h" size="2724" stream="MCProduction.h" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="MCProduction.py.txt" attr="h" comment="" date="1313606358" name="MCProduction.py.txt" path="MCProduction.py" size="6796" stream="MCProduction.py" user="Public.DanielHayden" version="1"

Revision 2307 Mar 2011 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

Data Samples

Line: 56 to 56
 You need to obtain the following two files via, although the latter most is really just an example file:

> get_files PDGTABLE.!MeV

Changed:
<
<
> get_files Evgen_trf.py (Importantly for MC10)

>
>
> get_files EvgenCorrAtlfast_trf.py
> get_files Evgen_trf.py

 
Changed:
<
<
Then you are ready to make your first sample. Using Evgen_trf.py, you can type this with the -h command after to see what the following tags mean, but to summarise in order they are; CentreOfMassE / RunNumber (Has to match your jobOption) / Starting Event / Number of Events / Random 10 Digit Seed / JobOptions / Output Filename.
>
>
Then you are ready to make your first sample. Using "EvgenCorrAtlfast_trf.py, you can type this with the -h command after to see what the following tags mean, but to summarise in order they are; CentreOfMassE / RunNumber (Has to match your jobOption) / Starting Event / Number of Events / Random 10 Digit Seed / JobOptions / Output Filename.
  In Reality if you ONLY want the Electron Container information etc without Jet Info and other things, then you only need to run the EvgenCorrAtlfast_trf.py.

> Evgen_trf.py 7000 0700000 1 5000 1234567812 MC10.0700000.Pythia_Gee01_1000.py Output.pool.root

> EvgenCorrAtlfast_trf.py 7000 0700000 1 5000 1234567812 MC10.0700000.Pythia_Gee01_1000.py Output.pool.root AOD.pool.root ntuple.pool.root

Changed:
<
<
Note here, that MC10.070000.template.py is your joboptions file, and 5000, is the number of events you are going to make in your sample. The other file names are your output. I would recommend redirecting these to your tmp directory on lxplus as they can be 100mb big or so. Just remember to send them to linappserv1 or somewhere before you next log off so they don't disappear!
>
>
Note here, that MC10.070000.Gee01_1000.py is your joboptions file, and 5000, is the number of events you are going to make in your sample. The other file names are your output. I would recommend redirecting these to your tmp directory on lxplus as they can be 100mb big or so. Just remember to send them to your institutes local server or somewhere before you next log off so they don't disappear!
 

Making Validation Plots & Collecting Information

Changed:
<
<
The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.
>
>
The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no (or minimal) cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.
  Important! When the job finishes running, you will be left with a number of log files, namely EvgenCorrAtlfast_trf.log for Evgen.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
Line: 96 to 97
 

Automated Process

Changed:
<
<
First of all I want to thank Peter Waller for his coding expertise which enabled me to realise this Process. I was faced with having to do all of the above, for 15 samples, and I thought there must be a simpler way of doing things, which led me to come up with this idea.
>
>
First of all I want to thank Peter Waller for his coding expertise which helped me realise this Process. I was faced with having to do all of the above, for 15 samples, and I thought there must be a simpler way of doing things, which led me to come up with this idea.
  First of all you have to have set up most of the above steps, i.e. you need to:
Line: 105 to 106
 
  • Copy this Macro to the run directory of the above.
  • Follow the steps below.
Changed:
<
<
Now you will need to make a folder (I put it on my Desktop) and inside the folder do two things; Make a folder for every sample (Named Accordingly), and download the files below into the main folder.
>
>
Now you will need to make a folder (I put it on my Desktop) and inside the folder do two things; Make a folder for every sample (Named Accordingly, i.e. for MC10.0700000.Pythia_Gee01_500.py, I make a subfolder called Gee01_500 and so on...), and download the files below into the main folder.
  run_one_job.sh
run_all.sh
parse_evgen_log.py
joblist.txt
Changed:
<
<
You will have to change the paths in these files (namely joblist.txt and run_one_job.sh) to match and make sense for your own setup, but the files are self explanatory and I have added comments where necessary to make it a fairly trivial process. Also I have named a jobOptions called MCProduction.py in the macro but have omitted it here. This file simply runs over the .root output file and outputs the histograms you require for validation (usually; Pt, Eta, and Invariant Mass) without any cuts. I have not included it here as everyones setup / needed plots will be slightly different, it is easy to make, and as different releases come out the code might change where as what I have provided should always be true.
>
>
You will have to change the paths in these files (namely joblist.txt and run_one_job.sh) to match and make sense for your own setup, but the files are self explanatory and I have added comments where necessary to make it a fairly trivial process. Also I have named a jobOptions called MCProduction.py in the macro but have omitted it here. This file simply runs over the .root output file and outputs the histograms you require for validation (usually; Pt, Eta, and Invariant Mass) without any (or minimal) cuts as I previously described. I have not included it here as everyones setup / needed plots will be slightly different, it is easy to make, and as different releases come out the code might change where as what I have provided should always be true.
 
Changed:
<
<
The final step is to put a JobOptions File into each respective folder, and then simply open a terminal, navigate to the folder and run with ./run_all.sh.
>
>
The final step is to put a JobOptions File into each respective subfolder, and then simply open a terminal, navigate to the main folder containing all of the downloaded pieces of code above, and your subfolders with jobOptions in, and then run with ./run_all.sh.
  The result should be that each sample folder is filled with the needed validation plots, and cross-section text file, thus simplifying and automating the whole process to the nth degree!

Line: 119 to 120
 The result should be that each sample folder is filled with the needed validation plots, and cross-section text file, thus simplifying and automating the whole process to the nth degree!

Deleted:
<
<
 

Links

Changed:
<
<
>
>
 
Line: 145 to 143
  -->
Changed:
<
<
META FILEATTACHMENT attachment="run_all.sh" attr="h" comment="" date="1267188942" name="run_all.sh" path="run_all.sh" size="51" stream="run_all.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="run_one_job.sh" attr="h" comment="" date="1267189001" name="run_one_job.sh" path="run_one_job.sh" size="1922" stream="run_one_job.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="parse_evgen_log.py.txt" attr="h" comment="" date="1267189014" name="parse_evgen_log.py.txt" path="parse_evgen_log.py" size="709" stream="parse_evgen_log.py" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="job_list.txt" attr="h" comment="" date="1267189030" name="job_list.txt" path="job_list.txt" size="2217" stream="job_list.txt" user="Public.DanielHayden" version="1"
>
>
META FILEATTACHMENT attachment="run_all.sh" attr="h" comment="" date="1299503341" name="run_all.sh" path="run_all.sh" size="52" stream="run_all.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="run_one_job.sh" attr="h" comment="" date="1299503371" name="run_one_job.sh" path="run_one_job.sh" size="1758" stream="run_one_job.sh" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="parse_evgen_log.py.txt" attr="h" comment="" date="1299503400" name="parse_evgen_log.py.txt" path="parse_evgen_log.py" size="726" stream="parse_evgen_log.py" user="Public.DanielHayden" version="2"
META FILEATTACHMENT attachment="job_list.txt" attr="h" comment="" date="1299503415" name="job_list.txt" path="job_list.txt" size="1728" stream="job_list.txt" user="Public.DanielHayden" version="2"
 
META FILEATTACHMENT attachment="ValidationPlots.C" attr="h" comment="" date="1267189084" name="ValidationPlots.C" path="ValidationPlots.C" size="589" stream="ValidationPlots.C" user="Public.DanielHayden" version="1"

Revision 2204 Mar 2011 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

Data Samples

Changed:
<
<

Notes

>
>

Samples & Cross-Sections

 
Changed:
<
<
For all the Latest Samples and Cross-Sections Please go to the Page I made Here.

The first two digits of the 6 digit code after mc08 (for example) implies the COM energy of the sample:

10 = 10 TeV 00 = 14 TeV

Z'

mc08.105603.Pythia_Zprime_ee_SSM1000.recon.AOD.e352_s462_r541
mc08.105624.Pythia_Zprime_ee_SSM1500.recon.AOD.e357_s462_r541

Graviton

@ 10 TeV

mc08.105616.Pythia_Gee_300.recon.AOD.e355_s462_r541

Release E CM G* Mass k/Mpl N Evts xsec x BR
14.1.0 10 TeV 300 GeV 0.01 5 000 834 fb
14.1.0 10 TeV 500 GeV 0.01 5 000 79 fb
14.1.0 10 TeV 750 GeV 0.05 5 000 257 fb
14.1.0 10 TeV 1000 GeV 0.05 5 000 54.4 fb
14.1.0 10 TeV 1400 GeV 0.05 5 000 7.7 fb

@ 7 TeV

Release E CM G* Mass k/Mpl N Evts xsec x BR
15.6.1.7 7 TeV 300 GeV 0.01 5 000 521.6 fb
15.6.1.7 7 TeV 500 GeV 0.01 5 000 40.46 fb
15.6.1.7 7 TeV 800 GeV 0.01 5 000 2.996 fb
15.6.1.7 7 TeV 1000 GeV 0.01 5 000 0.7839 fb
15.6.1.7 7 TeV 500 GeV 0.03 5 000 369.5 fb
15.6.1.7 7 TeV 800 GeV 0.03 5 000 26.98 fb
15.6.1.7 7 TeV 1000 GeV 0.03 5 000 6.925 fb
15.6.1.7 7 TeV 700 GeV 0.05 5 000 163.7 fb
15.6.1.7 7 TeV 1000 GeV 0.05 5 000 19.42 fb
15.6.1.7 7 TeV 1250 GeV 0.05 5 000 4.567 fb
15.6.1.7 7 TeV 1500 GeV 0.05 5 000 1.324 fb
15.6.1.7 7 TeV 800 GeV 0.1 5 000 298.2 fb
15.6.1.7 7 TeV 1000 GeV 0.1 5 000 77.34 fb
15.6.1.7 7 TeV 1250 GeV 0.1 5 000 18.38 fb
15.6.1.7 7 TeV 1500 GeV 0.1 5 000 5.288 fb

Drell-Yan

@ 10 TeV

mc08.105417.Pythia_DYee_75M120.recon.AOD.e447_s495_r635_tid078079
mc08.105418.Pythia_DYee_120M250.recon.AOD.e447_s495_r635_tid078080
mc08.105419.Pythia_DYee_250M400.recon.AOD.e447_s495_r635_tid078081
mc08.105420.Pythia_DYee_400M600.merge.AOD.e447_s495_r635_t53_tid078870
mc08.105421.Pythia_DYee_600M800.recon.AOD.e447_s495_r635_tid078083
mc08.105422.Pythia_DYee_800M1000.recon.AOD.e447_s495_r635_tid078084
mc08.105423.Pythia_DYee_1000M1250.recon.AOD.e447_s495_r635_tid078085

@ 7 TeV

mc09_7TeV.105417.Pythia_DYee_75M120.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105418.Pythia_DYee_120M250.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105419.Pythia_DYee_250M400.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105420.Pythia_DYee_400M600.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105421.Pythia_DYee_600M800.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105422.Pythia_DYee_800M1000.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105423.Pythia_DYee_1000M1250.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105424.Pythia_DYee_1250M1500.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105425.Pythia_DYee_1500M1750.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105426.Pythia_DYee_1750M2000.merge.AOD.e526_s765_s767_r1207_r1210/

TTbar

mc09_7TeV.106201.TTbar_McAtNlo_Jimmy_170GeV.merge.AOD.e522_s765_s767_r1207_r1210/

Z+Jets

mc09_7TeV.106046.PythiaZee_no_filter.merge.AOD.e468_s765_s767_r1207_r1210/

W+Jets

mc09_7TeV.106043.PythiaWenu_no_filter.merge.AOD.e468_s765_s767_r1207_r1210/

Di-Jet

mc09_7TeV.105012.J3_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105011.J2_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105009.J0_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105014.J5_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105010.J1_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105013.J4_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105015.J6_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/

Cross Sections

There is a useful site from the top group which lists the correct cross sections for many of the mc09 samples, it can be found here:

Cross-Sections

>
>
We maintain a list of Samples and all relevant information on This Page
 

How To Make a MC Production Request

Line: 125 to 30
 

Setup Area

Changed:
<
<
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 15.6.1, with the setup -tag=AtlasProduction,15.6.1.7,setup,runtime,opt,32.
>
>
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 16.0.2, with the setup -tag=16.0.2,setup,32.
 

Get joboptions files to use/modify

Line: 145 to 50
  Go to your run directory such as:
Changed:
<
<
> cd testarea/15.6.1
>
>
> cd testarea/16.0.2
 > cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/run

Changed:
<
<
You need to obtain the following four files via, although the latter most is really just an example file:
>
>
You need to obtain the following two files via, although the latter most is really just an example file:
  > get_files PDGTABLE.!MeV
Changed:
<
<
> get_files csc_genAtlfastTwoStep08_trf.py (Only for MC8)
> get_files csc_evgenTruthJetMet08_trf.py (Only for MC8)
> get_files jobOptions.pythia.py
> get_files Evgen_trf.py (Importantly for MC9)

Then you are ready to make your first sample, but first you have a choice. If you want truth, jet, and missing et information in your sample you should use:

> csc_evgenTruthJetMet08_trf.py 1 1 5000 1 MC8.000001.template.py evgen.pool.root sampleB.AOD.pool.root

However if you only need the normal information (which is all that is generally needed for validation plots, and I recommend), use:

> csc_genAtlfastTwoStep08_trf.py 1 1 5000 1 MC8.000001.template.py evgen.pool.root atlfast.AOD.pool.root genfast.NTUP.pool.root

>
>
> get_files Evgen_trf.py (Importantly for MC10)

 
Changed:
<
<
Most importantly for MC9, you should use Evgen_trf.py, you can type this with the -h command after to see what the following tags mean, but to summarise in order they are; CentreOfMassE / RunNumber (Has to match your jobOption) / Starting Event / Number of Events / Random 10 Digit Seed / JobOptions / Output Filename.
>
>
Then you are ready to make your first sample. Using Evgen_trf.py, you can type this with the -h command after to see what the following tags mean, but to summarise in order they are; CentreOfMassE / RunNumber (Has to match your jobOption) / Starting Event / Number of Events / Random 10 Digit Seed / JobOptions / Output Filename.
  In Reality if you ONLY want the Electron Container information etc without Jet Info and other things, then you only need to run the EvgenCorrAtlfast_trf.py.
Changed:
<
<
> Evgen_trf.py 7000 0700000 1 5000 1234567812 MC9.0700000.Pythia_Gee01_1000.py Output.pool.root

> EvgenCorrAtlfast_trf.py 7000 0700000 1 5000 1234567812 MC9.0700000.Pythia_Gee01_1000.py Output.pool.root AOD.pool.root ntuple.pool.root

>
>
> Evgen_trf.py 7000 0700000 1 5000 1234567812 MC10.0700000.Pythia_Gee01_1000.py Output.pool.root

> EvgenCorrAtlfast_trf.py 7000 0700000 1 5000 1234567812 MC10.0700000.Pythia_Gee01_1000.py Output.pool.root AOD.pool.root ntuple.pool.root

 
Changed:
<
<
Note here, that MC8.000001.template.py is your joboptions file, and 5000, is the number of events you are going to make in your sample. The other file names are your output. I would recommend redirecting these to your tmp directory on lxplus as they can be 100mb big or so. Just remember to send them to linappserv1 or somewhere before you next log off so they don't disappear!
>
>
Note here, that MC10.070000.template.py is your joboptions file, and 5000, is the number of events you are going to make in your sample. The other file names are your output. I would recommend redirecting these to your tmp directory on lxplus as they can be 100mb big or so. Just remember to send them to linappserv1 or somewhere before you next log off so they don't disappear!
 

Making Validation Plots & Collecting Information

The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.

Changed:
<
<
Important! When the job finishes running, you will be left with a number of log files, namely csc_evgen08.log and csc_genAtlfast.log, or EvgenCorrAtlfast_trf.log for MC09, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
>
>
Important! When the job finishes running, you will be left with a number of log files, namely EvgenCorrAtlfast_trf.log for Evgen.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
 

Finishing up

Line: 206 to 100
  First of all you have to have set up most of the above steps, i.e. you need to:
Changed:
<
<
  • Install your work area to make test samples (15.6.1).
>
>
  • Install your work area to make test samples (16.0.2).
 
  • Install an area to run over your test sample and make validation plots, i.e. Pt, Eta, and InvMass Histograms.
  • Copy this Macro to the run directory of the above.
  • Follow the steps below.

Revision 2103 Nov 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"
Changed:
<
<

------------------------------------------------ My Data Samples ------------------------------------------------

>
>

Data Samples

 

Notes

Added:
>
>
For all the Latest Samples and Cross-Sections Please go to the Page I made Here.
 The first two digits of the 6 digit code after mc08 (for example) implies the COM energy of the sample:

10 = 10 TeV

Line: 101 to 103
  Cross-Sections
Changed:
<
<

--------------------------------- How To Make a MC Production Request ---------------------------------

>
>

How To Make a MC Production Request

 

To Start & Overview

Line: 226 to 228
 
Changed:
<
<

--------------------------------------------------------- Links ---------------------------------------------------------

>
>

Links

 

Revision 2030 Sep 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 95 to 95
 mc09_7TeV.105013.J4_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105015.J6_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/
Added:
>
>

Cross Sections

There is a useful site from the top group which lists the correct cross sections for many of the mc09 samples, it can be found here:

Cross-Sections

 

--------------------------------- How To Make a MC Production Request ---------------------------------

To Start & Overview

Revision 1907 Sep 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 210 to 210
 parse_evgen_log.py
joblist.txt
Changed:
<
<
You will have to change the paths in these files (namely joblist.txt and run_one_job.sh) to match and make sense for your own setup, but the files are self explanatory and I have added comments where necessary to make it a fairly trivial process.
>
>
You will have to change the paths in these files (namely joblist.txt and run_one_job.sh) to match and make sense for your own setup, but the files are self explanatory and I have added comments where necessary to make it a fairly trivial process. Also I have named a jobOptions called MCProduction.py in the macro but have omitted it here. This file simply runs over the .root output file and outputs the histograms you require for validation (usually; Pt, Eta, and Invariant Mass) without any cuts. I have not included it here as everyones setup / needed plots will be slightly different, it is easy to make, and as different releases come out the code might change where as what I have provided should always be true.
 
Changed:
<
<
Note the final step is to put a JobOptions File into each respective folder, and then simply open a terminal, navigate to the folder and run with ./run_all.sh.
>
>
The final step is to put a JobOptions File into each respective folder, and then simply open a terminal, navigate to the folder and run with ./run_all.sh.
  The result should be that each sample folder is filled with the needed validation plots, and cross-section text file, thus simplifying and automating the whole process to the nth degree!

Revision 1805 Aug 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 208 to 208
 run_one_job.sh
run_all.sh
parse_evgen_log.py
Changed:
<
<
joblist.txt
>
>
joblist.txt
  You will have to change the paths in these files (namely joblist.txt and run_one_job.sh) to match and make sense for your own setup, but the files are self explanatory and I have added comments where necessary to make it a fairly trivial process.

Revision 1708 Apr 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 48 to 48
 
15.6.1.7 7 TeV 1250 GeV 0.1 5 000 18.38 fb
15.6.1.7 7 TeV 1500 GeV 0.1 5 000 5.288 fb
Deleted:
<
<

Z Boson

mc08.005144.PythiaZee.recon.AOD.e323_s400_d99_r474_tid023534

 

Drell-Yan

Added:
>
>

@ 10 TeV

 mc08.105417.Pythia_DYee_75M120.recon.AOD.e447_s495_r635_tid078079
mc08.105418.Pythia_DYee_120M250.recon.AOD.e447_s495_r635_tid078080
mc08.105419.Pythia_DYee_250M400.recon.AOD.e447_s495_r635_tid078081
Line: 63 to 60
 mc08.105422.Pythia_DYee_800M1000.recon.AOD.e447_s495_r635_tid078084
mc08.105423.Pythia_DYee_1000M1250.recon.AOD.e447_s495_r635_tid078085
Added:
>
>

@ 7 TeV

mc09_7TeV.105417.Pythia_DYee_75M120.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105418.Pythia_DYee_120M250.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105419.Pythia_DYee_250M400.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105420.Pythia_DYee_400M600.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105421.Pythia_DYee_600M800.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105422.Pythia_DYee_800M1000.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105423.Pythia_DYee_1000M1250.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105424.Pythia_DYee_1250M1500.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105425.Pythia_DYee_1500M1750.merge.AOD.e526_s765_s767_r1207_r1210/ mc09_7TeV.105426.Pythia_DYee_1750M2000.merge.AOD.e526_s765_s767_r1207_r1210/

TTbar

mc09_7TeV.106201.TTbar_McAtNlo_Jimmy_170GeV.merge.AOD.e522_s765_s767_r1207_r1210/

Z+Jets

mc09_7TeV.106046.PythiaZee_no_filter.merge.AOD.e468_s765_s767_r1207_r1210/

W+Jets

mc09_7TeV.106043.PythiaWenu_no_filter.merge.AOD.e468_s765_s767_r1207_r1210/

Di-Jet

mc09_7TeV.105012.J3_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105011.J2_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105009.J0_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105014.J5_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105010.J1_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105013.J4_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/ mc09_7TeV.105015.J6_pythia_jetjet.merge.AOD.e468_s766_s767_r1206_r1210/

 

--------------------------------- How To Make a MC Production Request ---------------------------------

To Start & Overview

Revision 1624 Mar 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Revision 1510 Mar 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 18 to 18
 

Graviton

Added:
>
>

@ 10 TeV

 mc08.105616.Pythia_Gee_300.recon.AOD.e355_s462_r541
Changed:
<
<
mc09_10TeV.105586.Pythia_Gee_001_500.evgen.e488
mc09_10TeV.105587.Pythia_Gee_001_1000.evgen.e488
mc09_10TeV.105588.Pythia_Gee_010_1000.evgen.e488
>
>
Release E CM G* Mass k/Mpl N Evts xsec x BR
14.1.0 10 TeV 300 GeV 0.01 5 000 834 fb
14.1.0 10 TeV 500 GeV 0.01 5 000 79 fb
14.1.0 10 TeV 750 GeV 0.05 5 000 257 fb
14.1.0 10 TeV 1000 GeV 0.05 5 000 54.4 fb
14.1.0 10 TeV 1400 GeV 0.05 5 000 7.7 fb

@ 7 TeV

Release E CM G* Mass k/Mpl N Evts xsec x BR
15.6.1.7 7 TeV 300 GeV 0.01 5 000 521.6 fb
15.6.1.7 7 TeV 500 GeV 0.01 5 000 40.46 fb
15.6.1.7 7 TeV 800 GeV 0.01 5 000 2.996 fb
15.6.1.7 7 TeV 1000 GeV 0.01 5 000 0.7839 fb
15.6.1.7 7 TeV 500 GeV 0.03 5 000 369.5 fb
15.6.1.7 7 TeV 800 GeV 0.03 5 000 26.98 fb
15.6.1.7 7 TeV 1000 GeV 0.03 5 000 6.925 fb
15.6.1.7 7 TeV 700 GeV 0.05 5 000 163.7 fb
15.6.1.7 7 TeV 1000 GeV 0.05 5 000 19.42 fb
15.6.1.7 7 TeV 1250 GeV 0.05 5 000 4.567 fb
15.6.1.7 7 TeV 1500 GeV 0.05 5 000 1.324 fb
15.6.1.7 7 TeV 800 GeV 0.1 5 000 298.2 fb
15.6.1.7 7 TeV 1000 GeV 0.1 5 000 77.34 fb
15.6.1.7 7 TeV 1250 GeV 0.1 5 000 18.38 fb
15.6.1.7 7 TeV 1500 GeV 0.1 5 000 5.288 fb
 

Z Boson

Revision 1410 Mar 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 166 to 166
 
Added:
>
>

 

Revision 1301 Mar 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 174 to 174
 
Added:
>
>
 

Revision 1226 Feb 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

------------------------------------------------ My Data Samples ------------------------------------------------

Line: 134 to 134
  Now all that's left to do is send all of this information, along with the joboptions file(s), and a link to the Twiki page along to your MC Production representative, and everything should be taken out of your hands from there!
Added:
>
>

Automated Process

First of all I want to thank Peter Waller for his coding expertise which enabled me to realise this Process. I was faced with having to do all of the above, for 15 samples, and I thought there must be a simpler way of doing things, which led me to come up with this idea.

First of all you have to have set up most of the above steps, i.e. you need to:

  • Install your work area to make test samples (15.6.1).
  • Install an area to run over your test sample and make validation plots, i.e. Pt, Eta, and InvMass Histograms.
  • Copy this Macro to the run directory of the above.
  • Follow the steps below.

Now you will need to make a folder (I put it on my Desktop) and inside the folder do two things; Make a folder for every sample (Named Accordingly), and download the files below into the main folder.

run_one_job.sh
run_all.sh
parse_evgen_log.py
joblist.txt

You will have to change the paths in these files (namely joblist.txt and run_one_job.sh) to match and make sense for your own setup, but the files are self explanatory and I have added comments where necessary to make it a fairly trivial process.

Note the final step is to put a JobOptions File into each respective folder, and then simply open a terminal, navigate to the folder and run with ./run_all.sh.

The result should be that each sample folder is filled with the needed validation plots, and cross-section text file, thus simplifying and automating the whole process to the nth degree!

 

--------------------------------------------------------- Links ---------------------------------------------------------

Line: 151 to 178
  -->
Added:
>
>
META FILEATTACHMENT attachment="run_all.sh" attr="h" comment="" date="1267188942" name="run_all.sh" path="run_all.sh" size="51" stream="run_all.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="run_one_job.sh" attr="h" comment="" date="1267189001" name="run_one_job.sh" path="run_one_job.sh" size="1922" stream="run_one_job.sh" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="parse_evgen_log.py.txt" attr="h" comment="" date="1267189014" name="parse_evgen_log.py.txt" path="parse_evgen_log.py" size="709" stream="parse_evgen_log.py" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="job_list.txt" attr="h" comment="" date="1267189030" name="job_list.txt" path="job_list.txt" size="2217" stream="job_list.txt" user="Public.DanielHayden" version="1"
META FILEATTACHMENT attachment="ValidationPlots.C" attr="h" comment="" date="1267189084" name="ValidationPlots.C" path="ValidationPlots.C" size="589" stream="ValidationPlots.C" user="Public.DanielHayden" version="1"

Revision 1125 Feb 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"
Changed:
<
<

My Data Samples

>
>

------------------------------------------------ My Data Samples ------------------------------------------------

 
Line: 37 to 37
 mc08.105422.Pythia_DYee_800M1000.recon.AOD.e447_s495_r635_tid078084
mc08.105423.Pythia_DYee_1000M1250.recon.AOD.e447_s495_r635_tid078085
Changed:
<
<

How To Make a MC Production Request

>
>

--------------------------------- How To Make a MC Production Request ---------------------------------

 

To Start & Overview

Line: 111 to 111
  The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.
Changed:
<
<
Important! When the job finishes running, you will be left with a number of log files, namely csc_evgen08.log and csc_genAtlfast.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
>
>
Important! When the job finishes running, you will be left with a number of log files, namely csc_evgen08.log and csc_genAtlfast.log, or EvgenCorrAtlfast_trf.log for MC09, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
 

Finishing up

Line: 135 to 135
 Now all that's left to do is send all of this information, along with the joboptions file(s), and a link to the Twiki page along to your MC Production representative, and everything should be taken out of your hands from there!
Changed:
<
<

Links

>
>

--------------------------------------------------------- Links ---------------------------------------------------------

 

Revision 1023 Feb 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Line: 59 to 59
 

Setup Area

Changed:
<
<
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 15.6.1, with the setup -tag=AtlasProduction,15.6.1,setup,32.
>
>
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 15.6.1, with the setup -tag=AtlasProduction,15.6.1.7,setup,runtime,opt,32.
 

Get joboptions files to use/modify

Line: 100 to 100
  Most importantly for MC9, you should use Evgen_trf.py, you can type this with the -h command after to see what the following tags mean, but to summarise in order they are; CentreOfMassE / RunNumber (Has to match your jobOption) / Starting Event / Number of Events / Random 10 Digit Seed / JobOptions / Output Filename.
Added:
>
>
In Reality if you ONLY want the Electron Container information etcwithout Jet Info and other things, then you only need to run the EvgenCorrAtlfast_trf.py.
 > Evgen_trf.py 7000 0700000 1 5000 1234567812 MC9.0700000.Pythia_Gee01_1000.py Output.pool.root

Added:
>
>
> EvgenCorrAtlfast_trf.py 7000 0700000 1 5000 1234567812 MC9.0700000.Pythia_Gee01_1000.py Output.pool.root AOD.pool.root ntuple.pool.root

  Note here, that MC8.000001.template.py is your joboptions file, and 5000, is the number of events you are going to make in your sample. The other file names are your output. I would recommend redirecting these to your tmp directory on lxplus as they can be 100mb big or so. Just remember to send them to linappserv1 or somewhere before you next log off so they don't disappear!

Revision 918 Feb 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Line: 59 to 59
 

Setup Area

Changed:
<
<
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page.
>
>
First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page. I am writing here assuming the use of 15.6.1, with the setup -tag=AtlasProduction,15.6.1,setup,32.
 

Get joboptions files to use/modify

Line: 67 to 67
  http://alxr.usatlas.bnl.gov/lxr/source/atlas/Generators/EvgenJobOptions/share/
Added:
>
>
Or more importantly for MC9 now, here:

https://svnweb.cern.ch/trac/atlasoff/browser/Generators/MC09JobOptions/trunk/share

 All I did, was find the Particle and Decay I was interested in, take the joboptions file, and modify it for my own needs. Most of the time this just involves changing the Mass or some Coupling, that is well documented in the joboptions file itself. If you want to do something more drastic however, like make a new sample that has not even been roughly coded before, then I have not done this, but I would suggest you start by looking at multiple joboptions files, such as if you wanted to simulate G->ee and G->mumu, where currently there are only seperate files that do this; Take the two seperate files, and copy the lines which correspond to the decaying of each process into a new file, start building your joboptions that way, and after testing with a well known joboptions to see what you would expect, test yours and see if it makes sense.

Making a Test Sample

Line: 75 to 79
  Go to your run directory such as:
Changed:
<
<
> cd testarea/15.3.0
>
>
> cd testarea/15.6.1
 > cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/run

You need to obtain the following four files via, although the latter most is really just an example file:

> get_files PDGTABLE.!MeV

Changed:
<
<
> get_files csc_genAtlfastTwoStep08_trf.py
> get_files csc_evgenTruthJetMet08_trf.py
> get_files jobOptions.pythia.py

>
>
> get_files csc_genAtlfastTwoStep08_trf.py (Only for MC8)
> get_files csc_evgenTruthJetMet08_trf.py (Only for MC8)
> get_files jobOptions.pythia.py
> get_files Evgen_trf.py (Importantly for MC9)

 
Changed:
<
<
Then you are ready to make your first sample, how first you have a choice. If you want truth, jet, and missing et information in your sample you should use:
>
>
Then you are ready to make your first sample, but first you have a choice. If you want truth, jet, and missing et information in your sample you should use:
  > csc_evgenTruthJetMet08_trf.py 1 1 5000 1 MC8.000001.template.py evgen.pool.root sampleB.AOD.pool.root

Line: 93 to 98
  > csc_genAtlfastTwoStep08_trf.py 1 1 5000 1 MC8.000001.template.py evgen.pool.root atlfast.AOD.pool.root genfast.NTUP.pool.root

Added:
>
>
Most importantly for MC9, you should use Evgen_trf.py, you can type this with the -h command after to see what the following tags mean, but to summarise in order they are; CentreOfMassE / RunNumber (Has to match your jobOption) / Starting Event / Number of Events / Random 10 Digit Seed / JobOptions / Output Filename.

> Evgen_trf.py 7000 0700000 1 5000 1234567812 MC9.0700000.Pythia_Gee01_1000.py Output.pool.root

 Note here, that MC8.000001.template.py is your joboptions file, and 5000, is the number of events you are going to make in your sample. The other file names are your output. I would recommend redirecting these to your tmp directory on lxplus as they can be 100mb big or so. Just remember to send them to linappserv1 or somewhere before you next log off so they don't disappear!

Making Validation Plots & Collecting Information

The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.

Changed:
<
<
Important! When the job finishes running, you will be left with a number of log files, namely csc_evgen08.log and csc_genAtlfast.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
>
>
Important! When the job finishes running, you will be left with a number of log files, namely csc_evgen08.log and csc_genAtlfast.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.
 

Finishing up

Revision 824 Jan 2010 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Changed:
<
<

Notes

>
>

Notes

  The first two digits of the 6 digit code after mc08 (for example) implies the COM energy of the sample:

10 = 10 TeV 00 = 14 TeV

Changed:
<
<

Z'

>
>

Z'

  mc08.105603.Pythia_Zprime_ee_SSM1000.recon.AOD.e352_s462_r541
mc08.105624.Pythia_Zprime_ee_SSM1500.recon.AOD.e357_s462_r541
Changed:
<
<

Graviton

>
>

Graviton

 
Changed:
<
<
mc08.105616.Pythia_Gee_300.recon.AOD.e355_s462_r541
>
>
mc08.105616.Pythia_Gee_300.recon.AOD.e355_s462_r541
mc09_10TeV.105586.Pythia_Gee_001_500.evgen.e488
mc09_10TeV.105587.Pythia_Gee_001_1000.evgen.e488
mc09_10TeV.105588.Pythia_Gee_010_1000.evgen.e488
 
Changed:
<
<

Z Boson

>
>

Z Boson

  mc08.005144.PythiaZee.recon.AOD.e323_s400_d99_r474_tid023534
Changed:
<
<

Drell-Yan

>
>

Drell-Yan

  mc08.105417.Pythia_DYee_75M120.recon.AOD.e447_s495_r635_tid078079
mc08.105418.Pythia_DYee_120M250.recon.AOD.e447_s495_r635_tid078080

Revision 706 Nov 2009 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"
Changed:
<
<

My Data Samples

>
>

My Data Samples

 
Line: 34 to 34
 mc08.105422.Pythia_DYee_800M1000.recon.AOD.e447_s495_r635_tid078084
mc08.105423.Pythia_DYee_1000M1250.recon.AOD.e447_s495_r635_tid078085
Added:
>
>

How To Make a MC Production Request

To Start & Overview

This might vary slightly depending what group you are in. But having gone through the process now, I think a guide would be very useful, hope it helps!

On your groups home Twiki page, there should be a page dedicated to how to make Monte Carlo requests, but in general you can go to the Monte Carlo Working Group page, where they list the relevant contacts for every group:

https://twiki.cern.ch/twiki/bin/view/AtlasProtected/AtlasMcProduction

The General List of Pre-requisites for a MC Production Request are:

Note, before any of the below steps, you should contact your group convenors, and the MC Production Contact for your group, to let them know of your intentions, and ask if it would be okay to go ahead and start making the request.

  • Provide a joboptions file
  • Provide relevant cross-sections, evgen efficiencies, and number of events requested, along with centre of mass energy, and code version you are setup in, also the event generator version you are using.
  • Make Validation Plots, from a small sample you make with your joboptions file. I.e. Provide relevant plots that show the joboptions file produces what you would expect.
  • Put the Joboptions files, Validation plots, and all information so far on your groups relevant "Validation Plot" page under the process for which you are asking for samples, if there isn't one, create a new twiki page that is for your process.
  • Contact your groups Monte Carlo Production Contact, sending them the link to the Twiki page, along with the joboptions files attached to the e-mail, and all the information so far requested (even though it is already on the Twiki). They will take the request from here, and let you know the outcome.

Setup Area

First of all, you need to setup your work area, this is best done on lxplus. Make your cmthome area and download a package to work in such as UserAnalysis. This is explained how to do so on the coding tips and tricks page.

Get joboptions files to use/modify

You can find the joboptions files for all of the Official Monte Carlo Samples here:

http://alxr.usatlas.bnl.gov/lxr/source/atlas/Generators/EvgenJobOptions/share/

All I did, was find the Particle and Decay I was interested in, take the joboptions file, and modify it for my own needs. Most of the time this just involves changing the Mass or some Coupling, that is well documented in the joboptions file itself. If you want to do something more drastic however, like make a new sample that has not even been roughly coded before, then I have not done this, but I would suggest you start by looking at multiple joboptions files, such as if you wanted to simulate G->ee and G->mumu, where currently there are only seperate files that do this; Take the two seperate files, and copy the lines which correspond to the decaying of each process into a new file, start building your joboptions that way, and after testing with a well known joboptions to see what you would expect, test yours and see if it makes sense.

Making a Test Sample

Once you have your area setup, sourced, and have made your joboptions file:

Go to your run directory such as:

> cd testarea/15.3.0
> cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/run

You need to obtain the following four files via, although the latter most is really just an example file:

> get_files PDGTABLE.!MeV
> get_files csc_genAtlfastTwoStep08_trf.py
> get_files csc_evgenTruthJetMet08_trf.py
> get_files jobOptions.pythia.py

Then you are ready to make your first sample, how first you have a choice. If you want truth, jet, and missing et information in your sample you should use:

> csc_evgenTruthJetMet08_trf.py 1 1 5000 1 MC8.000001.template.py evgen.pool.root sampleB.AOD.pool.root

However if you only need the normal information (which is all that is generally needed for validation plots, and I recommend), use:

> csc_genAtlfastTwoStep08_trf.py 1 1 5000 1 MC8.000001.template.py evgen.pool.root atlfast.AOD.pool.root genfast.NTUP.pool.root

Note here, that MC8.000001.template.py is your joboptions file, and 5000, is the number of events you are going to make in your sample. The other file names are your output. I would recommend redirecting these to your tmp directory on lxplus as they can be 100mb big or so. Just remember to send them to linappserv1 or somewhere before you next log off so they don't disappear!

Making Validation Plots & Collecting Information

The next step is to take one of your no doubt already existing analysis programs, and strip it down so all it does it create plots of basic things like the, et spectrum, eta spectrum, and invariant mass, as an example. Apply no cuts, as you just want to see what the sample looks like. Save these plots, and include them with all the other information that you will eventually upload.

Important! When the job finishes running, you will be left with a number of log files, namely csc_evgen08.log and csc_genAtlfast.log, you will want to keep these files as they contain all of your cross section information!!! Also remember to take note of the event generator efficiency, which is usually set to about 0.90, and can be found on the last line of your joboptions file usually. You will also want to look through them to see exactly what version of Pythia you are using, if you haven't taken note of it before now.

Finishing up

Now you have all your relevant information, go to the Validation Plot Twiki Page, and upload all of your information, this looks best in a table, you can just do what I did and look at a previous request, and take their format. The basic format you want though would be something like this:

Validation

Joboption for generation under Pythia 6.420 :
MC8.0000001.Pythia_Gee001_500.py
MC8.0000001.Pythia_Gee001_1000.py
MC8.0000001.Pythia_Gee01_1000.py

Release E CM G* Mass k/Mpl N Evts xsec x BR Validation plots
15.2.0 10 TeV 500 GeV 0.01 5 000 79.5 fb Electron pt, electron eta, G Mass
15.2.0 10 TeV 1000 GeV 0.01 5 000 2.17 fb Electron pt, electron eta, G Mass
15.2.0 10 TeV 1000 GeV 0.1 5 000 214.2 fb Electron pt, electron eta, G Mass

Generator Efficiency = 0.90

Now all that's left to do is send all of this information, along with the joboptions file(s), and a link to the Twiki page along to your MC Production representative, and everything should be taken out of your hands from there!

 

Links

Revision 616 Oct 2009 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Line: 26 to 26
 

Drell-Yan

Changed:
<
<
mc08.105121.PythiaDYee_200M.recon.AOD.e355_s462_r541
>
>
mc08.105417.Pythia_DYee_75M120.recon.AOD.e447_s495_r635_tid078079
mc08.105418.Pythia_DYee_120M250.recon.AOD.e447_s495_r635_tid078080
mc08.105419.Pythia_DYee_250M400.recon.AOD.e447_s495_r635_tid078081
mc08.105420.Pythia_DYee_400M600.merge.AOD.e447_s495_r635_t53_tid078870
mc08.105421.Pythia_DYee_600M800.recon.AOD.e447_s495_r635_tid078083
mc08.105422.Pythia_DYee_800M1000.recon.AOD.e447_s495_r635_tid078084
mc08.105423.Pythia_DYee_1000M1250.recon.AOD.e447_s495_r635_tid078085
 

Links

Revision 515 Oct 2009 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Line: 38 to 38
 
Added:
>
>
 

Revision 418 Aug 2009 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Line: 18 to 18
 

Graviton

Changed:
<
<
Graviton: mc08.105616.Pythia_Gee_300.recon.AOD.e355_s462_r541
>
>
mc08.105616.Pythia_Gee_300.recon.AOD.e355_s462_r541
 

Z Boson

Changed:
<
<
Z Boson: mc08.005144.PythiaZee.recon.AOD.e323_s400_d99_r474_tid023534
>
>
mc08.005144.PythiaZee.recon.AOD.e323_s400_d99_r474_tid023534

Drell-Yan

mc08.105121.PythiaDYee_200M.recon.AOD.e355_s462_r541

 

Links

Revision 322 Jul 2009 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Line: 33 to 33
 

\ No newline at end of file
Added:
>
>
<--

Settings just to customise this page

-->
 \ No newline at end of file

Revision 221 Jul 2009 - DanielHayden

Line: 1 to 1
 
META TOPICPARENT name="DanielHayden"

My Data Samples

Line: 30 to 30
 
Changed:
<
<
>
>
 

Revision 107 Jul 2009 - DanielHayden

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="DanielHayden"

My Data Samples

Notes

The first two digits of the 6 digit code after mc08 (for example) implies the COM energy of the sample:

10 = 10 TeV 00 = 14 TeV

Z'

mc08.105603.Pythia_Zprime_ee_SSM1000.recon.AOD.e352_s462_r541
mc08.105624.Pythia_Zprime_ee_SSM1500.recon.AOD.e357_s462_r541

Graviton

Graviton: mc08.105616.Pythia_Gee_300.recon.AOD.e355_s462_r541

Z Boson

Z Boson: mc08.005144.PythiaZee.recon.AOD.e323_s400_d99_r474_tid023534

Links

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding RHUL Physics Department TWiki? Send feedback