python multiprocessing with map_sync - catching problems -

-

I am trying to use a multiprocessing package in Python.

I have a code that is designed to generate output based on the collection processes that have many processors ... 

  years = [2013] days = [1,2,3,4,5,6,7,8,9, 10] months = [8] hours = [0, 6, 12, 18] ens = [1, 2, 3, 4] nuns = Lane (days) * lane (hours) hours = hours * lane (days) year = days * days (days) * lane (hours) month = months * lane (days) * lane (hours) temporarily = [days] D: temp.append ([d] * lane (hour)) = [x in the sublist for x in the sublist for hours] hour = hour * lane (d N) nens = ens * len (day)

In this example I have 260 times that are near different processors.

t1 = c [:]. Map_sync (doCoolStuff, year, month, day, hour, nanus, [option] * lane (day))

There are times when there is a missing / incomplete data When this happens, then kills all the processes on other nodes. Is there any way to catch these examples? I'm not sure / works here except for try.

Thanks

I can think of two options here To make sure that the doCoolStuff function never throws an exception, and does not return any or nothing in return, which indicates the error, the second option is to use the iPad instead of the map_sync, and at once the iterator In addition to an element, block / try inside. 

  it = c [:] Imap (doCoolStuff (option) * lane (day)) t1 = [] while true: try: t1.append (it.next () except for StopIteration: Except exception: E: Print "Exception caught:% s "% E"

This approach works with the multiprocessing module, and it seems that the IPathon is equal to (), so it should also work for it.

Edit: If you go with the first option, exception (none, [], or any other value, where bool value) == incorrect ) From your final list like this: 

  t1 = filter (none, c [:]. Map_sync (doCoolStuff, year, ...))

Comments

Post a Comment

Popular posts from this blog

import - Python ImportError: No module named wmi -

-
I followed the instructions for downloading WMI for Python When I try to run the code for C.Win32_Service (StartMode = "Auto", state = "Stopped") import wmi c = wmi.WMI (): if Raw_input ("restart% s?"% S.Caption) .upper () == "Y": s.StartService () I got the error < Code> traceback (most recent call end): file ". \", Line 1, edit: I am using Python 2.7.6 EDIT2: I am running 64-bit Windows 2008 R2, and I've downloaded WMI-1.4.9.zip (md5). I removed the content and put it in D: Python \ Tools \ Scripts I executed dragon setup.py.install I said D : \ Python \ tools \ scripts to% PATH% and when I execute the code for C.Win32_Service (StartMode = "Auto", state = "Stopped") import wmi c = Wmi.WMI (): If raw_input ("Restart% s?"% S. Caption). () == "Y": s.StartService () error me Gets traceback (most recent call final): File ". See \", line 1, &
Read more

Editing Python Class in Shell and SQLAlchemy -

-
I am working on the terminal on a shell script after this tutorial SQLAlchemy tutorial. I need to type gt; & Gt; & Gt; Sqlalchemy import column, integer, string & gt; & Gt; & Gt; Class user (base): __tablename__ = 'users' id = column (integer, primary_key = true) name = column (string) absolute name = column (string) password = column (string) def __repr __ (self): return "& lt ; User (name = '% s', absolute name = '% s', password = '% s') & gt; "% (Self.name, self.fullname, self.password) After the problem I have typed the password = column (string) I hit twice and changed .... >> I then took everything back but then an error was thrown because the class already exists ... I am not completely sure how to fix it. How do I open that slip in the shell script and edit it (Add DF to DRR) The error thrown below: / user / giripeters / TFSQLLX / Lib / python2.7 / site-packages / sqlalchemy / ext / decla
Read more

c# - MySQL Parameterized Select Query joining tables issue -

-
I am using parameterized select questions in conjunction with my program and it works entirely, When I try to join the table Everything I have done is a small fraction: using (MySqlCommand cmd = new MySqlCommand (paramQuery) ToSql (), Connection)) /etc/ paramQuery.ToSql () Equal: "Select TableOne ID, Tableon, Department, Tablet. One by name table, Table 2 h Yes TableOnEID = @Pharmak "* / for (Int Index = 0; Index and Lt; ParamariX Parameter (.c calculation; Index ++) Cmd.Parameters.AddWithValue (paramQuery.Parameters (). ElementAt (index). , ParamQuery.Parameters (). ElementAt (index) .Value); / * ParamQuery.Parameters (). ElementAt (index) .k = "@most 0" paramQuery.Parameters (). ElementAt (index) .Value = "tableTwo.ID" * / MySqlDataReader Reader = cmd.ExecuteReader (); While (reader.Read ()) {// do stuff} } One of the tables I attempt to join is For the table, two with the same id for all. Is there something that I'm doing wrong?
Read more