php - Optimizing array merge operation -

-

I appreciate any help.

I have approximately 7 different arrays. I have 90,000 numbers in each array (we call them arrays1-arrays7). There is no duplicate number within each array, but duplicates between arrays can be duplicated. For example, array 2 does not have any duplicates, but with arrays3 and arrays4 it is possible in the same number.

Problem: I'm trying to identify duplicated numbers of all 7 arrows once in a merging class.

I want to make this calculation 1000 times and it takes 15 minutes but that's not okay because I have to run it 40 times - Code:

If you have any other language I know this is most suitable for calculation of this type. Please tell me some extension suggestions like redis or gearman are useful. For 

  ($ kj = 1; $ kj & lt; = 1000; $ kj ++) {$ result = array_merge ($ files_array1, $ files_array2, $ files_array3, $ files_array4, $ Files_array5, $ files_array6, $ files_array7); $ Result = array_count_values ​​($ result); $ Fp_lines = fopen ("equalTo3.txt", "w"); Forex Currency ($ $ $ Key => $ val) {If ($ result [$ key] == 3) {Fit ($ fp_lines, $ key) "\ r \ n"); }} Fclose ($ fp_lines); }

I have tried the code below with the strings but arr_map call and array_count value call for 17 minutes: 

 for  ($ kj = 1; $ Kj & lt; = 1000; $ kj ++) {$ Result = ''; For ($ ii = 0; $ ii & lt; 7; $ ii ++) {$ Result = $ Files_array [$ hello_won [$ ii]]. '\ R \ n'; } $ Result2 = Explosion ("\ n", $ result); // 5mins $ result2 = array_map ("trim", $ result2); // 11mins $ result2 = array_count_values ​​($ result2); // 4-6mins $ fp_lines = FOPN ("BarBarTO3WT", "W"); Forex currency ($ key as $ result2 & gt; $ val) {if ($ result2 [$ key] == 3) {FILIT ($ fp_lines, $ key. "\ R \ n"); }} Fclose ($ fp_lines); Not set ($ result2);

/////////////////////////////////////// ////////////

@jymin @ Change @scunalaffe @ this.lau_ @monocell Thanks to everyone and for any other person posting !! I am working through all your suggestions and work through all the replies after yesterday's reply. Thanks a lot!

array_arug () is much slower with more elements because in the array ( From:)

If the input arrays have the same string key, the subsequent values ​​for that key will overwrite the previous one, however, if there are numeric keys in the arrays, then the later Values ​​will not overwrite the original value, but will be added.

In the input array with the numeric key, the result array with the values ​​starting from zero.

Then this function is actually making some conditional statement that you can change the merge of the array with the addition of normal, loop (foreach or any other) and [] < / Code> operator. You can write functions by copying array_merge (such as using the reference not to copy the array.): 

  function imitateMerge (& $ array1, & $ array2) { Foreach ($ array2 as $ I) {$ array1 [] = $ i; }}

And you will actually see an increase in the speed of the speed.


Comments

Post a Comment

Popular posts from this blog

import - Python ImportError: No module named wmi -

-
I followed the instructions for downloading WMI for Python When I try to run the code for C.Win32_Service (StartMode = "Auto", state = "Stopped") import wmi c = wmi.WMI (): if Raw_input ("restart% s?"% S.Caption) .upper () == "Y": s.StartService () I got the error < Code> traceback (most recent call end): file ". \", Line 1, edit: I am using Python 2.7.6 EDIT2: I am running 64-bit Windows 2008 R2, and I've downloaded WMI-1.4.9.zip (md5). I removed the content and put it in D: Python \ Tools \ Scripts I executed dragon setup.py.install I said D : \ Python \ tools \ scripts to% PATH% and when I execute the code for C.Win32_Service (StartMode = "Auto", state = "Stopped") import wmi c = Wmi.WMI (): If raw_input ("Restart% s?"% S. Caption). () == "Y": s.StartService () error me Gets traceback (most recent call final): File ". See \", line 1, &
Read more

Editing Python Class in Shell and SQLAlchemy -

-
I am working on the terminal on a shell script after this tutorial SQLAlchemy tutorial. I need to type gt; & Gt; & Gt; Sqlalchemy import column, integer, string & gt; & Gt; & Gt; Class user (base): __tablename__ = 'users' id = column (integer, primary_key = true) name = column (string) absolute name = column (string) password = column (string) def __repr __ (self): return "& lt ; User (name = '% s', absolute name = '% s', password = '% s') & gt; "% (Self.name, self.fullname, self.password) After the problem I have typed the password = column (string) I hit twice and changed .... >> I then took everything back but then an error was thrown because the class already exists ... I am not completely sure how to fix it. How do I open that slip in the shell script and edit it (Add DF to DRR) The error thrown below: / user / giripeters / TFSQLLX / Lib / python2.7 / site-packages / sqlalchemy / ext / decla
Read more

c# - MySQL Parameterized Select Query joining tables issue -

-
I am using parameterized select questions in conjunction with my program and it works entirely, When I try to join the table Everything I have done is a small fraction: using (MySqlCommand cmd = new MySqlCommand (paramQuery) ToSql (), Connection)) /etc/ paramQuery.ToSql () Equal: "Select TableOne ID, Tableon, Department, Tablet. One by name table, Table 2 h Yes TableOnEID = @Pharmak "* / for (Int Index = 0; Index and Lt; ParamariX Parameter (.c calculation; Index ++) Cmd.Parameters.AddWithValue (paramQuery.Parameters (). ElementAt (index). , ParamQuery.Parameters (). ElementAt (index) .Value); / * ParamQuery.Parameters (). ElementAt (index) .k = "@most 0" paramQuery.Parameters (). ElementAt (index) .Value = "tableTwo.ID" * / MySqlDataReader Reader = cmd.ExecuteReader (); While (reader.Read ()) {// do stuff} } One of the tables I attempt to join is For the table, two with the same id for all. Is there something that I'm doing wrong?
Read more