powershell - Zip high volume of folders & files -

-

I have a big problem with the backup of a stock, with a large volume (10 000 000 +) small files where Until I know that the total megabytes of those files are not so big, but the biggest problem is the number of files. First things first: - The shares are more or less "regular", therefore the root directory containing 30 directories, all those 1 level directories, have a subfolder with a date in the format: yyMMdd.

I have created some PowerShell scripts to zip those directories based on their names, so, now, I am running backup only on .zip files, but ...

I have noticed that the time of running the script is increasing daily (because this script still needs to check all the folders) and the number of folders is increasing every day

My question is : Is there anyone - let's say - marker it Number used as: - When the script to leave before storing folders in moving and add directory archival mark today Folder, "previously stored as" running the next script.

This will give me more or less scripts runtime everyday, because this "check and amp; collection" will be more or less, the only amount of directories that are not already stored.

Can someone give advice? Any remedy? I'm just following the options.

The script is not very simplified: 

  $ zip = "C: \ apps \ 7-zip \ 7z.exe" $ days_behind = -1 $ folder_data = ( Received-date). Addition ($ day_church) .string ("yyMMdd") $ store = "X: \ SHARE_ARCH \ Archive_ $ folder_data.zip" $ to_zip = (gc x: \ SHARE_ROOT ($ Folder_data)}). Full name $ option = "a", "-tzip", "-y", $ archive, $ to_zip; $ Zip option $;

I think this problem is most problematic:

$ to_zip = (GC X: \ SHARE_ROOT -Recurse | | {$ .PSIsContainer} {? <$ .name- included ($ folder_data)}). FullName

OK, if you have PSV 3 or more, then you $ _ PSIsContainer- and and instead can add -Directory to the GCI command, which can help speed it up by filtering at the provider level instead of later

< P> This will prevent it from remembering everything and just drag all the folders into the root folder, and check to see if it has a subfolder with the desired name. These things should be sharpened. 

  $ zip = "C: \ apps \ 7-zip \ 7z.exe" $ days_behind = -1 $ folder_data = (received-date). Aaday ($ days_behind) .string ("yyMMdd") $ store = "X: \ SHARE_ARCH \ Archive_ $ folder_data.zip" $ to_zip = gci X: \ SHARE_ROOT | ? {$ _. PSIsContainer- and (test path "$ _ \ $ folder_data")} | Select Full Name $ option = "a", "-tzip", "-y", $ archive, $ to_zip & amp; $ Zip $ option

I also removed the bracket and instead used a selection-expand command. I do not know that this will actually change any speed, but in general this is cleaner.


Comments

Post a Comment

Popular posts from this blog

import - Python ImportError: No module named wmi -

-
I followed the instructions for downloading WMI for Python When I try to run the code for C.Win32_Service (StartMode = "Auto", state = "Stopped") import wmi c = wmi.WMI (): if Raw_input ("restart% s?"% S.Caption) .upper () == "Y": s.StartService () I got the error < Code> traceback (most recent call end): file ". \", Line 1, edit: I am using Python 2.7.6 EDIT2: I am running 64-bit Windows 2008 R2, and I've downloaded WMI-1.4.9.zip (md5). I removed the content and put it in D: Python \ Tools \ Scripts I executed dragon setup.py.install I said D : \ Python \ tools \ scripts to% PATH% and when I execute the code for C.Win32_Service (StartMode = "Auto", state = "Stopped") import wmi c = Wmi.WMI (): If raw_input ("Restart% s?"% S. Caption). () == "Y": s.StartService () error me Gets traceback (most recent call final): File ". See \", line 1, &
Read more

Editing Python Class in Shell and SQLAlchemy -

-
I am working on the terminal on a shell script after this tutorial SQLAlchemy tutorial. I need to type gt; & Gt; & Gt; Sqlalchemy import column, integer, string & gt; & Gt; & Gt; Class user (base): __tablename__ = 'users' id = column (integer, primary_key = true) name = column (string) absolute name = column (string) password = column (string) def __repr __ (self): return "& lt ; User (name = '% s', absolute name = '% s', password = '% s') & gt; "% (Self.name, self.fullname, self.password) After the problem I have typed the password = column (string) I hit twice and changed .... >> I then took everything back but then an error was thrown because the class already exists ... I am not completely sure how to fix it. How do I open that slip in the shell script and edit it (Add DF to DRR) The error thrown below: / user / giripeters / TFSQLLX / Lib / python2.7 / site-packages / sqlalchemy / ext / decla
Read more

c# - MySQL Parameterized Select Query joining tables issue -

-
I am using parameterized select questions in conjunction with my program and it works entirely, When I try to join the table Everything I have done is a small fraction: using (MySqlCommand cmd = new MySqlCommand (paramQuery) ToSql (), Connection)) /etc/ paramQuery.ToSql () Equal: "Select TableOne ID, Tableon, Department, Tablet. One by name table, Table 2 h Yes TableOnEID = @Pharmak "* / for (Int Index = 0; Index and Lt; ParamariX Parameter (.c calculation; Index ++) Cmd.Parameters.AddWithValue (paramQuery.Parameters (). ElementAt (index). , ParamQuery.Parameters (). ElementAt (index) .Value); / * ParamQuery.Parameters (). ElementAt (index) .k = "@most 0" paramQuery.Parameters (). ElementAt (index) .Value = "tableTwo.ID" * / MySqlDataReader Reader = cmd.ExecuteReader (); While (reader.Read ()) {// do stuff} } One of the tables I attempt to join is For the table, two with the same id for all. Is there something that I'm doing wrong?
Read more