mr13.5.1
mr14.0
mr14.0.1
master
mr13.5
mr10.5
mr10.5.9
mr13.4
mr13.4.1
mr13.3
mr13.3.1
mr13.2
mr13.2.1
mr13.1.1
mr12.5.1
mr13.0.1
mr12.5
mr13.0
mr13.1
mr10.5.8
mr11.5.1
mr11.5
mr9.5
mr9.5.9
mr12.4.1
mr12.4
mr12.3.1
mr12.3
mr10.5.7
mr12.2
mr12.2.1
mr12.1
mr12.1.1
mr8.5
mr8.5.12
mr10.5.6
mr12.0
mr12.0.1
mr9.5.8
mr10.5.5
mr11.4
mr11.4.1
mr9.5.7
mr7.5.5
mr8.5.11
mr11.3
mr11.3.1
mr11.2.1
mr10.5.4
mr11.2
mr10.5.3
mr8.5.10
mr9.5.6
mr11.1
mr11.1.1
mr10.5.2
mr11.0
mr11.0.1
mr7.5
mr7.5.13
mr10.5.1
mr9.5.5
mr8.5.9
mr7.5.12
mr10.4
mr10.4.1
mr8.1.1
mr8.5.8
mr9.5.4
mr10.3
mr10.3.1
mr7.5.4
mr7.5.11
mr9.5.3
mr10.2
mr10.2.1
mr8.5.7
mr6.5
mr6.5.13
mr10.1
mr10.1.1
mr8.5.6
mr9.5.2
mr10.0
mr10.0.1
mr7.5.10
mr8.5.5
mr9.5.1
mr7.5.9
mr9.4
mr9.4.1
mr8.5.4
mr7.5.8
mr6.5.12
mr9.3
mr9.3.1
mr7.5.7
mr8.5.3
mr9.2
mr9.2.1
mr6.5.11
mr9.1
mr9.1.1
mr5.5
mr5.5.13
mr8.5.2
mr7.5.6
mr8.0.2
mr8.4
mr8.3
mr8.2
mr8.1
mr8.0
mr9.0
mr9.0.1
mr7.5.1
mr6.5.10
mr8.4.2
mr8.5.1
mr8.3.2
mr5.5.12
mr8.4.1
mr6.5.9
mr8.2.2
mr8.3.1
mr6.5.8
mr8.1.2
mr8.2.1
mr7.5.3
mr7.5.2
mr8.0.1
mr6.5.7
mr5.5.11
mr6.5.6
mr7.4
mr7.4.2
mr5.5.10
mr7.3
mr7.3.2
mr7.4.1
mr6.5.5
mr7.2
mr7.2.2
mr5.5.9
mr7.3.1
mr6.5.4
mr7.1
mr7.1.2
mr6.5.2
mr7.0
mr7.2.1
mr5.5.8
mr7.0.2
mr6.5.3
mr7.1.1
mr6.5.1
mr7.0.1
mr5.5.7
mr6.4
mr6.4.2
mr6.4.1
mr5.5.6
mr6.3
mr6.3.2
mr6.2
mr6.2.2
mr6.3.1
mr5.5.5
mr6.1
mr6.1.2
mr6.2.1
mr5.5.4
mr6.0
mr6.0.2
mr5.5.3
mr6.1.1
mr6.0.1
mr5.5.2
mr5.4
mr5.4.2
mr5.5.1
mr5.3
mr5.3.2
mr5.4.1
mr5.2
mr5.2.2
mr5.3.1
mr5.1
mr5.1.2
mr5.2.1
mr5.0
mr5.0.2
mr5.1.1
mr5.0.1
mr10.0.1.1
mr10.1.1.1
mr10.2.1.1
mr10.3.1.1
mr10.4.1.1
mr10.5.1.1
mr10.5.2.1
mr10.5.3.1
mr10.5.4.1
mr10.5.5.1
mr10.5.6.1
mr10.5.7.1
mr10.5.8.1
mr10.5.9.1
mr11.0.1.1
mr11.1.1.1
mr11.2.1.1
mr11.2.1.2
mr11.3.1.1
mr11.4.1.1
mr11.5.1.1
mr11.5.1.2
mr11.5.1.3
mr11.5.1.4
mr12.0.1.1
mr12.1.1.1
mr12.2.1.1
mr12.3.1.1
mr12.3.1.2
mr12.4.1.1
mr12.4.1.2
mr12.5.1.1
mr12.5.1.2
mr12.5.1.3
mr12.5.1.4
mr13.0.1.1
mr13.0.1.2
mr13.0.1.3
mr13.0.1.4
mr13.1.1.1
mr13.1.1.2
mr13.1.1.3
mr13.1.1.4
mr13.2.1.1
mr13.3.1.1
mr13.4.1.1
mr13.5.1.1
mr13.5.1.2
mr14.0.1.1
mr5.0.1.1
mr5.0.2.1
mr5.1.1.1
mr5.1.2.1
mr5.2.1.1
mr5.2.2.1
mr5.3.1.1
mr5.3.2.1
mr5.4.1.1
mr5.4.2.1
mr5.5.1.1
mr5.5.10.1
mr5.5.11.1
mr5.5.12.1
mr5.5.13.1
mr5.5.2.1
mr5.5.3.1
mr5.5.3.2
mr5.5.4.1
mr5.5.5.1
mr5.5.6.1
mr5.5.7.1
mr5.5.8.1
mr5.5.9.1
mr6.0.1.1
mr6.0.2.1
mr6.1.1.1
mr6.1.2.1
mr6.2.1.1
mr6.2.2.1
mr6.3.1.1
mr6.3.2.1
mr6.4.1.1
mr6.4.1.2
mr6.4.2.1
mr6.5.1.1
mr6.5.1.2
mr6.5.1.3
mr6.5.10.1
mr6.5.11.1
mr6.5.12.1
mr6.5.13.1
mr6.5.2.1
mr6.5.2.2
mr6.5.2.3
mr6.5.2.4
mr6.5.2.5
mr6.5.2.6
mr6.5.2.7
mr6.5.2.8
mr6.5.3.1
mr6.5.3.2
mr6.5.3.3
mr6.5.4.1
mr6.5.5.1
mr6.5.6.1
mr6.5.7.1
mr6.5.8.1
mr6.5.9.1
mr7.0.1.1
mr7.0.1.2
mr7.0.1.3
mr7.0.2.1
mr7.1.1.1
mr7.1.2.1
mr7.2.1.1
mr7.2.2.1
mr7.3.1.1
mr7.3.2.1
mr7.4.1.1
mr7.4.2.1
mr7.5.1.1
mr7.5.1.10
mr7.5.1.11
mr7.5.1.12
mr7.5.1.2
mr7.5.1.3
mr7.5.1.4
mr7.5.1.5
mr7.5.1.6
mr7.5.1.7
mr7.5.1.8
mr7.5.1.9
mr7.5.10.1
mr7.5.11.1
mr7.5.12.1
mr7.5.13.1
mr7.5.2.1
mr7.5.2.2
mr7.5.2.3
mr7.5.2.4
mr7.5.2.5
mr7.5.2.6
mr7.5.3.1
mr7.5.4.1
mr7.5.4.2
mr7.5.4.3
mr7.5.4.4
mr7.5.4.5
mr7.5.4.6
mr7.5.4.7
mr7.5.4.8
mr7.5.4.9
mr7.5.5.1
mr7.5.5.10
mr7.5.5.11
mr7.5.5.12
mr7.5.5.13
mr7.5.5.14
mr7.5.5.15
mr7.5.5.16
mr7.5.5.17
mr7.5.5.18
mr7.5.5.19
mr7.5.5.2
mr7.5.5.3
mr7.5.5.4
mr7.5.5.5
mr7.5.5.6
mr7.5.5.7
mr7.5.5.8
mr7.5.5.9
mr7.5.6.1
mr7.5.7.1
mr7.5.8.1
mr7.5.9.1
mr8.0.1.1
mr8.0.1.2
mr8.0.1.3
mr8.0.2.1
mr8.0.2.2
mr8.0.2.3
mr8.1.1.1
mr8.1.1.10
mr8.1.1.11
mr8.1.1.12
mr8.1.1.13
mr8.1.1.14
mr8.1.1.15
mr8.1.1.16
mr8.1.1.17
mr8.1.1.18
mr8.1.1.19
mr8.1.1.2
mr8.1.1.20
mr8.1.1.3
mr8.1.1.4
mr8.1.1.5
mr8.1.1.6
mr8.1.1.7
mr8.1.1.8
mr8.1.1.9
mr8.1.2.1
mr8.2.1.1
mr8.2.1.2
mr8.2.2.1
mr8.3.1.1
mr8.3.2.1
mr8.4.1.1
mr8.4.2.1
mr8.5.1.1
mr8.5.10.1
mr8.5.11.1
mr8.5.12.1
mr8.5.2.1
mr8.5.3.1
mr8.5.4.1
mr8.5.5.1
mr8.5.6.1
mr8.5.7.1
mr8.5.8.1
mr8.5.9.1
mr9.0.1.1
mr9.1.1.1
mr9.2.1.1
mr9.3.1.1
mr9.4.1.1
mr9.5.1.1
mr9.5.2.1
mr9.5.3.1
mr9.5.4.1
mr9.5.5.1
mr9.5.6.1
mr9.5.7.1
mr9.5.7.2
mr9.5.8.1
mr9.5.9.1
${ noResults }
309 Commits (master)
| Author | SHA1 | Message | Date |
|---|---|---|---|
|
|
b4f244a9f1 |
MT#18663 MT#20893 row bulk processing framework WIP #7
+allow #* symbols in setoptionitems in Features_Define.cfg +prevent double execution+log properly +make sure to close all db connections before forking threads, not only project-specific ones +per-db dao folder for ipgallery migration project +start with ngcp db dao's: +contract_balances +contracts +refactor dao/sql processing class +params hash for method with long arg list +take out obselete methods +dedicated unique field option for "insert_record" +split SqlRecord class into SqlRecord&SqlProcessor +dependencies in Build.pl and debian/control +took out comments from debian/control +calcualte deltas of Subscriber_Define.cfg imports +"truncate subscriber import" task Change-Id: I8eab88319e6a4ba3d5b6ba935e50a56cc1763ad9 |
10 years ago |
|
|
1c669a3a73 |
MT#18663 row bulk processing framework WIP #6
+import LNP_Define.cfg +workingdir folder for rollback logs +cleanup task +chained task execution +dry mode for import +refactoring txn demaraction for rowblock db operations +take out "lock table" impl completely, too dangerous +take out DateTime::Format::Excel dependency for now +allow '#' comments in Subscriber_Define.cfg and Lnp_Define.cfg +check for import sequence +referential integrity checks for Subscriber_Define.cfg +task summary messages / rowcounts +exclude and exclude exception number patterns for Subscriber_Define.cfg +ignore_unique options Change-Id: If1f5094e15828633e212b1a8d651c97816c388b3 |
10 years ago |
|
|
52d66ca0de |
MT#18663 MT#20893 row bulk processing framework WIP #5
+setting to drop duplicate setoptionitems in Feature_Define.cfg +adjust Feature_Define.cfg threads vs block size settings to arrange with a low sqlite busy_timeout +Subscriber_Define.cfg importer +resolve garbage collector problems with log4perl +refactoring to conform with perl module lib/folder structure for installation -runs again Change-Id: I1821cc0085086684c3c1415be4c262453509045a |
10 years ago |
|
|
cc3e93d77b |
MT#20893 Initial dummy package
Change-Id: I6d80f83c6cd4ec59959b65a21826a6adf3adf0fe |
10 years ago |
|
|
4570a01bbc |
MT#18663 row bulk processing framework WIP #4
+"import" stage continued: +Dao's/db schema for the sqlite db to map the Features_Define.cfg content +project-specific connector pool +Importing Features_Define.cfg is working, 1.2+4.2 mio. records can be inserted into the temporary sqlite db in 4min40sec using 4 hyperthread cpus +importing melita's remaining files from the set will be less complicated by far +GetOpt setup +a stage is a task, multiple tasks can be passed as args, to be executed at once +dry mode option +force option +project settings file extended Change-Id: I6a84eb90756ad382dc3e96636220254b5e3b5023 |
10 years ago |
|
|
0d40b0c4ff |
MT#18663 row bulk processing framework WIP #3
+input/output folder permission -> process umask fix +config file loading fallbacks +refactor to allow custom additions within "Projects" subdirs +settings file per project +make RestConnectors compiling +make thread states used in thread queue patterns more verbose/readable +multithreaded text file processor -linesplitter, fieldsplitter callbacks +poc: marpa r2 parsergenerator to parse Features_Define.cfg by declaring the syntax via BNF +try to make it work +evaluating the syntax tree to get a final row data structure turns out to be slow +hence moving parsing to processor threads +evaluating a Features_Define.cfg record into a perl data structure succeeded. +class hierarchy for file processors +main "migrate.pl" layout Change-Id: I1550e2689bb5640931787fc70e9b5b00432dd0a2 |
10 years ago |
|
|
656e373f57 |
MT#18663 row bulk processing framework WIP #2
+included Excel::Reader::XLSX, as it was discontinued +FakeTime +rest connectors class hierarchy +ngcp rest api connector +support for yml config files +log4perl initialisation refactored +separate a "working paht" from the application_path, to be friendly with packaging/installation Change-Id: If56c27a3c3b8b526b5abc7a29e049a0db6a43ad6 |
10 years ago |
|
|
9027e86928 |
MT#18663 row bulk processing framework WIP
initial commit .gitignore .percriticrc - doesn't work no critic per file Change-Id: If46efa9a6b008861d3e7a527c47715743fef2579 |
10 years ago |
|
|
538fc41bd3 |
MT#18529 Add .gitreview for bulk-processor
Change-Id: If65a1ea5427f156f8bae6f037443c40870bfb406 |
10 years ago |