mr13.3
mr13.3.1
master
mr13.2
mr13.2.1
mr13.1.1
mr12.5.1
mr13.0.1
mr12.5
mr13.0
mr13.1
mr10.5
mr10.5.8
mr11.5.1
mr11.5
mr9.5
mr9.5.9
mr12.4.1
mr12.4
mr12.3.1
mr12.3
mr10.5.7
mr12.2
mr12.2.1
mr12.1
mr12.1.1
mr8.5
mr8.5.12
mr10.5.6
mr12.0
mr12.0.1
mr9.5.8
mr10.5.5
mr11.4
mr11.4.1
mr9.5.7
mr7.5.5
mr8.5.11
mr11.3
mr11.3.1
mr11.2.1
mr10.5.4
mr11.2
mr10.5.3
mr8.5.10
mr9.5.6
mr11.1
mr11.1.1
mr10.5.2
mr11.0
mr11.0.1
mr7.5
mr7.5.13
mr10.5.1
mr9.5.5
mr8.5.9
mr7.5.12
mr10.4
mr10.4.1
mr8.1.1
mr8.5.8
mr9.5.4
mr10.3
mr10.3.1
mr7.5.4
mr7.5.11
mr9.5.3
mr10.2
mr10.2.1
mr8.5.7
mr6.5
mr6.5.13
mr10.1
mr10.1.1
mr8.5.6
mr9.5.2
mr10.0
mr10.0.1
mr7.5.10
mr8.5.5
mr9.5.1
mr7.5.9
mr9.4
mr9.4.1
mr8.5.4
mr7.5.8
mr6.5.12
mr9.3
mr9.3.1
mr7.5.7
mr8.5.3
mr9.2
mr9.2.1
mr6.5.11
mr9.1
mr9.1.1
mr5.5
mr5.5.13
mr8.5.2
mr7.5.6
mr8.0.2
mr8.4
mr8.3
mr8.2
mr8.1
mr8.0
mr9.0
mr9.0.1
mr7.5.1
mr6.5.10
mr8.4.2
mr8.5.1
mr8.3.2
mr5.5.12
mr8.4.1
mr6.5.9
mr8.2.2
mr8.3.1
mr6.5.8
mr8.1.2
mr8.2.1
mr7.5.3
mr7.5.2
mr8.0.1
mr6.5.7
mr5.5.11
mr6.5.6
mr7.4
mr7.4.2
mr5.5.10
mr7.3
mr7.3.2
mr7.4.1
mr6.5.5
mr7.2
mr7.2.2
mr5.5.9
mr7.3.1
mr6.5.4
mr7.1
mr7.1.2
mr6.5.2
mr7.0
mr7.2.1
mr5.5.8
mr7.0.2
mr6.5.3
mr7.1.1
mr6.5.1
mr7.0.1
mr5.5.7
mr6.4
mr6.4.2
mr6.4.1
mr5.5.6
mr6.3
mr6.3.2
mr6.2
mr6.2.2
mr6.3.1
mr5.5.5
mr6.1
mr6.1.2
mr6.2.1
mr5.5.4
mr6.0
mr6.0.2
mr5.5.3
mr6.1.1
mr6.0.1
mr5.5.2
mr5.4
mr5.4.2
mr5.5.1
mr5.3
mr5.3.2
mr5.4.1
mr5.2
mr5.2.2
mr5.3.1
mr5.1
mr5.1.2
mr5.2.1
mr5.0
mr5.0.2
mr5.1.1
mr5.0.1
mr10.0.1.1
mr10.1.1.1
mr10.2.1.1
mr10.3.1.1
mr10.4.1.1
mr10.5.1.1
mr10.5.2.1
mr10.5.3.1
mr10.5.4.1
mr10.5.5.1
mr10.5.6.1
mr10.5.7.1
mr10.5.8.1
mr11.0.1.1
mr11.1.1.1
mr11.2.1.1
mr11.2.1.2
mr11.3.1.1
mr11.4.1.1
mr11.5.1.1
mr11.5.1.2
mr11.5.1.3
mr11.5.1.4
mr12.0.1.1
mr12.1.1.1
mr12.2.1.1
mr12.3.1.1
mr12.3.1.2
mr12.4.1.1
mr12.4.1.2
mr12.5.1.1
mr12.5.1.2
mr12.5.1.3
mr12.5.1.4
mr13.0.1.1
mr13.0.1.2
mr13.0.1.3
mr13.0.1.4
mr13.1.1.1
mr13.1.1.2
mr13.1.1.3
mr13.1.1.4
mr13.2.1.1
mr5.0.1.1
mr5.0.2.1
mr5.1.1.1
mr5.1.2.1
mr5.2.1.1
mr5.2.2.1
mr5.3.1.1
mr5.3.2.1
mr5.4.1.1
mr5.4.2.1
mr5.5.1.1
mr5.5.10.1
mr5.5.11.1
mr5.5.12.1
mr5.5.13.1
mr5.5.2.1
mr5.5.3.1
mr5.5.3.2
mr5.5.4.1
mr5.5.5.1
mr5.5.6.1
mr5.5.7.1
mr5.5.8.1
mr5.5.9.1
mr6.0.1.1
mr6.0.2.1
mr6.1.1.1
mr6.1.2.1
mr6.2.1.1
mr6.2.2.1
mr6.3.1.1
mr6.3.2.1
mr6.4.1.1
mr6.4.1.2
mr6.4.2.1
mr6.5.1.1
mr6.5.1.2
mr6.5.1.3
mr6.5.10.1
mr6.5.11.1
mr6.5.12.1
mr6.5.13.1
mr6.5.2.1
mr6.5.2.2
mr6.5.2.3
mr6.5.2.4
mr6.5.2.5
mr6.5.2.6
mr6.5.2.7
mr6.5.2.8
mr6.5.3.1
mr6.5.3.2
mr6.5.3.3
mr6.5.4.1
mr6.5.5.1
mr6.5.6.1
mr6.5.7.1
mr6.5.8.1
mr6.5.9.1
mr7.0.1.1
mr7.0.1.2
mr7.0.1.3
mr7.0.2.1
mr7.1.1.1
mr7.1.2.1
mr7.2.1.1
mr7.2.2.1
mr7.3.1.1
mr7.3.2.1
mr7.4.1.1
mr7.4.2.1
mr7.5.1.1
mr7.5.1.10
mr7.5.1.11
mr7.5.1.12
mr7.5.1.2
mr7.5.1.3
mr7.5.1.4
mr7.5.1.5
mr7.5.1.6
mr7.5.1.7
mr7.5.1.8
mr7.5.1.9
mr7.5.10.1
mr7.5.11.1
mr7.5.12.1
mr7.5.13.1
mr7.5.2.1
mr7.5.2.2
mr7.5.2.3
mr7.5.2.4
mr7.5.2.5
mr7.5.2.6
mr7.5.3.1
mr7.5.4.1
mr7.5.4.2
mr7.5.4.3
mr7.5.4.4
mr7.5.4.5
mr7.5.4.6
mr7.5.4.7
mr7.5.4.8
mr7.5.4.9
mr7.5.5.1
mr7.5.5.10
mr7.5.5.11
mr7.5.5.12
mr7.5.5.13
mr7.5.5.14
mr7.5.5.15
mr7.5.5.16
mr7.5.5.17
mr7.5.5.18
mr7.5.5.19
mr7.5.5.2
mr7.5.5.3
mr7.5.5.4
mr7.5.5.5
mr7.5.5.6
mr7.5.5.7
mr7.5.5.8
mr7.5.5.9
mr7.5.6.1
mr7.5.7.1
mr7.5.8.1
mr7.5.9.1
mr8.0.1.1
mr8.0.1.2
mr8.0.1.3
mr8.0.2.1
mr8.0.2.2
mr8.0.2.3
mr8.1.1.1
mr8.1.1.10
mr8.1.1.11
mr8.1.1.12
mr8.1.1.13
mr8.1.1.14
mr8.1.1.15
mr8.1.1.16
mr8.1.1.17
mr8.1.1.18
mr8.1.1.19
mr8.1.1.2
mr8.1.1.20
mr8.1.1.3
mr8.1.1.4
mr8.1.1.5
mr8.1.1.6
mr8.1.1.7
mr8.1.1.8
mr8.1.1.9
mr8.1.2.1
mr8.2.1.1
mr8.2.1.2
mr8.2.2.1
mr8.3.1.1
mr8.3.2.1
mr8.4.1.1
mr8.4.2.1
mr8.5.1.1
mr8.5.10.1
mr8.5.11.1
mr8.5.12.1
mr8.5.2.1
mr8.5.3.1
mr8.5.4.1
mr8.5.5.1
mr8.5.6.1
mr8.5.7.1
mr8.5.8.1
mr8.5.9.1
mr9.0.1.1
mr9.1.1.1
mr9.2.1.1
mr9.3.1.1
mr9.4.1.1
mr9.5.1.1
mr9.5.2.1
mr9.5.3.1
mr9.5.4.1
mr9.5.5.1
mr9.5.6.1
mr9.5.7.1
mr9.5.7.2
mr9.5.8.1
mr9.5.9.1
${ noResults }
7 Commits (52d66ca0dee62c7ec82cae38d17d5c7d61276f3f)
| Author | SHA1 | Message | Date |
|---|---|---|---|
Rene Krenn
|
52d66ca0de |
MT#18663 MT#20893 row bulk processing framework WIP #5
+setting to drop duplicate setoptionitems in Feature_Define.cfg +adjust Feature_Define.cfg threads vs block size settings to arrange with a low sqlite busy_timeout +Subscriber_Define.cfg importer +resolve garbage collector problems with log4perl +refactoring to conform with perl module lib/folder structure for installation -runs again Change-Id: I1821cc0085086684c3c1415be4c262453509045a |
9 years ago |
Victor Seva
|
cc3e93d77b |
MT#20893 Initial dummy package
Change-Id: I6d80f83c6cd4ec59959b65a21826a6adf3adf0fe |
9 years ago |
|
Rene Krenn
|
4570a01bbc |
MT#18663 row bulk processing framework WIP #4
+"import" stage continued: +Dao's/db schema for the sqlite db to map the Features_Define.cfg content +project-specific connector pool +Importing Features_Define.cfg is working, 1.2+4.2 mio. records can be inserted into the temporary sqlite db in 4min40sec using 4 hyperthread cpus +importing melita's remaining files from the set will be less complicated by far +GetOpt setup +a stage is a task, multiple tasks can be passed as args, to be executed at once +dry mode option +force option +project settings file extended Change-Id: I6a84eb90756ad382dc3e96636220254b5e3b5023 |
9 years ago |
|
Rene Krenn
|
0d40b0c4ff |
MT#18663 row bulk processing framework WIP #3
+input/output folder permission -> process umask fix +config file loading fallbacks +refactor to allow custom additions within "Projects" subdirs +settings file per project +make RestConnectors compiling +make thread states used in thread queue patterns more verbose/readable +multithreaded text file processor -linesplitter, fieldsplitter callbacks +poc: marpa r2 parsergenerator to parse Features_Define.cfg by declaring the syntax via BNF +try to make it work +evaluating the syntax tree to get a final row data structure turns out to be slow +hence moving parsing to processor threads +evaluating a Features_Define.cfg record into a perl data structure succeeded. +class hierarchy for file processors +main "migrate.pl" layout Change-Id: I1550e2689bb5640931787fc70e9b5b00432dd0a2 |
9 years ago |
|
Rene Krenn
|
656e373f57 |
MT#18663 row bulk processing framework WIP #2
+included Excel::Reader::XLSX, as it was discontinued +FakeTime +rest connectors class hierarchy +ngcp rest api connector +support for yml config files +log4perl initialisation refactored +separate a "working paht" from the application_path, to be friendly with packaging/installation Change-Id: If56c27a3c3b8b526b5abc7a29e049a0db6a43ad6 |
9 years ago |
|
Rene Krenn
|
9027e86928 |
MT#18663 row bulk processing framework WIP
initial commit .gitignore .percriticrc - doesn't work no critic per file Change-Id: If46efa9a6b008861d3e7a527c47715743fef2579 |
9 years ago |
Alexander Lutay
|
538fc41bd3 |
MT#18529 Add .gitreview for bulk-processor
Change-Id: If65a1ea5427f156f8bae6f037443c40870bfb406 |
9 years ago |