Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

CommitDateAuthorMessage
c3e99042012-12-20 07:58:10 +0100Kåre Fiedler ChristiansenQuote ' in looking up ids
8780a582012-12-13 22:55:04 +0100Kåre Fiedler ChristiansenDowngrade doms client dependency to latest functional version that matches server. Also add ignored test skeleton that works on real DOMS.
2dd56682012-12-13 22:53:43 +0100Kåre Fiedler ChristiansenUse namespace in program broadcast xpath query
9eb1d752012-12-13 22:52:39 +0100Kåre Fiedler ChristiansenUpdate schema to have namespace on programStructure
15b0ce02012-12-13 22:52:00 +0100Kåre Fiedler ChristiansenRemove obsolete ffprobe injector
6c027932012-12-13 10:40:33 +0100Kåre Fiedler ChristiansenAdd skeleton test
c5fb7b82012-12-13 10:40:14 +0100Kåre Fiedler ChristiansenUse namespaced xpath queries
57410fd2012-12-13 10:39:48 +0100Kåre Fiedler ChristiansenFix bug where exception should be ignored on no previous program in DOMS
2b90d512012-12-13 10:38:24 +0100Kåre Fiedler ChristiansenUpgrade xsd schema version
e0be8ae2012-12-13 08:21:16 +0100Kåre Fiedler ChristiansenDowngrade dependency
dff2a582012-12-12 23:13:18 +0100Adam TuliniusAdd missing version-information for the shardmigrator-dependency.
e9fea6e2012-12-12 22:58:26 +0100Adam TuliniusIgnore .idea/
319ff892012-12-04 11:34:21 +0100Kåre Fiedler ChristiansenHuge cleanup of doms ingester. Shorter and simplified, and supports new digitv exporter format
7b713702012-12-03 07:56:06 +0100Kåre Fiedler ChristiansenSlight cleanup of getting old IDs
51512c92012-11-12 17:26:13 +0100Asger Askov Blekingeremember to add teh transformers to the dependency management list....
fe147402012-11-12 17:25:46 +0100Asger Askov Blekingeupdated the doms radio tv ingester to the new datamodel, and made it depend on the transformers code
2af620e2012-09-20 23:24:49 +0200Kåre Fiedler ChristiansenSlightly better defaults for local testing
daf36ee2012-09-20 23:24:23 +0200Kåre Fiedler ChristiansenUpdate dependency on doms-client to bugfixed version
89bf2442012-09-20 18:08:02 +0200Kåre Fiedler ChristiansenIgnore idea files
8a9dadb2012-09-20 18:06:41 +0200Kåre Fiedler ChristiansenRemove idea files
ce49a832012-09-20 16:29:01 +0200Kåre Fiedler ChristiansenSupport multiple identifiers
816c2e32012-09-20 16:00:52 +0200Kåre Fiedler ChristiansenRemove redundant TODOs
68bafe32012-09-20 15:59:46 +0200Kåre Fiedler ChristiansenRemove shard object
9286c112012-09-20 10:10:41 +0200Kåre Fiedler ChristiansenAdded comments and TODOs for methods that need to be updated
7ed95832012-09-20 09:53:03 +0200Kåre Fiedler ChristiansenIncreased allowed number of failures during ingest
f17ba222012-09-20 09:52:25 +0200Kåre Fiedler ChristiansenInlined use of DOMS client
3271e9e2012-09-20 09:40:19 +0200Kåre Fiedler ChristiansenCode cleanup: Cleaned and documented method to move failed pid file
4362b992012-09-20 09:33:40 +0200Kåre Fiedler ChristiansenDocumented and moved the main work method
f4b22f02012-09-20 08:01:28 +0200Kåre Fiedler ChristiansenCode cleanup: Documented looking up PIDs of old programs in DOMS, and slightly cleaned up code.
88c173c2012-09-20 07:51:20 +0200Kåre Fiedler ChristiansenMake fileModified behave as fileAdded
c7331462012-09-20 07:50:04 +0200Kåre Fiedler ChristiansenSanitized fault barrier
97282182012-09-20 07:49:30 +0200Kåre Fiedler ChristiansenCode cleanup: Moved public methods to top, added some javadoc, sanitized constants, fields and initializations
bf67ad32012-09-20 07:28:09 +0200Kåre Fiedler ChristiansenReindented code
50ac4b32012-09-20 07:14:12 +0200Kåre Fiedler ChristiansenFix a few codestyle and documentation issues
8efdbb22012-09-19 11:16:59 +0200Kåre Fiedler ChristiansenCleanup defaults to not mention specific user dirs
e81f84b2012-08-25 17:02:25 +0200Kåre Fiedler ChristiansenMade code compile
2ed8d202012-08-25 16:52:15 +0200Kåre Fiedler ChristiansenRemoved obsolete modules directory
21bba642012-08-24 15:09:08 +0200Adam TuliniusAdd basic .gitignore
794982012-08-24 14:15:48 +0200Adam TuliniusDOMS-164 - migrate projects to git: Update pom.xml to reflect the new scm paths.
893dc9b2012-02-20 16:53:35 +0000Jeppe Ravn-GroveCommitting FFProbe metadata injector "as-is", to let other people work on it while jrg does work on other projects.
28ea8412012-02-15 14:34:04 +0000Kåre Fiedler ChristiansenMoved handleRegistrar to more proper location in tools
86594272012-02-14 16:43:38 +0000Jeppe Ravn-GroveBasicHandleRegistrar should be finished now. Next step will be to test it.
8cc7f7c2012-02-14 15:34:42 +0000Jeppe Ravn-GroveMore handle-registering. Implementing Claus/KB's ideas. Now only one method to do.
cd276ab2012-02-06 14:32:35 +0000Jeppe Ravn-GroveMore handle-registering. Better understanding now.
af282dd2012-02-06 13:13:30 +0000Jeppe Ravn-GroveMore handle-registering. Trying to rebuild what was thrown away by Idea or svn or whoever.
3e867f62012-02-03 15:44:27 +0000Kåre Fiedler ChristiansenSlight updates to framework
fb7454e2012-01-31 15:20:39 +0000Kåre Fiedler ChristiansenPossibly correct implementation of doms communication part. Needs testing
bbf08fa2012-01-25 17:08:49 +0000Jeppe Ravn-GroveBeginnings of handle-registering, including Maven-support for handle-lib.
11d2f622012-01-20 14:24:26 +0000Kåre Fiedler ChristiansenHandleRegistrar stub
88809002011-12-13 12:33:29 +0000Jeppe Ravn-GroveRefactoring FFProbeWrapper stuff
2282dcf2011-11-24 10:38:06 +0000Esben Agerbaek Blackmore documentation
01bfdd22011-11-24 10:02:04 +0000Esben Agerbaek Blackffprobe tools now uses a config file and has a README
727e4932011-11-23 12:39:30 +0000Esben Agerbaek Blackffprobe tools now uses a config file and has a README
1011622011-11-22 14:02:37 +0000Esben Agerbaek BlackFFProbe ingester and initial ffprobing wrapper
e76c5092011-03-16 17:37:23 +0000Asger Askov BlekingeShould now handle comments to the doms instance
105ce692011-03-16 17:35:38 +0000Asger Askov Blekinge[maven-release-plugin] prepare for next development iteration
68d85022011-03-16 17:34:41 +0000Asger Askov Blekinge[maven-release-plugin] prepare release ingesters-0.0.6
89a6bd02011-03-16 10:49:06 +0000Asger Askov BlekingeShould now handle comments to the doms instance
24d37102011-03-16 10:01:14 +0000Asger Askov Blekinge[maven-release-plugin] prepare for next development iteration
dff00192011-03-16 10:00:40 +0000Asger Askov Blekinge[maven-release-plugin] prepare release ingesters-0.0.5
e7a526f2011-03-15 17:03:11 +0000Asger Askov BlekingeShould now be an ingester that handles updates of objects
0dff62c2011-03-11 15:07:43 +0000Asger Askov Blekinge[maven-release-plugin] prepare for next development iteration
2b2a1962011-03-11 15:07:10 +0000Asger Askov Blekinge[maven-release-plugin] prepare release ingesters-0.0.4
50020552011-03-11 15:06:26 +0000Asger Askov Blekinge[maven-release-plugin] rollback the release of ingesters-0.0.4
706786f2011-03-11 15:05:51 +0000Asger Askov Blekinge[maven-release-plugin] prepare release ingesters-0.0.4
c89d5ec2011-03-11 15:04:52 +0000Asger Askov BlekingeThe final fixes, idea mostly
c2e36fc2011-03-11 14:58:11 +0000Asger Askov BlekingeFinal fixes before first maven release
fd7ae792011-03-11 14:41:48 +0000Asger Askov BlekingeSmall changes for better bundling with testbed
86708152011-03-11 11:24:24 +0000Asger Askov BlekingeShould bundle correctly now
4978e2d2011-03-11 10:58:38 +0000Asger Askov BlekingeFirst attempt at mavenizing the ingester. Will not bundle the scripts yet
ab770da2011-01-14 19:04:25 +0000Asger Askov Blekingemissing libs
496f4b02011-01-14 12:52:03 +0000Asger Askov BlekingeUpdating domsutils to newest version
7cb107d2011-01-14 12:27:55 +0000Asger Askov Blekingenew buildframeworkd distributed
faf588a2011-01-14 12:12:13 +0000Asger Askov Blekingenew buildframeworkd distributed
a46e5df2011-01-14 12:01:40 +0000Asger Askov Blekingenew buildframeworkd distributed
eca10a92011-01-14 11:56:48 +0000Asger Askov Blekingenew buildframeworkd distributed
bf5eeea2011-01-12 13:28:14 +0000Thomas Skou HansenUpdated the fedora admin password in the setenv.sh script which is deployed with the ingester.
f12485c2011-01-12 12:53:34 +0000Thomas Skou HansenCranked up the build version number to 0.0.4#SNAPSHOT after releasing version 0.0.3
e86a8e82011-01-12 12:43:53 +0000Thomas Skou HansenUpdated the hard-coded fedora admin password.
8c73a402011-01-12 12:15:26 +0000Esben Agerbaek BlackAltered coder to reflect unfrozen feature request "make RitzauProgramID a DC field"
9291902011-01-10 14:27:55 +0000Thomas Skou HansenAdded System.out, notifying about termination due to detection of a "stop file".
8280a982011-01-10 14:17:10 +0000Thomas Skou HansenCranked the build version number up to 0.0.3#SNAPSHOT
50051aa2011-01-10 13:08:18 +0000Thomas Skou HansenDefused some booby traps. The usage of static attributes in NonRecursiveHotfolderInspector could lead to nasty surprises, such as race conditions in the statistics calculation or termination of all running instances when the user expected to terminate only one.
551eb612011-01-05 16:52:34 +0000Asger Askov BlekingeOnly attempt to ingest .xml files, not anything in the folder
65f5e9f2010-11-30 09:59:06 +0000Thomas Skou Hansen- Fixed more date/time formatting issues. - The ingester now properly maintains a file in the lukewarm folder which contains the PIDs of the objects currently ingested but not yet published. This is quite useful in the event of an unexpected crash.
f2c70922010-11-26 10:01:22 +0000Thomas Skou HansenUpgraded the domsserver lib from version 0.0.11 to 0.0.14.
dfd30ef2010-11-25 15:23:42 +0000Thomas Skou Hansen-Fixed a bug in the processing of the -stopfile option. -Added proper formatting to the date/time-stamps printed by the ingester. -Updated the pre-ingest file schema.
40f85542010-11-23 10:32:45 +0000Asger Askov BlekingeFixed a broken javadoc ref
34c1a4b2010-11-23 10:30:22 +0000Asger Askov BlekingeUpdated the doms client
115b30d2010-11-19 11:53:34 +0000Esben Agerbaek Blackcomments added to some code
943d81f2010-11-19 10:24:24 +0000Esben Agerbaek Blackcomments added to some code
1036c002010-11-18 14:55:21 +0000Mads RavnUpdated the UNIT tests as well
84a49262010-11-18 10:51:56 +0000Mads RavnSecond step towards resolving issue DOMS-81, assumed solved
cffa00d2010-11-18 10:24:57 +0000Mads RavnSecond step towards resolving issue DOMS-81, assumed solved
b7103a82010-11-12 14:50:32 +0000Mads RavnFirst step towards resolving issue DOMS-81
357eed92010-11-10 13:09:15 +0000Asger Askov BlekingeIngester script
96e817d2010-11-09 16:41:27 +0000Mads RavnAdded a stopfolder option. You can specify stopfolder path through arguments and when you put a file named stoprunning into this folder, the program will stop running and exit.
709b39d2010-11-08 14:44:00 +0000Mads RavnCorrected to output to be ... correct.
ef121262010-11-03 16:03:20 +0000Mads RavnAdded some output to let the user know what is going on at start.
23525262010-11-03 15:58:40 +0000Mads RavnAdded some output to let the user know what is going on at start.
9640b3d2010-11-03 15:58:21 +0000Asger Askov BlekingedomsClient created when used, not in constructor
f071d922010-11-03 15:48:33 +0000Asger Askov BlekingeDomsClient threaded again
1b4ed172010-11-03 15:47:49 +0000Asger Askov BlekingeDomsClient threaded again
e1716ca2010-11-03 15:32:05 +0000Asger Askov BlekingeA bit of a restructure for some exception handling
a7136872010-11-03 15:31:30 +0000Asger Askov BlekingeNew version of domsclient
dba6c9e2010-11-03 14:18:26 +0000Asger Askov BlekingeUpdated libs and made stuff work with the new versions
6e652672010-10-28 14:04:04 +0000Asger Askov BlekingeMore explicit printout of speed
393fefa2010-10-28 10:40:11 +0000Asger Askov BlekingeNow accesses the files in sorted order
0ca1b792010-10-28 10:34:49 +0000Asger Askov BlekingePrints speed information as it goes along
e6394cb2010-10-27 13:46:46 +0000Thomas Skou HansenCranked up the build version from 0.0.1#SNAPSHOT to 0.0.2#SNAPSHOT.
fb4fc202010-10-27 13:37:22 +0000Asger Askov BlekingeDanish title=titel
67e6d482010-10-27 12:57:00 +0000Thomas Skou Hansen- Added a command line parameter on the executable ingester for specification of the full path to the pre-ingest file schema. - The ingester does no longer fetch the empty/template data stream contents of the data streams to update. It now just creates the documents from scratch and submit them to the DOMS. While this improves the performance, it is also a potential source of errors as any changes to the templates / document structure on the DOMS side will be ignored and overwritten.
c07d8dc2010-10-27 11:43:23 +0000Asger Askov BlekingeRemoved unused src package, and updated idea files
f67d6762010-10-26 12:50:26 +0000Thomas Skou Hansen- Removed the redundant DOMS client implementation from the project and added the domsclient library version 0.0.2. - Changed the port number for the DOMS server from 7880 to 7980. - The ingester now adds the program name as the object label on DOMS program objects.
7f0445a2010-10-26 12:09:51 +0000Mads RavnUpgraded to domsutil-0.0.11 and sbutil-0.5.2
ab3c5262010-10-25 13:46:42 +0000Thomas Skou HansenReplaced the hacky doms web service client library with the proper domsserver-0.0.8 library.
4c28f3d2010-10-22 08:53:06 +0000Mads RavnUpdated build-framework
57afb722010-10-22 08:51:19 +0000Mads RavnUpdating build-framework
83348762010-10-21 16:17:08 +0000Asger Askov BlekingeFor now, the ingester gets the datastreams from the template objects. Enable better caching
fecbb062010-10-20 10:53:20 +0000Mads Ravnupgraded domsutil-0.0.7 to domsutil-0.0.10
83bccac2010-10-20 10:42:53 +0000Mads Ravnupgraded domsutil-0.0.7 to domsutil-0.0.10
3c351db2010-10-19 14:45:14 +0000Asger Askov BlekingeAdded TODOs
c2b0d6c2010-10-14 13:54:15 +0000Mads RavnNearly ready - needs a place to put the title
60abf7b2010-10-14 11:39:29 +0000Thomas Skou HansenRemoved obsolete import statements.
c59da162010-10-14 07:34:10 +0000Asger Askov Blekingecommand line parameters
3d85fd62010-10-13 13:51:51 +0000Thomas Skou HansenRemoved obsolete variable;
0d106bf2010-10-12 15:40:37 +0000Asger Askov BlekingeMade a ingest.sh with usage information
5f2516b2010-10-12 15:37:58 +0000Asger Askov BlekingeBetter idea files
a1745b72010-10-12 15:36:58 +0000Asger Askov BlekingeDo not include getTime in the url...
dba9bab2010-10-12 14:14:53 +0000Thomas Skou Hansen- Created a new method on DOMSWSClient for adding a physical file to an existing DOMS file object, as the meta file / shard ingest method needed to create its file object first and then add the its 'phantom' file.
58cb8952010-10-11 07:51:35 +0000Thomas Skou HansenJust cleaned up/fixed some trivial TODOs and javadoc for a monday morning start-up exercise.
e90a2b62010-10-05 13:43:25 +0000Thomas Skou HansenCorrected the build to apply the latest released central web service interface.
705ad472010-10-04 08:46:16 +0000Thomas Skou HansenUpdated the central webservice interface to the latest released version and added the version number to the directory name.
9906a602010-09-24 06:38:28 +0000Thomas Skou HansenFinished a code tab-completion for Esben, so now the code compiles :-)
a987a2b2010-09-23 12:48:46 +0000Esben Agerbaek Blackhave begun implementing methods to handle fatal and max-recurring errors
82d1a9c2010-09-22 13:36:23 +0000Thomas Skou HansenAdded the radio-tv pre-ingest file schema for the validation performed by the ingester.
47302ad2010-09-22 13:33:42 +0000Thomas Skou Hansen- The pre-ingest files are now schema validated in order to make debugging easier. - Made the XML parser namespace aware when parsing PBCore metadata. However, I added a heap of hard-coded uglyness in the process - so I'll be back.
c1d3e122010-09-21 15:18:57 +0000Asger Askov Blekingeworking idea files
ad76b5d2010-09-21 09:15:06 +0000Thomas Skou Hansen- Added more javadoc. - Renamed DOMSClient to DOMSWSClient.
500450000002010-09-21 08:55:41 +0000Asger Askov Blekingeidea files
02a9b9e2010-09-20 13:15:09 +0000Asger Askov Blekingeingester updated to buildframework 11 #SNAPSHOT
ce4fbb12010-09-20 12:53:36 +0000Asger Askov BlekingeAdded folders
10f206f2010-09-20 12:52:19 +0000Asger Askov Blekingeproper indents
bba0e072010-09-20 12:25:55 +0000Asger Askov BlekingeUpdated build framework
d7c734d2010-09-20 12:14:24 +0000Thomas Skou HansenAdded missing lib directory.
1206c0d2010-09-20 12:10:57 +0000Thomas Skou HansenUpdated to the latest revision of the Central Webservice Interface.
19f8dfd2010-09-20 09:54:26 +0000Thomas Skou Hansenoops... forgot removing an obsolete import statement.
6a28bc02010-09-20 09:53:17 +0000Thomas Skou HansenAdded some javadoc more.
bbebb2c2010-09-17 14:08:49 +0000Thomas Skou Hansen-Removed System.out.println() which was accedentially checked in earlier. -Added a new-line to the end of the list of failed PIDs, when writing the file.
62986f32010-09-17 12:22:29 +0000Thomas Skou Hansen- Fixed broken exception handling in DOMSClient. - RadioTVMetadataProcessor now writes a file containing the PIDs of all ingested objects for each failed pre-ingest file. This is useful for debugging and cleaning up.
22405b92010-09-16 13:42:33 +0000Thomas Skou Hansen- Added license header where needed. - Removed an obsolete java file. - Added some more fixes to get the DOMS to accept the shard objects.
86c09dd2010-09-15 14:31:03 +0000Thomas Skou HansenAdded a format URI for the metafile/shard object. However, there is a problem with publishing the ingested objects. It has not yet been determined whether this is due to a client or server problem.
d31ee212010-09-15 14:26:25 +0000Thomas Skou HansenThe radio-TV ingester is now as complete as it can be at the current time. There are some outstanding issues due to lack of information or design decisions. Also, the code could use some cleaning and refactoring, however that is not important right now.
952e3862010-09-14 14:50:23 +0000Thomas Skou HansenShard / meta file metadata can now be updated. However, it is still unclear what the format should be like, thus, the element is not changed at ingest.
498d61b2010-09-14 14:39:23 +0000Thomas Skou HansenFile objects are now successfully ingested and Shards/meta files are currently "in the works".
f71cdeb2010-09-13 14:17:43 +0000Thomas Skou Hansen- Fixed minor bug in the hot-folder handling. No slashes were added when building the destination file path for failed files to be moved. - Successfully communicated with the DOMS server in a simple test making a query for an existing file object.
e356ad82010-09-10 14:09:37 +0000Thomas Skou HansenThe design is taking form... nothing works yet.
ef76efa2010-09-07 13:59:26 +0000Thomas Skou HansenFinished the code for the hot folder scanner. However, more elaborate JUnit testing would be nice.
8ee0d062010-09-06 14:40:02 +0000Thomas Skou HansenAdded centralWebserviceInterface.jar
1cfdd0f2010-09-06 14:35:22 +0000Thomas Skou HansenChecked in the first bits and pieces for the radio-tv ingester. Nothing works yet, however, it compiles.
6b73ae72010-09-06 09:53:03 +0000Thomas Skou HansenCreated directory structure and added libraries.
8c552772010-09-06 09:04:30 +0000Thomas Skou HansenAdded build scripts to the project.
ed523882010-09-06 08:54:56 +0000Thomas Skou HansenNew attempt to create a tree for example code.