Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem while indexing - indexing stopped #187

Closed
rusty9283 opened this issue Jun 25, 2019 · 2 comments
Closed

problem while indexing - indexing stopped #187

rusty9283 opened this issue Jun 25, 2019 · 2 comments

Comments

@rusty9283
Copy link

Hello!
I tried to index a network folder with about 2million files with:
opensemanticsearch-index-dir /media/folder/

after about 3 hours it stops.
THe last line is:
"indexing new file /media/folder/...." and nothing happens

Now i tried to delete the index and tried indexing again but now it comes only one line with "indexing new file /media/folder/...." and it stops again.

What can I do?

Or is there a better way to index a directory with so many files? We want also to reindex this directory one time every day.

By the way: where is the file "jetty-http.xml" to get access to SOlr remote admin from an other computer?

Many thanks!

@rusty9283
Copy link
Author

Sorry It was a server problem.

@Mandalka
Copy link
Collaborator

Mandalka commented Jul 3, 2019

"Indexing new file" is not the perfect label, since in this step not indexed / changed / new files are added to the queue. Document processing and indexing is done after that parallel in background, which takes much more time.

I'll change the label in opensemanticsearch/open-semantic-etl#91

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants