How Can I Open Large Text Files In C# and Check Through them Faster?

[275]

Hey guys I was wondering how I can open up a FAT DB in C#. I basically made a DB lookup/search in C#. Where the user can enter a email and it prints the full combo. So far I've got to the point where I can search through smaller dbs but when I put lets say Exploit.In, It will take FOREVER. Can anyone help me speed up the process? Here is the code so you guys can try to help. Sorry if it very sloppy code, Im pretty new at C#.

BTW I have a good pc so thats not the problem.

Hidden Content

You must register or login to view this content.

[75]

You could either use an Indexer (Fastest), or you could use a Parralel.foreach loop. Indexer is by far the fastest with iteration though so i'd recommend that.

Indexer + Lock object + Multithreading. 

If you are paying I can write you a piece of code that would be by far the fastest way of iteration.

 

[45]

hmmmmm

[1]

I need to see the code posted first

---

I think you better use sqlite which is a simple but powerful embedded database. So my recommendation:

- learn how to use sqlite
- create a simple data transfer program to read from the raw text files and insert the data into sqlite (you just need to execute this program once)
- use sqlite for your lookup program, it will be much faster since database are designed for thing like that.

The second method is to split the files. For example, split the file by alphabet.

[417]

Thanks