Changes
- KEY:
- + = added feature, +M = mac only feature, +W = windows only feature
- - = removed feature,
- ~ = feature Change
- * = Bug/Issue Fix
- ! = Bug found / new issue
- FEATURES TO ADD:
- help! and Documentation.
- file size criterea
- regex usage
- modification date
- anon FTP socket
- KNOWN BUGS AND ISSUES:
- SPELLING
- Compiler related... (kind of) .. :|
- menu shortcut keys don't work unless a window is open
- Random nil object Exception crashes
- unhadled exception c00005 (error in RB)
- no new advanced search features work yet (regEX, fileSize and modified)
- no time-out on filesize thread
- file size is not saved
- sorting URL's has no effect on search/download order
- possible error when redirecting to different host
- interface tends to "Stick" with large queues
- analysis thread is a CPU Hog
- listbox flickers alot due to large number of refreshes
- moving errors back to search causes out of bounds in searchThread
- file:// resolution of networked drives faulty
- closing download window causes an error (use ignore errors as workaround)
- search thread crashes on bad URL/HTTP error
- HISTORY:
- 16/06/03:
- + Finally added custom Tag support
- + Added "as <img>" option to export to view found tags as images
- ~ Export now shows links in a nice table including the refering page
- * Altered close code to (try and) prevent crashes
- 27/03/02:
- ~ Add button now also inserts "http://" if needed
- * promote of multiple list items is fixed (infinite loop)
- 26/03/02:
- ~ importing a page now adds it to the que as a "file://" url
- ~ "http://" is now added to initial url if not present
- + usearch stats now includes errors (if any)
- + ignore Errors menu item to try to continue on an error(most errors
are logged to "crash report.txt"
- * Paste is fixed for use with new URL system
- * Refine now works with new URL system
- * moving urls from delete now works
- * fixed bug that caused blank entries when urls added multiple times
- * fileQue sorting works (insert sort algorithm)
- * multiple analysis threads should now work properly although
not much advantage to be gained due to new behaviour
- * quick analysis ctxtmnu is fixed
- +!refresh does not work
- ! search thread crashes on bad URL/HTTP error
- 20/03/02-24/03/02:
- ~ Complete re-write of URL storage/queueing system
- ~ Analysis thread is much improved (only one is now reqiured)
- + added handling of tags (used by google chache)
- + added debug menu for beta testing
- * less crashes (RB,c00005) when search que not visible (multithread)
- * full referer information is now saved/loded
- * proper handling of leading "/" URL's
- ! premote of multiple items is busted
- 20/03/02:
- * canceling loading a search (from file menu) no longer leaves empty search window
- ~ stop watch now visible when in "less" mode
- + web crawler now pretends to be a webbrowser(see prefs file to change)
- ~ Referer information is now saved (files found only)
- ~ error status info is now saved
- * templates now working again plus backwards compatable from this point
- * premote now works again
- - skip button removed use delete from menu/ctxtmenu
- * refine fixed
- * context menu now active again on right click
- * fixed error status information in history
- ! loading a saved search seems to crash when search is complete
- + new warning dialog when switching from advanced to simple modes
- * deleting a url now releases HTTP threads (if downloading).
- ! crash (RB,c00005) when search que not visible
- ~ Search Que is back to being polled every 1s to avoid freezes when multithreading
on slower computers.
- 19/03/02:
- + more informative history
- * better thread management
- * fixed SearchCompleted Bugs
- ! freeze on bad initial URL
- * filesize's now work better
- ~ Search Que is back to being polled every 200ms
- * interface stalls removed (Smarter thread checking)
- * fixed bug with urls being added too fast to list box->displayed incorrectly
- 18/03/02:
- + added multithreaded analysis
- ! interface stalling due to checking all threads
- + added stopwatch to searches
- ~ Search Que is polled every 500ms (due to interface stalls)
- 17/03/02:
- ~ tidied up listbox code
- + added multithreaded HTTP
- ! search Complete is broken
- 16/03/02:
- * fixed CVS issues
- * fixed Quick analysis problem
- ! premote seems to be broken
- ! filesize redirection doesn't work
- ! about box is broken
- 15/03/02:
- * fixed funny behaviour with /URL links in google
- * fixed odd behaviour in Link translation
- ~ simple search is now default (overide in prefs)
- ~ list boxes now work on keys so order not important
- ~ esc now pauses the search
- ~ more/Less button works better
- * fixed redirection problem with 0 length pages
- * fixed handling of single quote's
- ~ "all" checkbox is disabled when only one item
- ! Quick analysis ctxtMnu no longer works
- ! search que management needs work.
- 14/03/02:
- * fixed all the errors from yesturday
- + added Floating help
- + added headers to list boxes, (sorting is bad)
- + added incremental search to display windows
- + new simple/advanced search options windows
- + improved template file format
- 13/03/02:
- + added window items + prep for regex & file size crit
- + added Basic RegEx help menu and page
- ~ revamped prefs file (added Provission for expansion,
file criteria + regEx
- * fixed mishandling of query bug
- * fixed unquoted link extraction bug
- + added cut and paste functionallity
- ~ copying multiple URL's now copys as a list
- ~ pasting a list now adds all urls
- ~ improved query analysis
- 12/03/02:
- ~ initial URl now focused and selected on starting new search
- + delete and backspace keys now delete selection
- + copy to context menu© in edit menu works with URLs
- + Quick analysis to context menu
- 11/03/02:
- + URL's containing queries are now searched for embedded urls
- + Transfer-encoding now handled ("chunked" pages)
- + URL's now fully encoded/decoded using rfc standard for Hex substitution
- ~ Searching for tags has been speed up
- 10/03/02:
- + handling of "../" is done locally
- + Meta Http-Equiv tags can now be searched
- + "Show in Browser" option added to menu's
- ~ Search Que is polled every 200ms (was every 1s)
- + double click support for opening files or drag on to program icon
- 08/03/02:
- + context menu also activated by double click
- + context menu's reflected in search menu
- 07/03/02:
- + context menu's on list boxes
- + option to automatically search all query's
- 06/03/02:
- + added watchdog timer to skip pages that take too long
- * skipping URls now records properly in deleted history
- * File resuming works properly, file download windows more informative
- 04/03/02:
- + option to automaticlly download files as added to the que
- + Page being searched is now in bold in the srch Q
- * fixed crash when trying to promote/delete page being searched
- * fixed bug in HTTP, now completes transactions that occur in a
single packet properly
- 28/02/02:
- + Automatic resume,rename or skip for existing files when
downloading
- 27/02/02:
- + close download window on completion preference
- * fixed import and Search button behaviour on resizing
- + made the about window a bit nicer, but uses quicktime
- * downloading now handles redirection properly.
- + added more prefernces to prefs window, most don't work yet
- 26/02/02:
- * fixed handling of bad URL's that contain spaces and backslashes
- * downloading now detects error
- + can now load and save searches in progress, although currently referrer info
is lost
- * refine no longers ignores changes when criterea are removed
- 25/02/02:
- + added trace button to search panel(will move to menu or off panels)
- + added ability to save a default template(saved in prefs file)
- + added ability to save search in progress(no loading yet though)
- 24/02/02:
- + HTTP/URL's now recognise "file://somefile.gif" style URL's
- * fixed # references bug
- * Search thread now works properly (reduced interface freeze ups)
- 23/02/02:
- * trace button (and others) disabling on show/hide
- *W error/deleted list should now display properly
- + can now import/search a HTML file
- 22/02/02:
- + added ability to re-search URLs in the history
- + added Bad Urls and deleted URL's to history panel
- + file trace using referer information
- + added preference page to be expanded in future
- + selectable download Directory
- + selectable export format, plaintext/HTML, headers or simple (for use with 3rd
party downloaders like dwnld deputy, getright and bpftp)
- ~ add referal information to url & HTTP requests
- * Refining a google search translates back to original keywords
- * redirecting to https no longer causes infinite redirection loop
- ~ search now moved to thread to reduce interface freeze ups
- ~ HTTP now uses persistent connections to speed up multiple requests to same
host
- 21/02/02:
- + ability to load/save search Criterea as templates from "new search window"
- ~ refine now works on the search in progress rather than starting a new search
- 18/02/02:
- * Deletions from search queue no longer cause crashes
- * Deletions in the search queue now updates the stats
- * export file list menu is now enabled.(properly)
- * cancel of export nolonger causes crash
- + Skip page button to move off stalled pages
- - Removed save from seach window (menu to be used instead)
- 17/02/02:
- ~ extended Documentation
- ~ HTTP errors no longer display a msg box
- ~ Export file list uses default file name consisting in part of current date and
time
- + Export Filelist option now listed in the menu.
- 14/02/02:
- + added basic documentation
- + added heaps of ideas to the "features to add" list.
- 13/02/02:
- + Option to use a google search as the initial URL.
- ~ File list now exports as html
- * address not found error stalls search. bad TCP connection now skips URL
- * hiding details on search causes buttons to move about.
- * inpage '#' references should now be ignored (by URLClass)
- 12/02/02:
- + Started change History
- + Refine button functionallity
- + Delete, Promote & Add buttons on the search Que
- + HTTP 1.1 compatabilityfor all http requests
including automatic redirection.
- + Tooltips added for newsearch and search windows
- + Frame searching, (Frames appear as links in Quick Analysis)
- ~ refined mHTML code to use new generic tag search function
- ??/??/02-11/02/02:
- rewrote entire program from scratch in RealBasic after Visual Basic prototype
became cluttered and a fresh approach was needed, now done with Object orientated
approach (reusable HTTP and HTML classes created) and support for MacOS