There was no reason A Scanner Darkly had to be science fiction. It could have been set in contemporary times with contemporary technology.
He was right. No one at the time would give a shit about his mediocre prose if it wasn't for the sci-fi label. His writing itself is absolutely atrocious. It's the ideas people wank to, and most if not all of them have been done better by others in a non sci-fi context.