Having read "The Little Schemer" recently, yes, I definitely think you will get a lot from reading the book. What it teaches you is the recursive style of programming which is very prevalent in the Lisp world. The beauty of Lists is that it satisfies the closure property (not the Closure, the programming language concept, but Closure as in Mathematics where an operation on two elements from a set produces another unique element of the same set). The book teaches you all these advanced concepts without naming them and much more (for example, chapter 9 talks about Y Combinator, one of the most beautiful concepts in the Programming-Language/Logic theory).
I would suggest you to read it by all means, whether you learn Scheme or Clojure or any language.