What do you mean by sitting idle? It's being used. Probably for caching files. That's what an operating system should do - use available memory to make things faster and then release it when it is actually needed by an application. If this keeps you up at night, then open the terminal and type "purge".